-- Logs begin at Wed 2022-10-12 01:51:01 UTC, end at Wed 2022-10-12 02:51:24 UTC. -- Oct 12 02:15:48.813261 dv-cinder-849143-14-smb systemd[1]: Starting Devstack devstack@keystone.service... Oct 12 02:15:48.821726 dv-cinder-849143-14-smb devstack@keystone.service[81350]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Oct 12 02:15:48.824322 dv-cinder-849143-14-smb devstack@keystone.service[81350]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Oct 12 02:15:48 2022] *** Oct 12 02:15:48.824322 dv-cinder-849143-14-smb devstack@keystone.service[81350]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Oct 12 02:15:48.824322 dv-cinder-849143-14-smb devstack@keystone.service[81350]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Oct 12 02:15:48.824322 dv-cinder-849143-14-smb devstack@keystone.service[81350]: nodename: dv-cinder-849143-14-smb Oct 12 02:15:48.824322 dv-cinder-849143-14-smb devstack@keystone.service[81350]: machine: x86_64 Oct 12 02:15:48.824773 dv-cinder-849143-14-smb devstack@keystone.service[81350]: clock source: unix Oct 12 02:15:48.824773 dv-cinder-849143-14-smb devstack@keystone.service[81350]: pcre jit disabled Oct 12 02:15:48.824985 dv-cinder-849143-14-smb devstack@keystone.service[81350]: detected number of CPU cores: 4 Oct 12 02:15:48.824985 dv-cinder-849143-14-smb devstack@keystone.service[81350]: current working directory: / Oct 12 02:15:48.824985 dv-cinder-849143-14-smb devstack@keystone.service[81350]: detected binary path: /usr/bin/uwsgi-core Oct 12 02:15:48.824985 dv-cinder-849143-14-smb devstack@keystone.service[81350]: your processes number limit is 47680 Oct 12 02:15:48.825265 dv-cinder-849143-14-smb devstack@keystone.service[81350]: your memory page size is 4096 bytes Oct 12 02:15:48.825265 dv-cinder-849143-14-smb devstack@keystone.service[81350]: detected max file descriptor number: 2048 Oct 12 02:15:48.825265 dv-cinder-849143-14-smb devstack@keystone.service[81350]: lock engine: pthread robust mutexes Oct 12 02:15:48.825265 dv-cinder-849143-14-smb devstack@keystone.service[81350]: thunder lock: enabled Oct 12 02:15:48.825521 dv-cinder-849143-14-smb devstack@keystone.service[81350]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Oct 12 02:15:48.825521 dv-cinder-849143-14-smb devstack@keystone.service[81350]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Oct 12 02:15:48.865044 dv-cinder-849143-14-smb devstack@keystone.service[81350]: Python main interpreter initialized at 0x562a5020c9c0 Oct 12 02:15:48.865044 dv-cinder-849143-14-smb devstack@keystone.service[81350]: python threads support enabled Oct 12 02:15:48.865044 dv-cinder-849143-14-smb devstack@keystone.service[81350]: your server socket listen backlog is limited to 100 connections Oct 12 02:15:48.865044 dv-cinder-849143-14-smb devstack@keystone.service[81350]: your mercy for graceful operations on workers is 90 seconds Oct 12 02:15:48.865420 dv-cinder-849143-14-smb devstack@keystone.service[81350]: mapped 403077 bytes (393 KB) for 2 cores Oct 12 02:15:48.865502 dv-cinder-849143-14-smb devstack@keystone.service[81350]: *** Operational MODE: preforking *** Oct 12 02:15:48.865734 dv-cinder-849143-14-smb devstack@keystone.service[81350]: *** uWSGI is running in multiple interpreter mode *** Oct 12 02:15:48.865734 dv-cinder-849143-14-smb devstack@keystone.service[81350]: spawned uWSGI master process (pid: 81350) Oct 12 02:15:48.865931 dv-cinder-849143-14-smb systemd[1]: Started Devstack devstack@keystone.service. Oct 12 02:15:48.867004 dv-cinder-849143-14-smb devstack@keystone.service[81350]: spawned uWSGI worker 1 (pid: 81361, cores: 1) Oct 12 02:15:48.867004 dv-cinder-849143-14-smb devstack@keystone.service[81350]: spawned uWSGI worker 2 (pid: 81362, cores: 1) Oct 12 02:15:48.867004 dv-cinder-849143-14-smb devstack@keystone.service[81350]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Oct 12 02:15:53.156114 dv-cinder-849143-14-smb devstack@keystone.service[81361]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 12 02:15:53.156114 dv-cinder-849143-14-smb devstack@keystone.service[81361]: from cryptography.utils import int_from_bytes Oct 12 02:15:53.156932 dv-cinder-849143-14-smb devstack@keystone.service[81361]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 12 02:15:53.156932 dv-cinder-849143-14-smb devstack@keystone.service[81361]: from cryptography.utils import int_from_bytes Oct 12 02:15:53.157052 dv-cinder-849143-14-smb devstack@keystone.service[81362]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 12 02:15:53.157052 dv-cinder-849143-14-smb devstack@keystone.service[81362]: from cryptography.utils import int_from_bytes Oct 12 02:15:53.157465 dv-cinder-849143-14-smb devstack@keystone.service[81362]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 12 02:15:53.157465 dv-cinder-849143-14-smb devstack@keystone.service[81362]: from cryptography.utils import int_from_bytes Oct 12 02:15:53.207055 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 12 02:15:53.207252 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 12 02:15:53.207344 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 12 02:15:53.207432 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] command line args: [] {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 12 02:15:53.207509 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 12 02:15:53.207679 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] command line args: [] {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 12 02:15:53.207766 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 12 02:15:53.207870 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] ================================================================================ {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 12 02:15:53.207948 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 12 02:15:53.208124 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] ================================================================================ {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 12 02:15:53.208201 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] admin_token = **** {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 02:15:53.208370 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] config_dir = [] {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 02:15:53.208459 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] admin_token = **** {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 02:15:53.208587 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 02:15:53.208673 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] config_dir = [] {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 02:15:53.208773 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] config_source = [] {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 02:15:53.208856 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 02:15:53.208953 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] debug = True {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 02:15:53.209042 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] config_source = [] {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 02:15:53.209155 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 02:15:53.209395 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] debug = True {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 02:15:53.209395 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 02:15:53.209539 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 02:15:53.209599 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 02:15:53.209742 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 02:15:53.209849 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 02:15:53.209950 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 02:15:53.210049 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 02:15:53.210157 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 02:15:53.210252 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 02:15:53.210392 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] list_limit = None {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 02:15:53.210500 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] list_limit = None {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 02:15:53.210599 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] log_config_append = None {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 02:15:53.210705 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] log_config_append = None {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 02:15:53.210810 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 02:15:53.210903 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 02:15:53.211001 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] log_dir = None {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 02:15:53.211105 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] log_dir = None {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 02:15:53.211199 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] log_file = None {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 02:15:53.211296 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] log_file = None {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 02:15:53.211400 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 02:15:53.211478 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 02:15:53.211599 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 02:15:53.211679 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 02:15:53.211798 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 02:15:53.211871 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 02:15:53.211994 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 02:15:53.212075 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 02:15:53.212193 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 02:15:53.212273 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 02:15:53.212349 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 02:15:53.212502 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 02:15:53.212578 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 02:15:53.212710 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 02:15:53.212832 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 02:15:53.212907 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 02:15:53.213029 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 02:15:53.213111 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 02:15:53.213260 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 02:15:53.213336 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 02:15:53.213492 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 02:15:53.213576 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 02:15:53.213722 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 02:15:53.213818 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 02:15:53.214063 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 02:15:53.214158 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 02:15:53.214298 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 02:15:53.214383 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 02:15:53.214581 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 02:15:53.214667 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 02:15:53.215074 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.18/identity {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 02:15:53.215153 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.18/identity {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 02:15:53.215263 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] publish_errors = False {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 02:15:53.215341 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] publish_errors = False {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 02:15:53.215500 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 02:15:53.215578 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 02:15:53.215737 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 02:15:53.215822 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 02:15:53.215899 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 02:15:53.215969 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 02:15:53.216146 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 02:15:53.216243 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 02:15:53.216381 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 02:15:53.216458 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 02:15:53.216645 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] standard_threads = False {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 02:15:53.216720 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] standard_threads = False {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 02:15:53.216877 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 02:15:53.216965 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 02:15:53.217121 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 02:15:53.217205 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 02:15:53.217302 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 02:15:53.217379 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 02:15:53.217480 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] use_journal = False {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 02:15:53.217618 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] use_journal = False {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 02:15:53.217693 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] use_json = False {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 02:15:53.217774 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] use_json = False {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 02:15:53.217852 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] use_stderr = False {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 02:15:53.217922 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] use_stderr = False {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 02:15:53.217990 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] use_syslog = False {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 02:15:53.218070 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] use_syslog = False {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 02:15:53.218195 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 02:15:53.218271 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 02:15:53.218447 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.218530 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.218686 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.218770 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.218944 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.219027 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.219182 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.219264 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.219430 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.219516 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.219667 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.219750 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.219912 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.219989 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.220148 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.220231 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.220392 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.220486 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.220668 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.220751 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.220915 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.221002 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.221147 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.221231 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.221396 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.221479 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.221630 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.221717 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.221875 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.221958 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.222120 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.222198 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.222354 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.222441 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.222605 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.222694 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.222857 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.222934 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.223100 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.223180 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.223333 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.223410 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.223583 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.223659 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.223841 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.223925 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.224092 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.224169 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.224339 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.224415 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.224594 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.224674 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.224824 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.224900 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.225054 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.225130 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.225289 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.225367 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.225534 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.225617 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.225779 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.225855 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.226008 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.226086 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.226239 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.226315 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.226484 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.226566 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.226729 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.226807 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.226962 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.227038 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.227209 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.227285 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.227438 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.227515 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.227672 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.227758 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.227905 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.227988 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.228132 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.228210 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.228359 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.228435 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.228611 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.228688 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.228839 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.228919 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.229062 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.229140 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.229307 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.229383 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.230109 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.230305 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.230379 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.230447 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.230515 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.230613 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.230755 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.230861 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.230990 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.231104 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.231235 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.231359 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.231465 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.231595 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.231700 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.231836 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.231938 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.232077 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.232171 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.232318 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.232403 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.232581 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.232662 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.232824 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.232893 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.233059 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.233131 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.233313 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.233390 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.233554 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.233632 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.233782 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.233863 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.234020 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.234104 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.234262 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.234340 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.234492 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.234570 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.234726 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.234799 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.234960 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.235036 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.235198 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.235275 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.235451 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.235528 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.235698 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.235774 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.235941 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.236025 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.236174 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.236250 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.236407 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.236499 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.236666 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.236746 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.236904 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.236980 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.237139 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.237214 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.237374 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.237460 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.237614 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.237697 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.237849 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.237925 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.238087 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.238164 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.238319 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.238394 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.238552 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.238635 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.238785 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.238863 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.239017 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.239093 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.239249 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.239325 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.239485 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.239568 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.239735 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.239811 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.239981 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.240057 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.240220 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.240298 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.240455 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.240567 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.240716 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.240792 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.240942 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.241015 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.241172 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.241249 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.241406 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.241494 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.241636 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.241726 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.241872 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.241949 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.242102 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.242185 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.242334 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.242423 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.242560 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.242636 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.242795 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.242870 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.243029 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.243115 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.243267 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.243351 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.243501 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.243576 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.243748 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.243838 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.244268 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.244350 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.244527 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.244610 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.244762 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] auth.external = None {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.244850 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.244991 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.245077 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] auth.external = None {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.246018 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.246208 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.246292 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.246370 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.246444 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] auth.password = None {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.246522 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.246595 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] auth.token = None {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.246712 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] auth.password = None {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.246791 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.246951 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] auth.token = None {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.247029 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.247199 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.247279 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.247441 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.247518 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.247695 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.247771 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.247930 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.248008 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.248159 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.248235 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.248394 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] credential.caching = True {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.248487 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.248673 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.248752 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.248913 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] credential.caching = True {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.248991 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.249158 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.249279 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.249399 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.249485 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.249638 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.249718 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.249872 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.249951 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.250115 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.250195 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.250352 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.250430 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.250588 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.250664 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.250838 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.250919 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.251077 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.251156 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.251335 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.251452 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.251595 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.251681 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.251837 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.257102 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.257230 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.257230 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] federation.caching = True {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.257386 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.257450 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.257943 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.258018 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.258089 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.258170 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.258244 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] federation.caching = True {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.258314 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.258383 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.258453 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.258523 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.258601 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.258674 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.258744 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.258814 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.258890 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.258961 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.259038 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.259159 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.259237 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.259308 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.259377 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.259446 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.259524 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] identity.caching = True {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.259597 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.259667 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.259736 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.259806 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.259865 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.260013 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.260127 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] identity.caching = True {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.260209 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.260280 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.260349 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.260418 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.260515 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.260591 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.260662 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.260769 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.260846 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.261048 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.261137 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.261241 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.261302 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.261359 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.261416 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.261472 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.261538 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.261597 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.261676 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.261749 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.261818 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.261888 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.261965 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.262038 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.262108 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.262172 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.262241 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.262310 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.262388 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.262460 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.262530 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.262600 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.262669 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.262752 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.262833 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.262833 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.262957 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.263025 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.263084 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.263151 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.263228 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.263300 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.263370 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.263439 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.263508 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.263508 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.263643 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.263713 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.263782 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.263850 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.263920 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.263996 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.264074 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.264225 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.264307 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.264367 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.264435 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.264534 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.264608 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.264678 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.264748 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.264817 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.264887 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.264964 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.265036 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.265106 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.265176 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.265253 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.265324 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.265406 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.265479 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.265556 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.265627 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.265696 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.265765 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.265847 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.265920 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.265989 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.266058 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.266128 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.266196 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.266196 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.266331 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.266401 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.266470 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.266547 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.266619 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.266697 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.266768 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.266838 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.266907 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.266976 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.267045 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.267123 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] ldap.user = None {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.267194 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.267264 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.267333 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.267449 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.267535 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.267674 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.267754 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.267922 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.268000 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] ldap.user = None {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.268170 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.268248 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.268419 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.268565 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.268681 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.268760 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.268912 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.268990 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.269148 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.269229 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.269383 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.269460 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.269618 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.269695 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.269849 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.269929 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.270089 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.270166 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.270331 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.270409 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.270574 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.270654 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.270811 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.270888 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.271052 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.271129 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.271283 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.271367 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.271528 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.271608 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.271765 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.271842 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.272006 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.272086 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.272239 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.272317 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.272488 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.272568 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.272735 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.272815 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.272975 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.273051 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.273209 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.273286 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.273447 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.273525 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.273678 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.273755 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.273920 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.273998 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.274155 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.274235 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.274390 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.274469 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.274626 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.274703 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.274873 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.274952 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.275114 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.275191 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.275345 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.275423 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.275580 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.275660 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.275820 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] resource.caching = True {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.275898 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.276064 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.276141 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.276302 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.277047 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.277129 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.277201 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.277325 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] resource.caching = True {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.277582 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.277676 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.277837 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.277917 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.278330 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.278418 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.278500 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.278574 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.278645 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.278715 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.278786 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.278856 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.279002 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] role.caching = True {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.279078 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.279245 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] role.driver = sql {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.279323 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.279475 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.279553 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.279721 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] role.caching = True {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.279801 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.279967 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.280045 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] role.driver = sql {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.280200 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.280277 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.280449 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.280562 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.280718 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.280797 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.280965 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.281042 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.281211 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.281292 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.281459 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.281536 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.281689 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.281766 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.281933 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.282013 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.282179 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.282257 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.282414 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.282490 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.282664 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.282749 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.282913 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.283059 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.283164 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.283295 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.283415 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.283543 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.283792 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.283869 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.284038 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.284125 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.284285 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.284363 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.284545 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.284627 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.284802 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.284891 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.285049 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.285130 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.285284 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.285361 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.285512 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.285598 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.285743 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.285822 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.285975 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.286053 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.286224 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.286311 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.286459 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.286536 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.286698 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.286776 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.286932 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.287017 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.287166 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.287244 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.287394 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.287471 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.287629 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] token.caching = True {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.287755 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.287866 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.287946 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.288113 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.288192 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.288350 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] token.caching = True {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.288435 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.288618 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.288699 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.288864 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.288983 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.289104 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.289195 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.289347 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.289426 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.289588 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.289667 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.289832 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.289917 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.290065 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.290142 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.290300 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.290378 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.290532 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.290619 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.290774 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.290853 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.291013 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.291090 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.291253 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.291340 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.291492 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.291579 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.291755 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.291834 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.292104 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.292208 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] database.connection = **** {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.292293 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.292490 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.292596 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.292742 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.292822 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] database.connection = **** {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.292980 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.293059 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.293222 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.293310 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.293459 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.293537 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.293694 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.293773 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.293928 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.294015 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.294160 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.294239 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.294404 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.294482 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.294638 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.294731 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.294880 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.294959 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.295113 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.295191 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.295358 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.295446 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.295592 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.295671 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.295835 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.295912 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.296062 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.296153 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.296301 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.296380 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.296558 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.296643 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.296715 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 12 02:15:53.296800 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.297028 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 02:15:53.297202 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 12 02:15:53.326857 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81361) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 02:15:53.327087 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81361) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 02:15:53.327310 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81361) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 02:15:53.327749 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81362) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 02:15:53.327992 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81362) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 02:15:53.328228 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81362) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 02:15:53.335680 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81361) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 02:15:53.336916 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81362) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 02:15:53.363580 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81361) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 02:15:53.363807 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81361) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 02:15:53.364879 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81362) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 02:15:53.365116 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81362) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 02:15:53.418560 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81361) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 02:15:53.418942 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81362) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 02:15:53.467226 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81361) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 02:15:53.467456 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81361) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 02:15:53.468209 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81362) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 02:15:53.468448 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81362) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 02:15:53.623685 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81361) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 02:15:53.623925 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81361) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 02:15:53.624018 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81362) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 02:15:53.624135 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81361) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 02:15:53.624244 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81362) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 02:15:53.624356 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81361) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 02:15:53.624441 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81362) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 02:15:53.624603 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81361) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 02:15:53.624689 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81362) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 02:15:53.624823 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81361) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 02:15:53.624910 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81362) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 02:15:53.625064 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81362) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 02:15:53.648123 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81361) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 02:15:53.648235 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81362) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 02:15:53.648381 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81361) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 02:15:53.648538 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81362) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 02:15:53.648620 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81361) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 02:15:53.648697 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81362) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 02:15:53.648828 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81361) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 02:15:53.648914 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81362) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 02:15:53.649052 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81361) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 02:15:53.649138 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81362) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 02:15:53.649270 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81361) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 02:15:53.649355 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81362) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 02:15:53.649489 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81361) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 02:15:53.649583 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81362) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 02:15:53.661371 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81361) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 02:15:53.661599 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81362) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 02:15:53.674105 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81361) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 02:15:53.674334 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81361) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 02:15:53.674472 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81362) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 02:15:53.674587 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81361) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 02:15:53.674667 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81362) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 02:15:53.674742 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81361) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 02:15:53.674813 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81362) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 02:15:53.674938 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81361) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 02:15:53.675034 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81362) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 02:15:53.675153 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81362) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 02:15:53.675237 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81361) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 02:15:53.675366 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81361) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 02:15:53.675450 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81362) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 02:15:53.675581 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81362) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 02:15:53.692539 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81361) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 02:15:53.692754 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81361) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 12 02:15:53.692845 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 02:15:53.692968 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 12 02:15:53.693099 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81361) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 02:15:53.693301 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81361) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 12 02:15:53.693388 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 02:15:53.693506 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 12 02:15:53.693597 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81361) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 02:15:53.693784 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 02:15:53.693875 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81361) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 02:15:53.694050 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 02:15:53.694131 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81361) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 02:15:53.694313 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 02:15:53.694393 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81361) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 02:15:53.694573 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 02:15:53.704658 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81361) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 02:15:53.704791 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 02:15:53.704941 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81361) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 02:15:53.705077 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 02:15:53.705215 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81361) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 02:15:53.705357 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 02:15:53.705499 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81361) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 02:15:53.705645 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 02:15:53.712455 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81361) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 12 02:15:53.712686 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81362) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 12 02:15:53.715602 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81361) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 12 02:15:53.715737 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81362) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 12 02:15:53.715891 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81361) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 02:15:53.716026 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 02:15:53.716179 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81361) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 02:15:53.716314 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 02:15:53.716488 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81361) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 02:15:53.716626 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 02:15:53.716841 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81361) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 02:15:53.716920 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 02:15:53.717106 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81361) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 02:15:53.717199 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 02:15:53.717378 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81361) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 02:15:53.717458 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 02:15:53.717653 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81361) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 02:15:53.717732 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 02:15:53.717925 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81361) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 02:15:53.718007 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 02:15:53.718199 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81361) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 02:15:53.718279 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 02:15:53.718470 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81361) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 02:15:53.718550 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 02:15:53.741582 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81361) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 02:15:53.741732 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 02:15:53.743045 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81361) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 12 02:15:53.743214 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81362) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 12 02:15:53.743333 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81361) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 02:15:53.743505 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 02:15:53.748320 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81361) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 12 02:15:53.748618 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81362) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 12 02:15:53.748704 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81361) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 02:15:53.748911 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 02:15:53.749009 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81361) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 02:15:53.749200 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 02:15:53.755210 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81361) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 12 02:15:53.755495 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81361) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 02:15:53.755578 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81362) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 12 02:15:53.755842 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 02:15:53.761632 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81361) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 12 02:15:53.761927 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81361) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 02:15:53.762159 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81362) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 12 02:15:53.762243 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81361) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 02:15:53.762463 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 02:15:53.762560 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81361) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 02:15:53.762759 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81361) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 02:15:53.762838 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 02:15:53.763036 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81361) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 02:15:53.763117 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 02:15:53.763310 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81361) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 02:15:53.763391 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 02:15:53.763580 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81361) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 02:15:53.763660 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 02:15:53.763860 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 02:15:53.764136 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 02:15:53.778981 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81361) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 02:15:53.779261 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81361) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 02:15:53.779802 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 02:15:53.780087 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 02:15:53.783307 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81361) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 12 02:15:53.783935 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81362) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 12 02:15:53.786278 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81361) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 02:15:53.786579 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81361) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 02:15:53.787158 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 02:15:53.787461 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 02:15:53.790733 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81361) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 12 02:15:53.791641 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81362) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 12 02:15:53.794389 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81361) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 12 02:15:53.795340 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81362) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 12 02:15:53.797576 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81361) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 02:15:53.797880 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81361) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 02:15:53.798168 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81361) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 02:15:53.798453 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81361) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 02:15:53.798559 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 02:15:53.798730 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81361) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 02:15:53.798866 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 02:15:53.799012 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81361) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 02:15:53.799160 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 02:15:53.799450 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 02:15:53.799730 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 02:15:53.800012 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 02:15:53.814677 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81361) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 12 02:15:53.814972 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81361) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 02:15:53.815247 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81361) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 02:15:53.815514 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81361) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 02:15:53.815767 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81362) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 12 02:15:53.816062 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 02:15:53.816338 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 02:15:53.816639 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 02:15:53.822358 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81361) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 02:15:53.824038 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 02:15:53.824419 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81361) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 02:15:53.825617 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 02:15:53.825975 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81361) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 02:15:53.826254 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81361) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 02:15:53.827160 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 02:15:53.827445 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 02:15:53.828931 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81361) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 12 02:15:53.829221 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81361) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 02:15:53.829504 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81361) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 02:15:53.829798 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81361) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 02:15:53.830196 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81361) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 02:15:53.830289 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81362) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 12 02:15:53.830503 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 02:15:53.830792 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 02:15:53.831092 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 02:15:53.831496 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 02:15:53.841464 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81361) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 12 02:15:53.841761 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81361) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 02:15:53.842047 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81361) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 02:15:53.842329 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81361) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 02:15:53.842725 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81361) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 02:15:53.842806 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81362) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 12 02:15:53.843014 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81361) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 02:15:53.843150 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 02:15:53.843303 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81361) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 02:15:53.843445 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 02:15:53.843623 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 02:15:53.844011 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 02:15:53.844307 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 02:15:53.844630 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 02:15:53.859202 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81361) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 12 02:15:53.860996 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81362) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 12 02:15:53.862139 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81361) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 12 02:15:53.863908 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81362) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 12 02:15:53.865050 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81361) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 02:15:53.866568 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81361) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 02:15:53.866845 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 02:15:53.868048 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81361) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 12 02:15:53.868333 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81361) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 02:15:53.868458 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 02:15:53.868762 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81361) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 02:15:53.870217 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81362) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 12 02:15:53.870628 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 02:15:53.871003 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 02:15:53.875427 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81361) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 02:15:53.876980 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81361) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 12 02:15:53.877451 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 02:15:53.878931 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81362) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 12 02:15:53.879859 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81361) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 02:15:53.880257 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81361) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 02:15:53.880566 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81361) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 02:15:53.880843 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81361) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 02:15:53.881870 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 02:15:53.882270 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 02:15:53.882562 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 02:15:53.882849 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 02:15:53.889207 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81361) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 12 02:15:53.889499 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81361) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 02:15:53.889779 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81361) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 02:15:53.891359 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81362) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 12 02:15:53.891656 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 02:15:53.891939 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 02:15:53.896666 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81361) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 12 02:15:53.896952 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81361) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 02:15:53.897231 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81361) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 02:15:53.897518 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81361) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 02:15:53.897791 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81361) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 02:15:53.898064 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81361) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 02:15:53.898339 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81361) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 02:15:53.898617 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81361) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 02:15:53.898886 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81361) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 02:15:53.899012 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81362) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 12 02:15:53.899176 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81361) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 02:15:53.899304 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 02:15:53.899458 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81361) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 02:15:53.899594 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 02:15:53.899726 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81361) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 02:15:53.899852 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 02:15:53.899984 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 02:15:53.900117 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81361) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 02:15:53.900242 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 02:15:53.900367 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81361) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 02:15:53.900551 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 02:15:53.900844 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 02:15:53.901130 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 02:15:53.902004 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 02:15:53.902291 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 02:15:53.902560 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 02:15:53.902840 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 02:15:53.903125 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 02:15:53.934854 dv-cinder-849143-14-smb devstack@keystone.service[81361]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x562a5020c9c0 pid: 81361 (default app) Oct 12 02:15:53.937420 dv-cinder-849143-14-smb devstack@keystone.service[81362]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x562a5020c9c0 pid: 81362 (default app) Oct 12 02:15:53.938109 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6c4350-d360-46eb-9f88-213ec6f205f8 None None] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:15:53.938400 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6c4350-d360-46eb-9f88-213ec6f205f8 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:15:53.938677 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6c4350-d360-46eb-9f88-213ec6f205f8 None None] PATH_INFO: `/v3` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:15:53.942798 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1/1] 10.222.0.18 () {50 vars in 791 bytes} [Wed Oct 12 02:15:53 2022] GET /identity/v3/ => generated 255 bytes in 7 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 02:16:00.690867 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65aaeb4e-6c70-4b22-aedd-e81fb77b4b30 None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:16:00.691406 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65aaeb4e-6c70-4b22-aedd-e81fb77b4b30 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:16:00.691406 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65aaeb4e-6c70-4b22-aedd-e81fb77b4b30 None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:16:00.695678 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1/2] 10.222.0.18 () {54 vars in 927 bytes} [Wed Oct 12 02:16:00 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 12 02:16:00.701389 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d99e07a-2356-47be-851d-a6e8cd01a5f8 None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:16:00.701880 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d99e07a-2356-47be-851d-a6e8cd01a5f8 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:16:00.701972 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d99e07a-2356-47be-851d-a6e8cd01a5f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:16:00.774455 dv-cinder-849143-14-smb devstack@keystone.service[81361]: INFO dbcounter [None req-5d99e07a-2356-47be-851d-a6e8cd01a5f8 None None] Registered counter for database keystone Oct 12 02:16:00.793514 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG oslo_db.sqlalchemy.engines [None req-5d99e07a-2356-47be-851d-a6e8cd01a5f8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81361) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 12 02:16:00.799665 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writer thread running {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 12 02:16:00.977593 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG passlib.handlers.bcrypt [None req-5d99e07a-2356-47be-851d-a6e8cd01a5f8 None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81361) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Oct 12 02:16:00.978028 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG passlib.handlers.bcrypt [None req-5d99e07a-2356-47be-851d-a6e8cd01a5f8 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81361) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Oct 12 02:16:01.036114 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-5d99e07a-2356-47be-851d-a6e8cd01a5f8 None None] MFA Rules not processed for user `a326a5bb7364479382f528a592371656`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:16:01.037772 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-5d99e07a-2356-47be-851d-a6e8cd01a5f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:16:01.168831 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 2/3] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Oct 12 02:16:00 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 468 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Oct 12 02:16:01.463013 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65aaeb4e-6c70-4b22-aedd-e81fb77b4b30 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:16:01.533713 dv-cinder-849143-14-smb devstack@keystone.service[81362]: INFO dbcounter [None req-65aaeb4e-6c70-4b22-aedd-e81fb77b4b30 None None] Registered counter for database keystone Oct 12 02:16:01.555038 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG oslo_db.sqlalchemy.engines [None req-65aaeb4e-6c70-4b22-aedd-e81fb77b4b30 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81362) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 12 02:16:01.562231 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writer thread running {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 12 02:16:01.684237 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65aaeb4e-6c70-4b22-aedd-e81fb77b4b30 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:16:01.688484 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59233c06-ab3e-4098-b566-efce1e5b3b9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:16:01.689112 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59233c06-ab3e-4098-b566-efce1e5b3b9b admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:16:01.689391 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59233c06-ab3e-4098-b566-efce1e5b3b9b admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:16:01.689658 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59233c06-ab3e-4098-b566-efce1e5b3b9b admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:16:01.698344 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59233c06-ab3e-4098-b566-efce1e5b3b9b admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:16:01.750915 dv-cinder-849143-14-smb devstack@keystone.service[81362]: WARNING keystone.common.rbac_enforcer.enforcer [None req-59233c06-ab3e-4098-b566-efce1e5b3b9b admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Oct 12 02:16:01.751199 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59233c06-ab3e-4098-b566-efce1e5b3b9b admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:16:01.761337 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 2/4] 10.222.0.18 () {58 vars in 1324 bytes} [Wed Oct 12 02:16:01 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 12 02:16:01.767260 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d99e07a-2356-47be-851d-a6e8cd01a5f8 None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:16:01.783965 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d99e07a-2356-47be-851d-a6e8cd01a5f8 None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:16:01.788368 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f6b170-3d01-4757-96d7-d3709701ec30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:16:01.789502 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f6b170-3d01-4757-96d7-d3709701ec30 admin admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:16:01.789787 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f6b170-3d01-4757-96d7-d3709701ec30 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:16:01.790059 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f6b170-3d01-4757-96d7-d3709701ec30 admin admin] PATH_INFO: `/v3/projects/ae04d11182384b63981888ea102e1452` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:16:01.791745 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f6b170-3d01-4757-96d7-d3709701ec30 admin admin] RBAC: Authorizing `identity:get_project(project_id=ae04d11182384b63981888ea102e1452)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:16:01.846351 dv-cinder-849143-14-smb devstack@keystone.service[81361]: WARNING keystone.common.rbac_enforcer.enforcer [None req-45f6b170-3d01-4757-96d7-d3709701ec30 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Oct 12 02:16:01.846707 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f6b170-3d01-4757-96d7-d3709701ec30 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:16:01.851171 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 3/5] 10.222.0.18 () {56 vars in 1207 bytes} [Wed Oct 12 02:16:01 2022] GET /identity/v3/projects/ae04d11182384b63981888ea102e1452 => generated 344 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 02:16:03.985505 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e117a86-31cd-473d-ab7b-48ca28b2aac1 None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:16:03.986024 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e117a86-31cd-473d-ab7b-48ca28b2aac1 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:16:03.986024 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e117a86-31cd-473d-ab7b-48ca28b2aac1 None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:16:03.990153 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 3/6] 10.222.0.18 () {54 vars in 927 bytes} [Wed Oct 12 02:16:03 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 02:16:03.996279 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018df9de-c398-4d72-a433-d06954d2e94f None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:16:03.996703 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018df9de-c398-4d72-a433-d06954d2e94f None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:16:03.996854 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018df9de-c398-4d72-a433-d06954d2e94f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:16:04.017226 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-018df9de-c398-4d72-a433-d06954d2e94f None None] MFA Rules not processed for user `a326a5bb7364479382f528a592371656`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:16:04.018721 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-018df9de-c398-4d72-a433-d06954d2e94f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:16:04.026488 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 4/7] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Oct 12 02:16:03 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Oct 12 02:16:04.299926 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e117a86-31cd-473d-ab7b-48ca28b2aac1 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:16:04.311910 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e117a86-31cd-473d-ab7b-48ca28b2aac1 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:16:04.316004 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ac5b3c-246e-4e39-8d65-c84ea5ddd11d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:16:04.316638 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ac5b3c-246e-4e39-8d65-c84ea5ddd11d admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:16:04.316917 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ac5b3c-246e-4e39-8d65-c84ea5ddd11d admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:16:04.317188 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ac5b3c-246e-4e39-8d65-c84ea5ddd11d admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:16:04.325484 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ac5b3c-246e-4e39-8d65-c84ea5ddd11d admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:16:04.327220 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ac5b3c-246e-4e39-8d65-c84ea5ddd11d admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:16:04.335769 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 4/8] 10.222.0.18 () {58 vars in 1324 bytes} [Wed Oct 12 02:16:04 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 12 02:16:04.341570 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018df9de-c398-4d72-a433-d06954d2e94f None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:16:04.350642 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018df9de-c398-4d72-a433-d06954d2e94f None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:16:04.355413 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d996efd6-a65e-41bf-b779-a9e7ebd32353 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:16:04.356041 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d996efd6-a65e-41bf-b779-a9e7ebd32353 admin admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:16:04.356325 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d996efd6-a65e-41bf-b779-a9e7ebd32353 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:16:04.356636 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d996efd6-a65e-41bf-b779-a9e7ebd32353 admin admin] PATH_INFO: `/v3/users/a326a5bb7364479382f528a592371656` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:16:04.357960 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d996efd6-a65e-41bf-b779-a9e7ebd32353 admin admin] RBAC: Authorizing `identity:get_user(user_id=a326a5bb7364479382f528a592371656)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:16:04.359796 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d996efd6-a65e-41bf-b779-a9e7ebd32353 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:16:04.361363 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 5/9] 10.222.0.18 () {56 vars in 1198 bytes} [Wed Oct 12 02:16:04 2022] GET /identity/v3/users/a326a5bb7364479382f528a592371656 => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 02:16:06.540438 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bdc6b6-4818-4479-9611-554502150b4a None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:16:06.540888 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bdc6b6-4818-4479-9611-554502150b4a None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:16:06.541023 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bdc6b6-4818-4479-9611-554502150b4a None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:16:06.542890 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 5/10] 10.222.0.18 () {54 vars in 927 bytes} [Wed Oct 12 02:16:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 12 02:16:06.547909 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1c34ab-8eb6-4d86-8915-3c10717a8776 None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:16:06.548336 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1c34ab-8eb6-4d86-8915-3c10717a8776 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:16:06.548457 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1c34ab-8eb6-4d86-8915-3c10717a8776 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:16:06.567490 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-1c1c34ab-8eb6-4d86-8915-3c10717a8776 None None] MFA Rules not processed for user `a326a5bb7364479382f528a592371656`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:16:06.568702 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-1c1c34ab-8eb6-4d86-8915-3c10717a8776 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:16:06.598967 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426c6c7c-276c-45fa-818b-fe7c4e5992e4 None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:16:06.599251 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426c6c7c-276c-45fa-818b-fe7c4e5992e4 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:16:06.599527 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426c6c7c-276c-45fa-818b-fe7c4e5992e4 None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:16:06.600893 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 6/11] 10.222.0.18 () {54 vars in 927 bytes} [Wed Oct 12 02:16:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 12 02:16:06.606647 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ccc89f-1386-454c-b6eb-486c9749bd7c None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:16:06.606924 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ccc89f-1386-454c-b6eb-486c9749bd7c None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:16:06.607193 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ccc89f-1386-454c-b6eb-486c9749bd7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:16:06.649216 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG passlib.handlers.bcrypt [None req-e4ccc89f-1386-454c-b6eb-486c9749bd7c None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81362) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Oct 12 02:16:06.649599 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG passlib.handlers.bcrypt [None req-e4ccc89f-1386-454c-b6eb-486c9749bd7c None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81362) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Oct 12 02:16:06.651460 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 6/12] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Oct 12 02:16:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 12 02:16:06.699131 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-e4ccc89f-1386-454c-b6eb-486c9749bd7c None None] MFA Rules not processed for user `a326a5bb7364479382f528a592371656`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:16:06.700729 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-e4ccc89f-1386-454c-b6eb-486c9749bd7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:16:06.799495 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 7/13] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Oct 12 02:16:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 12 02:16:06.917294 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1c34ab-8eb6-4d86-8915-3c10717a8776 None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:16:06.942197 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:16:07.021182 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1c34ab-8eb6-4d86-8915-3c10717a8776 None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:16:07.053175 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aaccdee-549b-48a8-bff9-03a08015cb9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:16:07.053738 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aaccdee-549b-48a8-bff9-03a08015cb9c None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:16:07.054012 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aaccdee-549b-48a8-bff9-03a08015cb9c None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:16:07.054280 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aaccdee-549b-48a8-bff9-03a08015cb9c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:16:07.065665 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aaccdee-549b-48a8-bff9-03a08015cb9c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 02:16:07.070334 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ccc89f-1386-454c-b6eb-486c9749bd7c None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:16:07.075013 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application [None req-9aaccdee-549b-48a8-bff9-03a08015cb9c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 12 02:16:07.075013 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 02:16:07.075013 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 02:16:07.075013 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 02:16:07.075013 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 02:16:07.075013 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 02:16:07.075013 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 02:16:07.075013 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 02:16:07.075013 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 02:16:07.075013 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 02:16:07.075013 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 02:16:07.075013 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 02:16:07.075013 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 12 02:16:07.075013 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 12 02:16:07.075013 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 12 02:16:07.075013 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 12 02:16:07.076035 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 12 02:16:07.076035 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 12 02:16:07.076035 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 12 02:16:07.076035 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 12 02:16:07.076035 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 02:16:07.076035 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 02:16:07.076035 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 02:16:07.076035 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 02:16:07.076035 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 02:16:07.076035 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 02:16:07.076035 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 02:16:07.076035 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application with Lock( Oct 12 02:16:07.076035 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 02:16:07.076035 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._enter() Oct 12 02:16:07.076035 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 02:16:07.076035 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 02:16:07.076993 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 02:16:07.076993 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.creator() Oct 12 02:16:07.076993 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 02:16:07.076993 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application created_value = creator( Oct 12 02:16:07.076993 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 12 02:16:07.076993 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 12 02:16:07.076993 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 12 02:16:07.076993 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 12 02:16:07.076993 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 12 02:16:07.076993 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 12 02:16:07.076993 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 12 02:16:07.076993 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Oct 12 02:16:07.076993 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 7/14] 10.222.0.18 () {56 vars in 1096 bytes} [Wed Oct 12 02:16:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 02:16:07.081708 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aaccdee-549b-48a8-bff9-03a08015cb9c None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:16:07.162597 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:16:07.172240 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ccc89f-1386-454c-b6eb-486c9749bd7c None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:16:07.174853 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:16:07.181840 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aaccdee-549b-48a8-bff9-03a08015cb9c None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:16:07.209321 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7d0c29-26d6-451b-b07a-2a9ba810b9b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:16:07.210191 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7d0c29-26d6-451b-b07a-2a9ba810b9b4 None admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:16:07.210477 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7d0c29-26d6-451b-b07a-2a9ba810b9b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:16:07.210751 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7d0c29-26d6-451b-b07a-2a9ba810b9b4 None admin] PATH_INFO: `/v3/domains` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:16:07.211719 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7d0c29-26d6-451b-b07a-2a9ba810b9b4 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:16:07.213730 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7d0c29-26d6-451b-b07a-2a9ba810b9b4 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:16:07.216959 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9b602f-6e85-44d7-88a3-8d92b725fa1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:16:07.217563 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9b602f-6e85-44d7-88a3-8d92b725fa1a None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:16:07.217843 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9b602f-6e85-44d7-88a3-8d92b725fa1a None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:16:07.218126 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9b602f-6e85-44d7-88a3-8d92b725fa1a None admin] PATH_INFO: `/v3/roles` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:16:07.218786 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9b602f-6e85-44d7-88a3-8d92b725fa1a None admin] RBAC: Adding query filter params (name=admin) {{(pid=81361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 02:16:07.219087 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9b602f-6e85-44d7-88a3-8d92b725fa1a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:16:07.220511 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9b602f-6e85-44d7-88a3-8d92b725fa1a None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:16:07.224700 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.sql.core [None req-1d7d0c29-26d6-451b-b07a-2a9ba810b9b4 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Oct 12 02:16:07.224700 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 12 02:16:07.224700 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [parameters: {'id': '4115593bdd204ae1ac66bae04cc1c56d', 'name': 'Default', 'domain_id': '<>', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': None, 'is_domain': 1}] Oct 12 02:16:07.224700 dv-cinder-849143-14-smb devstack@keystone.service[81362]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81362) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 12 02:16:07.232578 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 8/15] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Oct 12 02:16:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 02:16:07.238059 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9b602f-6e85-44d7-88a3-8d92b725fa1a None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:16:07.242957 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-1d7d0c29-26d6-451b-b07a-2a9ba810b9b4 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default. Oct 12 02:16:07.242957 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 02:16:07.242957 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 12 02:16:07.242957 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 12 02:16:07.242957 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 12 02:16:07.242957 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 12 02:16:07.242957 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 12 02:16:07.242957 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application result = self._query(query) Oct 12 02:16:07.242957 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 12 02:16:07.242957 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application conn.query(q) Oct 12 02:16:07.242957 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 12 02:16:07.242957 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 12 02:16:07.242957 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 12 02:16:07.242957 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application result.read() Oct 12 02:16:07.244292 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 12 02:16:07.244292 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 12 02:16:07.244292 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 12 02:16:07.244292 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 12 02:16:07.244292 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 12 02:16:07.244292 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 12 02:16:07.244292 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 12 02:16:07.244292 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 12 02:16:07.244292 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Oct 12 02:16:07.244292 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Oct 12 02:16:07.244292 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 12 02:16:07.244292 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Oct 12 02:16:07.244292 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 02:16:07.244292 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 12 02:16:07.244292 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 12 02:16:07.244292 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Oct 12 02:16:07.244292 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return project_ref.to_dict() Oct 12 02:16:07.244292 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 12 02:16:07.246029 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application next(self.gen) Oct 12 02:16:07.246029 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Oct 12 02:16:07.246029 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application yield resource Oct 12 02:16:07.246029 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 12 02:16:07.246029 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application next(self.gen) Oct 12 02:16:07.246029 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Oct 12 02:16:07.246029 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application self.session.rollback() Oct 12 02:16:07.246029 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 12 02:16:07.246029 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application self.force_reraise() Oct 12 02:16:07.246029 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 12 02:16:07.246029 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise self.value Oct 12 02:16:07.246029 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Oct 12 02:16:07.246029 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 12 02:16:07.246029 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Oct 12 02:16:07.246029 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application session.commit() Oct 12 02:16:07.246029 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 12 02:16:07.246029 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 12 02:16:07.247091 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 12 02:16:07.247091 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application self._prepare_impl() Oct 12 02:16:07.247091 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 12 02:16:07.247091 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application self.session.flush() Oct 12 02:16:07.247091 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 12 02:16:07.247091 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application self._flush(objects) Oct 12 02:16:07.247091 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 12 02:16:07.247091 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 12 02:16:07.247091 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 12 02:16:07.247091 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application compat.raise_( Oct 12 02:16:07.247091 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 12 02:16:07.247091 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception Oct 12 02:16:07.247091 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 12 02:16:07.247091 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application flush_context.execute() Oct 12 02:16:07.247091 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 12 02:16:07.247091 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rec.execute(self) Oct 12 02:16:07.247091 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 12 02:16:07.248058 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 12 02:16:07.248058 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 12 02:16:07.248058 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 12 02:16:07.248058 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Oct 12 02:16:07.248058 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application c = connection._execute_20( Oct 12 02:16:07.248058 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 12 02:16:07.248058 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 12 02:16:07.248058 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 12 02:16:07.248058 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 12 02:16:07.248058 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 12 02:16:07.248058 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 12 02:16:07.248058 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 12 02:16:07.248058 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 12 02:16:07.248058 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 12 02:16:07.248058 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 12 02:16:07.249053 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 12 02:16:07.249053 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception Oct 12 02:16:07.249053 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 12 02:16:07.249053 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 12 02:16:07.249053 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 12 02:16:07.249053 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 12 02:16:07.249053 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 12 02:16:07.249053 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application result = self._query(query) Oct 12 02:16:07.249053 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 12 02:16:07.249053 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application conn.query(q) Oct 12 02:16:07.249053 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 12 02:16:07.249053 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 12 02:16:07.249053 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 12 02:16:07.249053 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application result.read() Oct 12 02:16:07.249053 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 12 02:16:07.249053 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 12 02:16:07.249053 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 12 02:16:07.250185 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 12 02:16:07.250185 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 12 02:16:07.250185 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 12 02:16:07.250185 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 12 02:16:07.250185 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 12 02:16:07.250185 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Oct 12 02:16:07.250185 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 12 02:16:07.250185 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [parameters: {'id': '4115593bdd204ae1ac66bae04cc1c56d', 'name': 'Default', 'domain_id': '<>', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': None, 'is_domain': 1}] Oct 12 02:16:07.250185 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 12 02:16:07.250185 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Oct 12 02:16:07.250185 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 12 02:16:07.250185 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Oct 12 02:16:07.250185 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 02:16:07.250185 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Oct 12 02:16:07.250185 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Oct 12 02:16:07.251163 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 12 02:16:07.251163 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 12 02:16:07.251163 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name Default. Oct 12 02:16:07.251163 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Oct 12 02:16:07.251163 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 12 02:16:07.251163 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Oct 12 02:16:07.251163 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 02:16:07.251163 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 02:16:07.251163 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 02:16:07.251163 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 02:16:07.251163 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 02:16:07.251163 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 02:16:07.251163 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 02:16:07.251163 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 02:16:07.251163 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 02:16:07.251163 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 02:16:07.251163 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 02:16:07.252193 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 128, in post Oct 12 02:16:07.252193 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_domain( Oct 12 02:16:07.252193 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 02:16:07.252193 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 02:16:07.252193 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 765, in create_domain Oct 12 02:16:07.252193 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application is_domain_project = self.create_project( Oct 12 02:16:07.252193 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 02:16:07.252193 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 02:16:07.252193 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Oct 12 02:16:07.252193 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.Conflict( Oct 12 02:16:07.252193 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default. Oct 12 02:16:07.252193 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Oct 12 02:16:07.252193 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 8/16] 10.222.0.18 () {60 vars in 1137 bytes} [Wed Oct 12 02:16:07 2022] POST /identity/v3/domains => generated 190 bytes in 175 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Oct 12 02:16:07.252193 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7d0c29-26d6-451b-b07a-2a9ba810b9b4 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:16:07.343970 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9b602f-6e85-44d7-88a3-8d92b725fa1a None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:16:07.349342 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7d0c29-26d6-451b-b07a-2a9ba810b9b4 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:16:07.378988 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67d1315-c5e9-45b6-9b4a-d49927c3c7b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:16:07.379619 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67d1315-c5e9-45b6-9b4a-d49927c3c7b5 None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:16:07.379894 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67d1315-c5e9-45b6-9b4a-d49927c3c7b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:16:07.380170 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67d1315-c5e9-45b6-9b4a-d49927c3c7b5 None admin] PATH_INFO: `/v3/users/a326a5bb7364479382f528a592371656` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:16:07.381322 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67d1315-c5e9-45b6-9b4a-d49927c3c7b5 None admin] RBAC: Authorizing `identity:get_user(user_id=a326a5bb7364479382f528a592371656)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:16:07.382809 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67d1315-c5e9-45b6-9b4a-d49927c3c7b5 None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:16:07.384581 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 9/17] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Oct 12 02:16:07 2022] GET /identity/v3/users/a326a5bb7364479382f528a592371656 => generated 247 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 02:16:07.389551 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696ebb49-03e8-443c-8471-049b4ada0f64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:16:07.389912 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67d1315-c5e9-45b6-9b4a-d49927c3c7b5 None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:16:07.390397 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696ebb49-03e8-443c-8471-049b4ada0f64 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:16:07.390675 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696ebb49-03e8-443c-8471-049b4ada0f64 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:16:07.390945 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696ebb49-03e8-443c-8471-049b4ada0f64 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:16:07.404518 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:16:07.414833 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696ebb49-03e8-443c-8471-049b4ada0f64 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:16:07.417444 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696ebb49-03e8-443c-8471-049b4ada0f64 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:16:07.434160 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-696ebb49-03e8-443c-8471-049b4ada0f64 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 02:16:07.434160 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 02:16:07.434160 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 02:16:07.434160 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 02:16:07.434160 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 02:16:07.434160 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 02:16:07.434160 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 02:16:07.434160 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 02:16:07.434160 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 02:16:07.434160 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 02:16:07.434160 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 02:16:07.434160 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 02:16:07.434160 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 12 02:16:07.434160 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 12 02:16:07.434160 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 12 02:16:07.434160 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 12 02:16:07.435085 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 02:16:07.435085 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 02:16:07.435085 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 02:16:07.435085 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 02:16:07.435085 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 02:16:07.435085 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 02:16:07.435085 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 02:16:07.435085 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Oct 12 02:16:07.435085 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 02:16:07.435085 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Oct 12 02:16:07.435085 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 02:16:07.435085 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 02:16:07.435085 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 02:16:07.435085 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Oct 12 02:16:07.435085 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 02:16:07.435085 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Oct 12 02:16:07.435085 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 12 02:16:07.435875 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 12 02:16:07.435875 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 02:16:07.435875 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Oct 12 02:16:07.435875 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 9/18] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Oct 12 02:16:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 12 02:16:07.440957 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696ebb49-03e8-443c-8471-049b4ada0f64 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:16:07.461826 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:16:07.492155 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67d1315-c5e9-45b6-9b4a-d49927c3c7b5 None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:16:07.526132 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449e391e-4a3d-46c8-8f0e-6457e6f15b64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:16:07.526779 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449e391e-4a3d-46c8-8f0e-6457e6f15b64 None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:16:07.527052 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449e391e-4a3d-46c8-8f0e-6457e6f15b64 None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:16:07.527325 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449e391e-4a3d-46c8-8f0e-6457e6f15b64 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:16:07.528497 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449e391e-4a3d-46c8-8f0e-6457e6f15b64 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:16:07.529961 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449e391e-4a3d-46c8-8f0e-6457e6f15b64 None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:16:07.531754 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 10/19] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Oct 12 02:16:07 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 02:16:07.537139 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449e391e-4a3d-46c8-8f0e-6457e6f15b64 None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:16:07.542388 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696ebb49-03e8-443c-8471-049b4ada0f64 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:16:07.578654 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccbb220-841f-4ab9-93ae-acd5e170e70f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:16:07.579519 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccbb220-841f-4ab9-93ae-acd5e170e70f None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:16:07.579800 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccbb220-841f-4ab9-93ae-acd5e170e70f None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:16:07.580081 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccbb220-841f-4ab9-93ae-acd5e170e70f None admin] PATH_INFO: `/v3/domains` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:16:07.580763 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ccbb220-841f-4ab9-93ae-acd5e170e70f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 02:16:07.581067 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ccbb220-841f-4ab9-93ae-acd5e170e70f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:16:07.582446 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ccbb220-841f-4ab9-93ae-acd5e170e70f None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:16:07.600019 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 10/20] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Oct 12 02:16:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 02:16:07.621134 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:16:07.642517 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449e391e-4a3d-46c8-8f0e-6457e6f15b64 None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:16:07.679064 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0e2b89-7e66-43f7-8e17-cb4e78a4c8fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:16:07.679744 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0e2b89-7e66-43f7-8e17-cb4e78a4c8fa None admin] REQUEST_METHOD: `PUT` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:16:07.680026 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0e2b89-7e66-43f7-8e17-cb4e78a4c8fa None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:16:07.680304 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0e2b89-7e66-43f7-8e17-cb4e78a4c8fa None admin] PATH_INFO: `/v3/domains/default/users/a326a5bb7364479382f528a592371656/roles/39b1e8108dff402383def3c559f48189` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:16:07.682342 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0e2b89-7e66-43f7-8e17-cb4e78a4c8fa None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=a326a5bb7364479382f528a592371656, role_id=39b1e8108dff402383def3c559f48189)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:16:07.683823 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0e2b89-7e66-43f7-8e17-cb4e78a4c8fa None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:16:07.801918 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 11/21] 10.222.0.18 () {58 vars in 1361 bytes} [Wed Oct 12 02:16:07 2022] PUT /identity/v3/domains/default/users/a326a5bb7364479382f528a592371656/roles/39b1e8108dff402383def3c559f48189 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 02:16:10.075400 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c4e213-ff8b-4d52-8ceb-c53d904b5419 None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:16:10.076375 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c4e213-ff8b-4d52-8ceb-c53d904b5419 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:16:10.076887 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c4e213-ff8b-4d52-8ceb-c53d904b5419 None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:16:10.078701 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 11/22] 10.222.0.18 () {54 vars in 927 bytes} [Wed Oct 12 02:16:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 02:16:10.084378 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edd7853-1bb5-4caa-a407-483e450e9378 None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:16:10.085232 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edd7853-1bb5-4caa-a407-483e450e9378 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:16:10.085710 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edd7853-1bb5-4caa-a407-483e450e9378 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:16:10.110068 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-6edd7853-1bb5-4caa-a407-483e450e9378 None None] MFA Rules not processed for user `a326a5bb7364479382f528a592371656`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:16:10.112070 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-6edd7853-1bb5-4caa-a407-483e450e9378 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:16:10.170881 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6464cf53-24e5-4e29-bb89-1346cf37885d None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:16:10.171524 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6464cf53-24e5-4e29-bb89-1346cf37885d None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:16:10.171993 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6464cf53-24e5-4e29-bb89-1346cf37885d None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:16:10.173890 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 12/23] 10.222.0.18 () {54 vars in 927 bytes} [Wed Oct 12 02:16:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 02:16:10.179590 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92aa2be-a1e9-422d-afe3-ff4607211b3b None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:16:10.179877 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92aa2be-a1e9-422d-afe3-ff4607211b3b None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:16:10.180181 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92aa2be-a1e9-422d-afe3-ff4607211b3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:16:10.208259 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 12/24] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Oct 12 02:16:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 12 02:16:10.214601 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-c92aa2be-a1e9-422d-afe3-ff4607211b3b None None] MFA Rules not processed for user `a326a5bb7364479382f528a592371656`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:16:10.215797 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-c92aa2be-a1e9-422d-afe3-ff4607211b3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:16:10.325334 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 13/25] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Oct 12 02:16:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 12 02:16:10.547730 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ef93eb-afa3-4dc8-84ff-0f7b8f8e57cf None None] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:16:10.548018 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ef93eb-afa3-4dc8-84ff-0f7b8f8e57cf None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:16:10.548319 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92aa2be-a1e9-422d-afe3-ff4607211b3b None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:16:10.548763 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ef93eb-afa3-4dc8-84ff-0f7b8f8e57cf None None] PATH_INFO: `/` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:16:10.553473 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 13/26] 10.222.0.18 () {54 vars in 927 bytes} [Wed Oct 12 02:16:10 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 02:16:10.559132 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cae5144-0987-41a4-b3f2-b624670a7db1 None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:16:10.559645 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cae5144-0987-41a4-b3f2-b624670a7db1 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:16:10.560118 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cae5144-0987-41a4-b3f2-b624670a7db1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:16:10.564543 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:16:10.590156 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-5cae5144-0987-41a4-b3f2-b624670a7db1 None None] MFA Rules not processed for user `a326a5bb7364479382f528a592371656`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:16:10.591849 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-5cae5144-0987-41a4-b3f2-b624670a7db1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:16:10.709098 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:16:10.715453 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 14/27] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Oct 12 02:16:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 12 02:16:10.728958 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92aa2be-a1e9-422d-afe3-ff4607211b3b None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:16:10.766350 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cae5144-0987-41a4-b3f2-b624670a7db1 None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:16:10.816310 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebe2070-a56e-45d6-88da-15ba8193ffe4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:16:10.816877 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebe2070-a56e-45d6-88da-15ba8193ffe4 None admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:16:10.817160 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebe2070-a56e-45d6-88da-15ba8193ffe4 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:16:10.817477 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebe2070-a56e-45d6-88da-15ba8193ffe4 None admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:16:10.818165 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cebe2070-a56e-45d6-88da-15ba8193ffe4 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:16:10.819541 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cebe2070-a56e-45d6-88da-15ba8193ffe4 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:16:10.975238 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cae5144-0987-41a4-b3f2-b624670a7db1 None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:16:11.014902 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 14/28] 10.222.0.18 () {60 vars in 1131 bytes} [Wed Oct 12 02:16:10 2022] POST /identity/v3/roles => generated 219 bytes in 467 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 02:16:11.016230 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebe2070-a56e-45d6-88da-15ba8193ffe4 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:16:11.058714 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b2e93f-a3ac-4501-9e29-94851e8c57ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:16:11.059729 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b2e93f-a3ac-4501-9e29-94851e8c57ef None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:16:11.060202 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b2e93f-a3ac-4501-9e29-94851e8c57ef None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:16:11.060723 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b2e93f-a3ac-4501-9e29-94851e8c57ef None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:16:11.082781 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b2e93f-a3ac-4501-9e29-94851e8c57ef None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:16:11.084349 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b2e93f-a3ac-4501-9e29-94851e8c57ef None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:16:11.106383 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application [None req-85b2e93f-a3ac-4501-9e29-94851e8c57ef None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 02:16:11.106383 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 02:16:11.106383 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 02:16:11.106383 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 02:16:11.106383 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 02:16:11.106383 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 02:16:11.106383 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 02:16:11.106383 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 02:16:11.106383 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 02:16:11.106383 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 02:16:11.106383 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 02:16:11.106383 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 02:16:11.106383 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 12 02:16:11.106383 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 12 02:16:11.106383 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 12 02:16:11.106383 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 12 02:16:11.107730 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 02:16:11.107730 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 02:16:11.107730 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 02:16:11.107730 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 02:16:11.107730 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 02:16:11.107730 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 02:16:11.107730 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 02:16:11.107730 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application with Lock( Oct 12 02:16:11.107730 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 02:16:11.107730 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._enter() Oct 12 02:16:11.107730 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 02:16:11.107730 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 02:16:11.107730 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 02:16:11.107730 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.creator() Oct 12 02:16:11.107730 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 02:16:11.107730 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application created_value = creator( Oct 12 02:16:11.107730 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 12 02:16:11.108573 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 12 02:16:11.108573 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 02:16:11.108573 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Oct 12 02:16:11.108573 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 15/29] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Oct 12 02:16:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 342 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 02:16:11.108812 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f67e4b-6558-4249-9f1e-6af4c016386f None None] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:16:11.109248 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f67e4b-6558-4249-9f1e-6af4c016386f None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:16:11.109661 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f67e4b-6558-4249-9f1e-6af4c016386f None None] PATH_INFO: `/` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:16:11.111126 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 16/30] 10.222.0.18 () {54 vars in 927 bytes} [Wed Oct 12 02:16:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 02:16:11.117133 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d8a215-d13b-44d9-b752-b355037699ac None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:16:11.118932 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d8a215-d13b-44d9-b752-b355037699ac None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:16:11.120419 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d8a215-d13b-44d9-b752-b355037699ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:16:11.149238 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:16:11.158822 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-f8d8a215-d13b-44d9-b752-b355037699ac None None] MFA Rules not processed for user `a326a5bb7364479382f528a592371656`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:16:11.160289 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-f8d8a215-d13b-44d9-b752-b355037699ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:16:11.214624 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebe2070-a56e-45d6-88da-15ba8193ffe4 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:16:11.260789 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:16:11.268878 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057a4156-1aff-4cc9-93d5-f752915c8b8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:16:11.269905 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057a4156-1aff-4cc9-93d5-f752915c8b8c None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:16:11.270407 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057a4156-1aff-4cc9-93d5-f752915c8b8c None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:16:11.270895 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057a4156-1aff-4cc9-93d5-f752915c8b8c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:16:11.287003 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057a4156-1aff-4cc9-93d5-f752915c8b8c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 02:16:11.287345 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 17/31] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Oct 12 02:16:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 12 02:16:11.288281 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d8a215-d13b-44d9-b752-b355037699ac None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:16:11.295070 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-057a4156-1aff-4cc9-93d5-f752915c8b8c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 12 02:16:11.295070 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 02:16:11.295070 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 02:16:11.295070 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 02:16:11.295070 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 02:16:11.295070 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 02:16:11.295070 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 02:16:11.295070 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 02:16:11.295070 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 02:16:11.295070 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 02:16:11.295070 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 02:16:11.295070 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 02:16:11.295070 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 12 02:16:11.295070 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 12 02:16:11.295070 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 12 02:16:11.295070 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 12 02:16:11.295960 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 12 02:16:11.295960 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 12 02:16:11.295960 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 12 02:16:11.295960 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 12 02:16:11.295960 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 02:16:11.295960 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 02:16:11.295960 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 02:16:11.295960 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 02:16:11.295960 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 02:16:11.295960 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 02:16:11.295960 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 02:16:11.295960 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Oct 12 02:16:11.295960 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 02:16:11.295960 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Oct 12 02:16:11.295960 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 02:16:11.295960 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 02:16:11.296761 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 02:16:11.296761 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Oct 12 02:16:11.296761 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 02:16:11.296761 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Oct 12 02:16:11.296761 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 12 02:16:11.296761 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 12 02:16:11.296761 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 12 02:16:11.296761 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 12 02:16:11.296761 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 12 02:16:11.296761 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 12 02:16:11.296761 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 12 02:16:11.296761 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Oct 12 02:16:11.296761 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 15/32] 10.222.0.18 () {56 vars in 1096 bytes} [Wed Oct 12 02:16:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 02:16:11.302110 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057a4156-1aff-4cc9-93d5-f752915c8b8c None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:16:11.460907 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d8a215-d13b-44d9-b752-b355037699ac None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:16:11.491366 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057a4156-1aff-4cc9-93d5-f752915c8b8c None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:16:11.530945 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0161b5-5ef3-441c-ae39-96ab8bb900cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:16:11.531566 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0161b5-5ef3-441c-ae39-96ab8bb900cb None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:16:11.531841 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0161b5-5ef3-441c-ae39-96ab8bb900cb None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:16:11.532111 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0161b5-5ef3-441c-ae39-96ab8bb900cb None admin] PATH_INFO: `/v3/domains` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:16:11.532979 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0161b5-5ef3-441c-ae39-96ab8bb900cb None admin] RBAC: Adding query filter params (name=Default) {{(pid=81361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 02:16:11.533280 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0161b5-5ef3-441c-ae39-96ab8bb900cb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:16:11.534672 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0161b5-5ef3-441c-ae39-96ab8bb900cb None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:16:11.553569 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:16:11.560558 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f056e9-c695-4a79-a0bb-1cac877cc6c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:16:11.561176 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f056e9-c695-4a79-a0bb-1cac877cc6c8 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:16:11.561450 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f056e9-c695-4a79-a0bb-1cac877cc6c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:16:11.564889 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f056e9-c695-4a79-a0bb-1cac877cc6c8 None admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:16:11.565826 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f056e9-c695-4a79-a0bb-1cac877cc6c8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 02:16:11.566373 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f056e9-c695-4a79-a0bb-1cac877cc6c8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:16:11.568125 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f056e9-c695-4a79-a0bb-1cac877cc6c8 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:16:11.568361 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 18/33] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Oct 12 02:16:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 02:16:11.575264 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0161b5-5ef3-441c-ae39-96ab8bb900cb None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:16:11.595826 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 16/34] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Oct 12 02:16:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 02:16:11.601943 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f056e9-c695-4a79-a0bb-1cac877cc6c8 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:16:11.645850 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:16:11.718075 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0161b5-5ef3-441c-ae39-96ab8bb900cb None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:16:11.724329 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f056e9-c695-4a79-a0bb-1cac877cc6c8 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:16:11.766966 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165c1ab1-e504-493a-98dd-0de843c70061 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:16:11.767579 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165c1ab1-e504-493a-98dd-0de843c70061 None admin] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:16:11.767858 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165c1ab1-e504-493a-98dd-0de843c70061 None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:16:11.768130 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165c1ab1-e504-493a-98dd-0de843c70061 None admin] PATH_INFO: `/v3/projects` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:16:11.768819 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165c1ab1-e504-493a-98dd-0de843c70061 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:16:11.769385 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3b733f-63bc-41f2-ade8-1f1bec9dd6a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:16:11.770241 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3b733f-63bc-41f2-ade8-1f1bec9dd6a7 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:16:11.770361 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165c1ab1-e504-493a-98dd-0de843c70061 None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:16:11.770849 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3b733f-63bc-41f2-ade8-1f1bec9dd6a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:16:11.771319 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3b733f-63bc-41f2-ade8-1f1bec9dd6a7 None admin] PATH_INFO: `/v3/users/a326a5bb7364479382f528a592371656` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:16:11.773078 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3b733f-63bc-41f2-ade8-1f1bec9dd6a7 None admin] RBAC: Authorizing `identity:get_user(user_id=a326a5bb7364479382f528a592371656)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:16:11.774912 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3b733f-63bc-41f2-ade8-1f1bec9dd6a7 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:16:11.777296 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 17/35] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Oct 12 02:16:11 2022] GET /identity/v3/users/a326a5bb7364479382f528a592371656 => generated 247 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 02:16:11.778264 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3b733f-63bc-41f2-ade8-1f1bec9dd6a7 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:16:11.806792 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 19/36] 10.222.0.18 () {60 vars in 1141 bytes} [Wed Oct 12 02:16:11 2022] POST /identity/v3/projects => generated 301 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 02:16:11.807781 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165c1ab1-e504-493a-98dd-0de843c70061 None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:16:11.868868 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:16:11.968775 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3b733f-63bc-41f2-ade8-1f1bec9dd6a7 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:16:12.022740 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0e77f2-8b94-4938-8cfb-df6d853dba93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:16:12.023418 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0e77f2-8b94-4938-8cfb-df6d853dba93 None admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:16:12.023701 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0e77f2-8b94-4938-8cfb-df6d853dba93 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:16:12.023974 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0e77f2-8b94-4938-8cfb-df6d853dba93 None admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:16:12.024727 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0e77f2-8b94-4938-8cfb-df6d853dba93 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:16:12.026582 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0e77f2-8b94-4938-8cfb-df6d853dba93 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:16:12.048498 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 18/37] 10.222.0.18 () {60 vars in 1131 bytes} [Wed Oct 12 02:16:11 2022] POST /identity/v3/roles => generated 225 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 02:16:12.048498 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f2084c-059c-4e0a-b89e-b9c69b8c7e0b None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:16:12.048498 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f2084c-059c-4e0a-b89e-b9c69b8c7e0b None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:16:12.048498 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f2084c-059c-4e0a-b89e-b9c69b8c7e0b None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:16:12.048498 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 19/38] 10.222.0.18 () {54 vars in 927 bytes} [Wed Oct 12 02:16:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 02:16:12.054579 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde07328-2203-4738-943e-f9e462cfd5da None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:16:12.054857 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde07328-2203-4738-943e-f9e462cfd5da None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:16:12.055136 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde07328-2203-4738-943e-f9e462cfd5da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:16:12.091412 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-cde07328-2203-4738-943e-f9e462cfd5da None None] MFA Rules not processed for user `a326a5bb7364479382f528a592371656`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:16:12.093331 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-cde07328-2203-4738-943e-f9e462cfd5da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:16:12.128860 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165c1ab1-e504-493a-98dd-0de843c70061 None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:16:12.132732 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:16:12.180779 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9e18ed-cbd1-4176-aee2-1335ec1c6db6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:16:12.182401 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9e18ed-cbd1-4176-aee2-1335ec1c6db6 None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:16:12.182652 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9e18ed-cbd1-4176-aee2-1335ec1c6db6 None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:16:12.183528 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9e18ed-cbd1-4176-aee2-1335ec1c6db6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:16:12.184125 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9e18ed-cbd1-4176-aee2-1335ec1c6db6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:16:12.187278 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9e18ed-cbd1-4176-aee2-1335ec1c6db6 None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:16:12.187278 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 20/39] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Oct 12 02:16:11 2022] GET /identity/v3/domains/default => generated 199 bytes in 380 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 02:16:12.188529 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76802bee-4ea8-4009-9c8c-1233da6d6bed None None] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:16:12.188804 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76802bee-4ea8-4009-9c8c-1233da6d6bed None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:16:12.189287 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76802bee-4ea8-4009-9c8c-1233da6d6bed None None] PATH_INFO: `/` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:16:12.190337 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 21/40] 10.222.0.18 () {54 vars in 927 bytes} [Wed Oct 12 02:16:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 02:16:12.196149 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f091257a-8fd1-48a8-9017-a246d54efea8 None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:16:12.196453 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f091257a-8fd1-48a8-9017-a246d54efea8 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:16:12.196626 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 20/41] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Oct 12 02:16:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 12 02:16:12.197025 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f091257a-8fd1-48a8-9017-a246d54efea8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:16:12.201946 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde07328-2203-4738-943e-f9e462cfd5da None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:16:12.228132 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-f091257a-8fd1-48a8-9017-a246d54efea8 None None] MFA Rules not processed for user `a326a5bb7364479382f528a592371656`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:16:12.230464 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-f091257a-8fd1-48a8-9017-a246d54efea8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:16:12.265702 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:16:12.313172 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 22/42] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Oct 12 02:16:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 12 02:16:12.334098 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde07328-2203-4738-943e-f9e462cfd5da None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:16:12.372680 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048338a1-6857-4fd7-b8be-aa6ffa52dc8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:16:12.373568 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048338a1-6857-4fd7-b8be-aa6ffa52dc8d None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:16:12.374050 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048338a1-6857-4fd7-b8be-aa6ffa52dc8d None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:16:12.374489 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048338a1-6857-4fd7-b8be-aa6ffa52dc8d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:16:12.375465 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048338a1-6857-4fd7-b8be-aa6ffa52dc8d None admin] RBAC: Adding query filter params (role.id=39b1e8108dff402383def3c559f48189, scope.domain.id=default, user.id=a326a5bb7364479382f528a592371656) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 02:16:12.375937 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048338a1-6857-4fd7-b8be-aa6ffa52dc8d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:16:12.377556 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048338a1-6857-4fd7-b8be-aa6ffa52dc8d None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:16:12.388018 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 21/43] 10.222.0.18 () {56 vars in 1322 bytes} [Wed Oct 12 02:16:12 2022] GET /identity/v3/role_assignments?user.id=a326a5bb7364479382f528a592371656&scope.domain.id=default&role.id=39b1e8108dff402383def3c559f48189 => generated 530 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 02:16:12.484060 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f091257a-8fd1-48a8-9017-a246d54efea8 None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:16:12.592062 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:16:12.601943 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f091257a-8fd1-48a8-9017-a246d54efea8 None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:16:12.609785 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048338a1-6857-4fd7-b8be-aa6ffa52dc8d None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:16:12.640042 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060c3cac-674f-4151-b9d4-6b7ad745a017 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:16:12.640694 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060c3cac-674f-4151-b9d4-6b7ad745a017 None admin] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:16:12.640982 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060c3cac-674f-4151-b9d4-6b7ad745a017 None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:16:12.641258 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060c3cac-674f-4151-b9d4-6b7ad745a017 None admin] PATH_INFO: `/v3/roles` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:16:12.641930 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060c3cac-674f-4151-b9d4-6b7ad745a017 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:16:12.643316 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060c3cac-674f-4151-b9d4-6b7ad745a017 None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:16:12.659729 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 23/44] 10.222.0.18 () {60 vars in 1131 bytes} [Wed Oct 12 02:16:12 2022] POST /identity/v3/roles => generated 223 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 02:16:12.718077 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048338a1-6857-4fd7-b8be-aa6ffa52dc8d None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:16:12.733575 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:16:12.754986 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb215277-7723-4ff3-a5ce-d0ced2e3f182 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:16:12.755549 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb215277-7723-4ff3-a5ce-d0ced2e3f182 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:16:12.755826 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb215277-7723-4ff3-a5ce-d0ced2e3f182 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:16:12.756095 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb215277-7723-4ff3-a5ce-d0ced2e3f182 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:16:12.757294 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb215277-7723-4ff3-a5ce-d0ced2e3f182 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:16:12.758748 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb215277-7723-4ff3-a5ce-d0ced2e3f182 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:16:12.760414 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 22/45] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Oct 12 02:16:12 2022] GET /identity/v3/domains/default => generated 199 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 02:16:12.766168 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060c3cac-674f-4151-b9d4-6b7ad745a017 None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:16:12.871629 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060c3cac-674f-4151-b9d4-6b7ad745a017 None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:16:12.905050 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd53a00-a415-4013-9496-7eadf19fe7c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:16:12.905657 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd53a00-a415-4013-9496-7eadf19fe7c9 None admin] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:16:12.905935 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd53a00-a415-4013-9496-7eadf19fe7c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:16:12.906203 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd53a00-a415-4013-9496-7eadf19fe7c9 None admin] PATH_INFO: `/v3/projects` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:16:12.906844 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd53a00-a415-4013-9496-7eadf19fe7c9 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:16:12.908291 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd53a00-a415-4013-9496-7eadf19fe7c9 None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:16:12.934970 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 24/46] 10.222.0.18 () {60 vars in 1141 bytes} [Wed Oct 12 02:16:12 2022] POST /identity/v3/projects => generated 312 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 02:16:15.113661 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13f0efd-6a29-41a1-82a5-c0ceb07329c1 None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:16:15.114187 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13f0efd-6a29-41a1-82a5-c0ceb07329c1 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:16:15.114270 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13f0efd-6a29-41a1-82a5-c0ceb07329c1 None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:16:15.115560 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 23/47] 10.222.0.18 () {54 vars in 927 bytes} [Wed Oct 12 02:16:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 02:16:15.122082 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ac9647-8940-4067-a909-c85f344e943c None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:16:15.122488 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ac9647-8940-4067-a909-c85f344e943c None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:16:15.122633 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ac9647-8940-4067-a909-c85f344e943c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:16:15.129872 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:16:15.142091 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-39ac9647-8940-4067-a909-c85f344e943c None None] MFA Rules not processed for user `a326a5bb7364479382f528a592371656`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:16:15.143269 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-39ac9647-8940-4067-a909-c85f344e943c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:16:15.207449 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 25/48] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Oct 12 02:16:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 12 02:16:15.475625 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13f0efd-6a29-41a1-82a5-c0ceb07329c1 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:16:15.574942 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13f0efd-6a29-41a1-82a5-c0ceb07329c1 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:16:15.606695 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23474ee7-779b-40c2-990f-470a91a12cb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:16:15.607314 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23474ee7-779b-40c2-990f-470a91a12cb5 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:16:15.607592 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23474ee7-779b-40c2-990f-470a91a12cb5 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:16:15.607861 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23474ee7-779b-40c2-990f-470a91a12cb5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:16:15.608978 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23474ee7-779b-40c2-990f-470a91a12cb5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:16:15.610403 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23474ee7-779b-40c2-990f-470a91a12cb5 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:16:15.611939 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 24/49] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Oct 12 02:16:15 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 02:16:15.617619 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ac9647-8940-4067-a909-c85f344e943c None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:16:15.718989 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ac9647-8940-4067-a909-c85f344e943c None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:16:15.752698 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8707c6-523e-42c0-91ff-0c024f9c3426 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:16:15.753235 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8707c6-523e-42c0-91ff-0c024f9c3426 None admin] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:16:15.753511 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8707c6-523e-42c0-91ff-0c024f9c3426 None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:16:15.753778 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8707c6-523e-42c0-91ff-0c024f9c3426 None admin] PATH_INFO: `/v3/projects` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:16:15.754440 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8707c6-523e-42c0-91ff-0c024f9c3426 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:16:15.755882 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8707c6-523e-42c0-91ff-0c024f9c3426 None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:16:15.760365 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:16:15.781325 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 26/50] 10.222.0.18 () {60 vars in 1140 bytes} [Wed Oct 12 02:16:15 2022] POST /identity/v3/projects => generated 298 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 02:16:17.921505 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71e2676-cdf7-431e-a8c4-58105b98a965 None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:16:17.922002 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71e2676-cdf7-431e-a8c4-58105b98a965 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:16:17.922105 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71e2676-cdf7-431e-a8c4-58105b98a965 None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:16:17.923403 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 25/51] 10.222.0.18 () {54 vars in 927 bytes} [Wed Oct 12 02:16:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 02:16:17.928517 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1adc99c-accd-4d6c-9203-a284dcbfc197 None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:16:17.928922 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1adc99c-accd-4d6c-9203-a284dcbfc197 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:16:17.929072 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1adc99c-accd-4d6c-9203-a284dcbfc197 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:16:17.947463 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-f1adc99c-accd-4d6c-9203-a284dcbfc197 None None] MFA Rules not processed for user `a326a5bb7364479382f528a592371656`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:16:17.948752 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-f1adc99c-accd-4d6c-9203-a284dcbfc197 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:16:18.013111 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 27/52] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Oct 12 02:16:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 12 02:16:18.277287 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71e2676-cdf7-431e-a8c4-58105b98a965 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:16:18.326974 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:16:18.375766 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71e2676-cdf7-431e-a8c4-58105b98a965 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:16:18.408164 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e32d10d-9e37-47d2-890f-ca6cf59296d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:16:18.408804 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e32d10d-9e37-47d2-890f-ca6cf59296d7 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:16:18.409080 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e32d10d-9e37-47d2-890f-ca6cf59296d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:16:18.409350 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e32d10d-9e37-47d2-890f-ca6cf59296d7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:16:18.410441 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e32d10d-9e37-47d2-890f-ca6cf59296d7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:16:18.411869 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e32d10d-9e37-47d2-890f-ca6cf59296d7 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:16:18.413430 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 26/53] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Oct 12 02:16:18 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 02:16:18.418875 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1adc99c-accd-4d6c-9203-a284dcbfc197 None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:16:18.512776 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1adc99c-accd-4d6c-9203-a284dcbfc197 None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:16:18.530114 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:16:18.547797 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea952e59-5a6a-4e6c-a133-285ba4023b02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:16:18.548409 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea952e59-5a6a-4e6c-a133-285ba4023b02 None admin] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:16:18.548714 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea952e59-5a6a-4e6c-a133-285ba4023b02 None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:16:18.548987 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea952e59-5a6a-4e6c-a133-285ba4023b02 None admin] PATH_INFO: `/v3/users` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:16:18.549644 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea952e59-5a6a-4e6c-a133-285ba4023b02 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:16:18.551082 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea952e59-5a6a-4e6c-a133-285ba4023b02 None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:16:18.576661 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 28/54] 10.222.0.18 () {60 vars in 1132 bytes} [Wed Oct 12 02:16:18 2022] POST /identity/v3/users => generated 275 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 02:16:21.852379 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303b76ed-baac-4aed-8672-74de84efedc8 None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:16:21.854155 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303b76ed-baac-4aed-8672-74de84efedc8 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:16:21.854656 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303b76ed-baac-4aed-8672-74de84efedc8 None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:16:21.856342 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 27/55] 10.222.0.18 () {54 vars in 927 bytes} [Wed Oct 12 02:16:21 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 02:16:21.862649 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2620ceba-9338-4da2-99a6-f22ab0e8b425 None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:16:21.863623 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2620ceba-9338-4da2-99a6-f22ab0e8b425 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:16:21.864102 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2620ceba-9338-4da2-99a6-f22ab0e8b425 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:16:21.894307 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-2620ceba-9338-4da2-99a6-f22ab0e8b425 None None] MFA Rules not processed for user `a326a5bb7364479382f528a592371656`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:16:21.895862 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-2620ceba-9338-4da2-99a6-f22ab0e8b425 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:16:21.985821 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 29/56] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Oct 12 02:16:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 12 02:16:22.077366 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c040cf4b-6b4a-48e7-b14f-848810d656f8 None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:16:22.077993 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c040cf4b-6b4a-48e7-b14f-848810d656f8 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:16:22.078498 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c040cf4b-6b4a-48e7-b14f-848810d656f8 None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:16:22.080144 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 28/57] 10.222.0.18 () {54 vars in 927 bytes} [Wed Oct 12 02:16:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 02:16:22.085661 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fbf280-1a45-45b3-a46d-445b4cd5a46e None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:16:22.086200 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fbf280-1a45-45b3-a46d-445b4cd5a46e None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:16:22.086773 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fbf280-1a45-45b3-a46d-445b4cd5a46e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:16:22.114019 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-94fbf280-1a45-45b3-a46d-445b4cd5a46e None None] MFA Rules not processed for user `a326a5bb7364479382f528a592371656`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:16:22.115612 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-94fbf280-1a45-45b3-a46d-445b4cd5a46e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:16:22.128007 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d136073-452c-4ab2-8d69-6c73b8b7101c None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:16:22.128633 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d136073-452c-4ab2-8d69-6c73b8b7101c None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:16:22.129136 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d136073-452c-4ab2-8d69-6c73b8b7101c None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:16:22.130679 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 29/58] 10.222.0.18 () {54 vars in 927 bytes} [Wed Oct 12 02:16:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 02:16:22.136057 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf53f85-e0d1-437a-94d3-f89aed3f381b None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:16:22.136606 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf53f85-e0d1-437a-94d3-f89aed3f381b None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:16:22.137084 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf53f85-e0d1-437a-94d3-f89aed3f381b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:16:22.168222 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-cbf53f85-e0d1-437a-94d3-f89aed3f381b None None] MFA Rules not processed for user `a326a5bb7364479382f528a592371656`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:16:22.170487 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-cbf53f85-e0d1-437a-94d3-f89aed3f381b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:16:22.245904 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 30/59] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Oct 12 02:16:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 12 02:16:22.271076 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 30/60] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Oct 12 02:16:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 12 02:16:22.448372 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fbf280-1a45-45b3-a46d-445b4cd5a46e None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:16:22.479728 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:16:22.487665 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1278de1d-7e60-4190-8c74-38f3f79a28c2 None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:16:22.489110 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1278de1d-7e60-4190-8c74-38f3f79a28c2 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:16:22.489593 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1278de1d-7e60-4190-8c74-38f3f79a28c2 None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:16:22.491393 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 31/61] 10.222.0.18 () {54 vars in 927 bytes} [Wed Oct 12 02:16:22 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 02:16:22.497147 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f4d477-f3c4-4ae7-9c36-ce6a92a80eb1 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:16:22.497669 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f4d477-f3c4-4ae7-9c36-ce6a92a80eb1 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:16:22.498249 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f4d477-f3c4-4ae7-9c36-ce6a92a80eb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:16:22.530362 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-15f4d477-f3c4-4ae7-9c36-ce6a92a80eb1 None None] MFA Rules not processed for user `a326a5bb7364479382f528a592371656`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:16:22.531734 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-15f4d477-f3c4-4ae7-9c36-ce6a92a80eb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:16:22.568208 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fbf280-1a45-45b3-a46d-445b4cd5a46e None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:16:22.582667 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:16:22.611179 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 32/62] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Oct 12 02:16:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 12 02:16:22.612037 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22966d16-c3fc-4f38-b611-01dc1ec44480 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:16:22.612293 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f4d477-f3c4-4ae7-9c36-ce6a92a80eb1 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:16:22.612716 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22966d16-c3fc-4f38-b611-01dc1ec44480 None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:16:22.612995 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22966d16-c3fc-4f38-b611-01dc1ec44480 None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:16:22.613265 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22966d16-c3fc-4f38-b611-01dc1ec44480 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:16:22.624667 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22966d16-c3fc-4f38-b611-01dc1ec44480 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 02:16:22.629906 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application [None req-22966d16-c3fc-4f38-b611-01dc1ec44480 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 12 02:16:22.629906 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 02:16:22.629906 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 02:16:22.629906 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 02:16:22.629906 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 02:16:22.629906 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 02:16:22.629906 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 02:16:22.629906 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 02:16:22.629906 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 02:16:22.629906 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 02:16:22.629906 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 02:16:22.629906 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 02:16:22.629906 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 12 02:16:22.629906 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 12 02:16:22.629906 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 12 02:16:22.629906 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 12 02:16:22.630742 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 12 02:16:22.630742 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 12 02:16:22.630742 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 12 02:16:22.630742 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 12 02:16:22.630742 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 02:16:22.630742 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 02:16:22.630742 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 02:16:22.630742 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 02:16:22.630742 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 02:16:22.630742 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 02:16:22.630742 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 02:16:22.630742 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application with Lock( Oct 12 02:16:22.630742 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 02:16:22.630742 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._enter() Oct 12 02:16:22.630742 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 02:16:22.630742 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 02:16:22.631634 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 02:16:22.631634 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.creator() Oct 12 02:16:22.631634 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 02:16:22.631634 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application created_value = creator( Oct 12 02:16:22.631634 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 12 02:16:22.631634 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 12 02:16:22.631634 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 12 02:16:22.631634 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 12 02:16:22.631634 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 12 02:16:22.631634 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 12 02:16:22.631634 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 12 02:16:22.631634 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Oct 12 02:16:22.631634 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 31/63] 10.222.0.18 () {56 vars in 1096 bytes} [Wed Oct 12 02:16:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 02:16:22.641511 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22966d16-c3fc-4f38-b611-01dc1ec44480 None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:16:22.724810 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f4d477-f3c4-4ae7-9c36-ce6a92a80eb1 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:16:22.756538 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:16:22.761819 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77b22e2-6ee7-41bf-9f10-dc1b98c5430d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:16:22.762460 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77b22e2-6ee7-41bf-9f10-dc1b98c5430d None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:16:22.762743 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77b22e2-6ee7-41bf-9f10-dc1b98c5430d None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:16:22.763018 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77b22e2-6ee7-41bf-9f10-dc1b98c5430d None admin] PATH_INFO: `/v3/roles/member` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:16:22.768031 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22966d16-c3fc-4f38-b611-01dc1ec44480 None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:16:22.773383 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77b22e2-6ee7-41bf-9f10-dc1b98c5430d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 02:16:22.778891 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-b77b22e2-6ee7-41bf-9f10-dc1b98c5430d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 12 02:16:22.778891 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 02:16:22.778891 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 02:16:22.778891 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 02:16:22.778891 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 02:16:22.778891 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 02:16:22.778891 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 02:16:22.778891 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 02:16:22.778891 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 02:16:22.778891 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 02:16:22.778891 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 02:16:22.778891 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 02:16:22.778891 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 12 02:16:22.778891 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 12 02:16:22.778891 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 12 02:16:22.778891 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 12 02:16:22.779758 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 12 02:16:22.779758 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 12 02:16:22.779758 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 12 02:16:22.779758 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 12 02:16:22.779758 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 02:16:22.779758 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 02:16:22.779758 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 02:16:22.779758 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 02:16:22.779758 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 02:16:22.779758 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 02:16:22.779758 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 02:16:22.779758 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Oct 12 02:16:22.779758 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 02:16:22.779758 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Oct 12 02:16:22.779758 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 02:16:22.779758 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 02:16:22.780537 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 02:16:22.780537 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Oct 12 02:16:22.780537 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 02:16:22.780537 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Oct 12 02:16:22.780537 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 12 02:16:22.780537 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 12 02:16:22.780537 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 12 02:16:22.780537 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 12 02:16:22.780537 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 12 02:16:22.780537 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 12 02:16:22.780537 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 12 02:16:22.780537 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Oct 12 02:16:22.780537 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 33/64] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Oct 12 02:16:22 2022] GET /identity/v3/roles/member => generated 84 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 02:16:22.781167 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77b22e2-6ee7-41bf-9f10-dc1b98c5430d None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:16:22.812621 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2aa8b1-6133-47a0-bebb-e081d09f09f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:16:22.813616 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2aa8b1-6133-47a0-bebb-e081d09f09f3 None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:16:22.814162 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2aa8b1-6133-47a0-bebb-e081d09f09f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:16:22.814645 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2aa8b1-6133-47a0-bebb-e081d09f09f3 None admin] PATH_INFO: `/v3/roles` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:16:22.815529 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2aa8b1-6133-47a0-bebb-e081d09f09f3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 02:16:22.816039 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2aa8b1-6133-47a0-bebb-e081d09f09f3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:16:22.817723 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2aa8b1-6133-47a0-bebb-e081d09f09f3 None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:16:22.828371 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 32/65] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Oct 12 02:16:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 02:16:22.830050 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cf3d46-3299-402f-8c7c-8d7d07d8e647 None None] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:16:22.830534 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cf3d46-3299-402f-8c7c-8d7d07d8e647 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:16:22.831001 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cf3d46-3299-402f-8c7c-8d7d07d8e647 None None] PATH_INFO: `/` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:16:22.832571 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 33/66] 10.222.0.18 () {54 vars in 927 bytes} [Wed Oct 12 02:16:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 02:16:22.833588 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cf3d46-3299-402f-8c7c-8d7d07d8e647 None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:16:22.929258 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:16:22.943180 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cf3d46-3299-402f-8c7c-8d7d07d8e647 None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:16:22.976906 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327155d0-aaa3-4b73-9832-f3f5f8d6d208 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:16:22.977445 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327155d0-aaa3-4b73-9832-f3f5f8d6d208 None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:16:22.978417 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327155d0-aaa3-4b73-9832-f3f5f8d6d208 None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:16:22.978696 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327155d0-aaa3-4b73-9832-f3f5f8d6d208 None admin] PATH_INFO: `/v3/roles` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:16:22.979353 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327155d0-aaa3-4b73-9832-f3f5f8d6d208 None admin] RBAC: Adding query filter params (name=member) {{(pid=81361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 02:16:22.979655 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327155d0-aaa3-4b73-9832-f3f5f8d6d208 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:16:22.981077 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327155d0-aaa3-4b73-9832-f3f5f8d6d208 None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:16:22.989093 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 34/67] 10.222.0.18 () {56 vars in 1101 bytes} [Wed Oct 12 02:16:22 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 02:16:22.989872 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327155d0-aaa3-4b73-9832-f3f5f8d6d208 None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:16:22.994510 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77b22e2-6ee7-41bf-9f10-dc1b98c5430d None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:16:23.007188 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:16:23.029134 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8927142-5107-4b8b-bd1d-ddb8cdcff677 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:16:23.029770 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8927142-5107-4b8b-bd1d-ddb8cdcff677 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:16:23.030055 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8927142-5107-4b8b-bd1d-ddb8cdcff677 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:16:23.030333 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8927142-5107-4b8b-bd1d-ddb8cdcff677 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:16:23.040596 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8927142-5107-4b8b-bd1d-ddb8cdcff677 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 02:16:23.045406 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-e8927142-5107-4b8b-bd1d-ddb8cdcff677 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 12 02:16:23.045406 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 02:16:23.045406 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 02:16:23.045406 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 02:16:23.045406 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 02:16:23.045406 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 02:16:23.045406 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 02:16:23.045406 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 02:16:23.045406 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 02:16:23.045406 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 02:16:23.045406 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 02:16:23.045406 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 02:16:23.045406 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 12 02:16:23.045406 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 12 02:16:23.045406 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 12 02:16:23.045406 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 12 02:16:23.046453 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 12 02:16:23.046453 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 12 02:16:23.046453 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 12 02:16:23.046453 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 12 02:16:23.046453 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 02:16:23.046453 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 02:16:23.046453 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 02:16:23.046453 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 02:16:23.046453 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 02:16:23.046453 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 02:16:23.046453 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 02:16:23.046453 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Oct 12 02:16:23.046453 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 02:16:23.046453 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Oct 12 02:16:23.046453 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 02:16:23.046453 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 02:16:23.047402 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 02:16:23.047402 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Oct 12 02:16:23.047402 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 02:16:23.047402 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Oct 12 02:16:23.047402 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 12 02:16:23.047402 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 12 02:16:23.047402 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 12 02:16:23.047402 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 12 02:16:23.047402 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 12 02:16:23.047402 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 12 02:16:23.047402 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 12 02:16:23.047402 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Oct 12 02:16:23.047402 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 34/68] 10.222.0.18 () {56 vars in 1114 bytes} [Wed Oct 12 02:16:22 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 02:16:23.053030 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacbb17f-a21b-44da-889b-d1beb1d6d08d None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:16:23.053317 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacbb17f-a21b-44da-889b-d1beb1d6d08d None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:16:23.053592 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacbb17f-a21b-44da-889b-d1beb1d6d08d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:16:23.071207 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-eacbb17f-a21b-44da-889b-d1beb1d6d08d None None] MFA Rules not processed for user `a326a5bb7364479382f528a592371656`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:16:23.073189 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-eacbb17f-a21b-44da-889b-d1beb1d6d08d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:16:23.090935 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327155d0-aaa3-4b73-9832-f3f5f8d6d208 None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:16:23.124774 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa648331-7509-4020-8119-189fc0f33bad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:16:23.125397 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa648331-7509-4020-8119-189fc0f33bad None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:16:23.125676 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa648331-7509-4020-8119-189fc0f33bad None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:16:23.125952 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa648331-7509-4020-8119-189fc0f33bad None admin] PATH_INFO: `/v3/users/a326a5bb7364479382f528a592371656` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:16:23.127117 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa648331-7509-4020-8119-189fc0f33bad None admin] RBAC: Authorizing `identity:get_user(user_id=a326a5bb7364479382f528a592371656)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:16:23.128604 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa648331-7509-4020-8119-189fc0f33bad None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:16:23.130163 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 35/69] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Oct 12 02:16:22 2022] GET /identity/v3/users/a326a5bb7364479382f528a592371656 => generated 247 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 02:16:23.130907 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa648331-7509-4020-8119-189fc0f33bad None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:16:23.143215 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 35/70] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Oct 12 02:16:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 12 02:16:23.143973 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacbb17f-a21b-44da-889b-d1beb1d6d08d None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:16:23.178375 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:16:23.223116 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:16:23.241224 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa648331-7509-4020-8119-189fc0f33bad None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:16:23.260145 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacbb17f-a21b-44da-889b-d1beb1d6d08d None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:16:23.278942 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20f4aa0-a8cb-44f6-b3cb-8a126a472725 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:16:23.279586 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20f4aa0-a8cb-44f6-b3cb-8a126a472725 None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:16:23.279876 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20f4aa0-a8cb-44f6-b3cb-8a126a472725 None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:16:23.280156 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20f4aa0-a8cb-44f6-b3cb-8a126a472725 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:16:23.291851 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20f4aa0-a8cb-44f6-b3cb-8a126a472725 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 02:16:23.295740 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e24a098-5461-49b8-8ef1-785263b13875 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:16:23.296373 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e24a098-5461-49b8-8ef1-785263b13875 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:16:23.296685 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e24a098-5461-49b8-8ef1-785263b13875 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:16:23.296963 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e24a098-5461-49b8-8ef1-785263b13875 None admin] PATH_INFO: `/v3/users/0b038ba692d94cff9a2a3042ea6f6922` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:16:23.297192 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application [None req-e20f4aa0-a8cb-44f6-b3cb-8a126a472725 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 12 02:16:23.297192 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 02:16:23.297192 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 02:16:23.297192 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 02:16:23.297192 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 02:16:23.297192 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 02:16:23.297192 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 02:16:23.297192 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 02:16:23.297192 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 02:16:23.297192 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 02:16:23.297192 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 02:16:23.297192 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 02:16:23.297192 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 12 02:16:23.297192 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 12 02:16:23.297192 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 12 02:16:23.297192 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 12 02:16:23.297967 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 12 02:16:23.297967 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 12 02:16:23.297967 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 12 02:16:23.297967 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 12 02:16:23.297967 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 02:16:23.297967 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 02:16:23.297967 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 02:16:23.297967 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 02:16:23.297967 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 02:16:23.297967 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 02:16:23.297967 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 02:16:23.297967 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application with Lock( Oct 12 02:16:23.297967 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 02:16:23.297967 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._enter() Oct 12 02:16:23.297967 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 02:16:23.297967 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 02:16:23.298761 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 02:16:23.298761 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.creator() Oct 12 02:16:23.298761 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 02:16:23.298761 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application created_value = creator( Oct 12 02:16:23.298761 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 12 02:16:23.298761 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 12 02:16:23.298761 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 12 02:16:23.298761 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 12 02:16:23.298761 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 12 02:16:23.298761 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 12 02:16:23.298761 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 12 02:16:23.298761 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Oct 12 02:16:23.298761 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 36/71] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Oct 12 02:16:23 2022] GET /identity/v3/roles/member => generated 84 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 02:16:23.300097 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20f4aa0-a8cb-44f6-b3cb-8a126a472725 None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:16:23.319379 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e24a098-5461-49b8-8ef1-785263b13875 None admin] RBAC: Authorizing `identity:get_user(user_id=0b038ba692d94cff9a2a3042ea6f6922)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:16:23.320912 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e24a098-5461-49b8-8ef1-785263b13875 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:16:23.323277 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 36/72] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Oct 12 02:16:23 2022] GET /identity/v3/users/0b038ba692d94cff9a2a3042ea6f6922 => generated 275 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 02:16:23.323881 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e24a098-5461-49b8-8ef1-785263b13875 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:16:23.413605 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:16:23.419115 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20f4aa0-a8cb-44f6-b3cb-8a126a472725 None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:16:23.431938 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e24a098-5461-49b8-8ef1-785263b13875 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:16:23.453234 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f23d1ad-2903-4165-a7d2-3819094b55af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:16:23.453967 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f23d1ad-2903-4165-a7d2-3819094b55af None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:16:23.454253 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f23d1ad-2903-4165-a7d2-3819094b55af None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:16:23.454541 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f23d1ad-2903-4165-a7d2-3819094b55af None admin] PATH_INFO: `/v3/roles` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:16:23.455237 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f23d1ad-2903-4165-a7d2-3819094b55af None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 02:16:23.455545 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f23d1ad-2903-4165-a7d2-3819094b55af None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:16:23.456975 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f23d1ad-2903-4165-a7d2-3819094b55af None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:16:23.465152 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 37/73] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Oct 12 02:16:23 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 02:16:23.465775 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f23d1ad-2903-4165-a7d2-3819094b55af None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:16:23.474620 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:16:23.482075 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babc7592-57e7-4a1d-ad80-4f29443e3c49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:16:23.482720 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babc7592-57e7-4a1d-ad80-4f29443e3c49 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:16:23.482996 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babc7592-57e7-4a1d-ad80-4f29443e3c49 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:16:23.483267 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babc7592-57e7-4a1d-ad80-4f29443e3c49 None admin] PATH_INFO: `/v3/projects/fd1c4db151454810bdf01c589c22b7b7` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:16:23.484396 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-babc7592-57e7-4a1d-ad80-4f29443e3c49 None admin] RBAC: Authorizing `identity:get_project(project_id=fd1c4db151454810bdf01c589c22b7b7)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:16:23.486155 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-babc7592-57e7-4a1d-ad80-4f29443e3c49 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:16:23.487928 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 37/74] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Oct 12 02:16:23 2022] GET /identity/v3/projects/fd1c4db151454810bdf01c589c22b7b7 => generated 298 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 02:16:23.488549 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babc7592-57e7-4a1d-ad80-4f29443e3c49 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:16:23.570989 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f23d1ad-2903-4165-a7d2-3819094b55af None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:16:23.591957 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babc7592-57e7-4a1d-ad80-4f29443e3c49 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:16:23.605956 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fedf431-781a-474e-be2b-e7a06a716865 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:16:23.606570 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fedf431-781a-474e-be2b-e7a06a716865 None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:16:23.606857 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fedf431-781a-474e-be2b-e7a06a716865 None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:16:23.607136 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fedf431-781a-474e-be2b-e7a06a716865 None admin] PATH_INFO: `/v3/roles` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:16:23.607799 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fedf431-781a-474e-be2b-e7a06a716865 None admin] RBAC: Adding query filter params (name=member) {{(pid=81361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 02:16:23.608107 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fedf431-781a-474e-be2b-e7a06a716865 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:16:23.609523 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fedf431-781a-474e-be2b-e7a06a716865 None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:16:23.617366 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 38/75] 10.222.0.18 () {56 vars in 1101 bytes} [Wed Oct 12 02:16:23 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 02:16:23.618941 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fedf431-781a-474e-be2b-e7a06a716865 None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:16:23.631678 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29157a4-7efb-4e38-a0c1-ecdc5c8e32e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:16:23.632307 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29157a4-7efb-4e38-a0c1-ecdc5c8e32e4 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:16:23.632620 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29157a4-7efb-4e38-a0c1-ecdc5c8e32e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:16:23.632895 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29157a4-7efb-4e38-a0c1-ecdc5c8e32e4 None admin] PATH_INFO: `/v3/projects/fd1c4db151454810bdf01c589c22b7b7` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:16:23.634126 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29157a4-7efb-4e38-a0c1-ecdc5c8e32e4 None admin] RBAC: Authorizing `identity:get_project(project_id=fd1c4db151454810bdf01c589c22b7b7)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:16:23.635510 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29157a4-7efb-4e38-a0c1-ecdc5c8e32e4 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:16:23.637284 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 38/76] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Oct 12 02:16:23 2022] GET /identity/v3/projects/fd1c4db151454810bdf01c589c22b7b7 => generated 298 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 02:16:23.637897 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29157a4-7efb-4e38-a0c1-ecdc5c8e32e4 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:16:23.661619 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:16:23.687689 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:16:23.729731 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fedf431-781a-474e-be2b-e7a06a716865 None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:16:23.737325 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29157a4-7efb-4e38-a0c1-ecdc5c8e32e4 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:16:23.763321 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f265f17c-4d13-4076-9a20-2748a7ed138c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:16:23.763951 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f265f17c-4d13-4076-9a20-2748a7ed138c None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:16:23.764233 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f265f17c-4d13-4076-9a20-2748a7ed138c None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:16:23.764553 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f265f17c-4d13-4076-9a20-2748a7ed138c None admin] PATH_INFO: `/v3/domains/default` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:16:23.765660 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f265f17c-4d13-4076-9a20-2748a7ed138c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:16:23.767103 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f265f17c-4d13-4076-9a20-2748a7ed138c None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:16:23.768904 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 39/77] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Oct 12 02:16:23 2022] GET /identity/v3/domains/default => generated 199 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 02:16:23.769523 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f265f17c-4d13-4076-9a20-2748a7ed138c None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:16:23.773258 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589b0e8d-2fd1-44d5-a22b-5e8e06c2b1cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:16:23.773904 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589b0e8d-2fd1-44d5-a22b-5e8e06c2b1cc None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:16:23.774184 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589b0e8d-2fd1-44d5-a22b-5e8e06c2b1cc None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:16:23.774955 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589b0e8d-2fd1-44d5-a22b-5e8e06c2b1cc None admin] PATH_INFO: `/v3/users/0b038ba692d94cff9a2a3042ea6f6922` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:16:23.776126 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589b0e8d-2fd1-44d5-a22b-5e8e06c2b1cc None admin] RBAC: Authorizing `identity:get_user(user_id=0b038ba692d94cff9a2a3042ea6f6922)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:16:23.777583 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589b0e8d-2fd1-44d5-a22b-5e8e06c2b1cc None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:16:23.779155 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 39/78] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Oct 12 02:16:23 2022] GET /identity/v3/users/0b038ba692d94cff9a2a3042ea6f6922 => generated 275 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 02:16:23.779905 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589b0e8d-2fd1-44d5-a22b-5e8e06c2b1cc None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:16:23.869185 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f265f17c-4d13-4076-9a20-2748a7ed138c None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:16:23.869887 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:16:23.879766 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589b0e8d-2fd1-44d5-a22b-5e8e06c2b1cc None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:16:23.901743 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841ee1f9-396b-473f-a108-322b55b8f003 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:16:23.902398 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841ee1f9-396b-473f-a108-322b55b8f003 None admin] REQUEST_METHOD: `PUT` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:16:23.902674 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841ee1f9-396b-473f-a108-322b55b8f003 None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:16:23.902946 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841ee1f9-396b-473f-a108-322b55b8f003 None admin] PATH_INFO: `/v3/projects/fd1c4db151454810bdf01c589c22b7b7/users/a326a5bb7364479382f528a592371656/roles/39b1e8108dff402383def3c559f48189` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:16:23.904876 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841ee1f9-396b-473f-a108-322b55b8f003 None admin] RBAC: Authorizing `identity:create_grant(project_id=fd1c4db151454810bdf01c589c22b7b7, user_id=a326a5bb7364479382f528a592371656, role_id=39b1e8108dff402383def3c559f48189)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:16:23.906353 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841ee1f9-396b-473f-a108-322b55b8f003 None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:16:23.909310 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:16:23.916450 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2efa65-63a7-41ee-a202-d8a0f940882b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:16:23.917131 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2efa65-63a7-41ee-a202-d8a0f940882b None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:16:23.917420 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2efa65-63a7-41ee-a202-d8a0f940882b None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:16:23.917701 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2efa65-63a7-41ee-a202-d8a0f940882b None admin] PATH_INFO: `/v3/users/0b038ba692d94cff9a2a3042ea6f6922` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:16:23.918847 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2efa65-63a7-41ee-a202-d8a0f940882b None admin] RBAC: Authorizing `identity:get_user(user_id=0b038ba692d94cff9a2a3042ea6f6922)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:16:23.920099 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 40/79] 10.222.0.18 () {58 vars in 1439 bytes} [Wed Oct 12 02:16:23 2022] PUT /identity/v3/projects/fd1c4db151454810bdf01c589c22b7b7/users/a326a5bb7364479382f528a592371656/roles/39b1e8108dff402383def3c559f48189 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 02:16:23.920302 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2efa65-63a7-41ee-a202-d8a0f940882b None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:16:23.920878 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841ee1f9-396b-473f-a108-322b55b8f003 None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:16:23.926540 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 40/80] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Oct 12 02:16:23 2022] GET /identity/v3/users/0b038ba692d94cff9a2a3042ea6f6922 => generated 275 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 02:16:23.926540 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2efa65-63a7-41ee-a202-d8a0f940882b None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:16:24.039654 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841ee1f9-396b-473f-a108-322b55b8f003 None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:16:24.052427 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2efa65-63a7-41ee-a202-d8a0f940882b None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:16:24.078699 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd29474-fc80-4d3c-89f2-006a976da455 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:16:24.079393 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd29474-fc80-4d3c-89f2-006a976da455 None admin] REQUEST_METHOD: `PUT` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:16:24.079678 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd29474-fc80-4d3c-89f2-006a976da455 None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:16:24.079960 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd29474-fc80-4d3c-89f2-006a976da455 None admin] PATH_INFO: `/v3/projects/fd1c4db151454810bdf01c589c22b7b7/users/0b038ba692d94cff9a2a3042ea6f6922/roles/3d75c4d7f1a849b9a771504d1583ab28` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:16:24.081979 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd29474-fc80-4d3c-89f2-006a976da455 None admin] RBAC: Authorizing `identity:create_grant(project_id=fd1c4db151454810bdf01c589c22b7b7, user_id=0b038ba692d94cff9a2a3042ea6f6922, role_id=3d75c4d7f1a849b9a771504d1583ab28)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:16:24.083458 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd29474-fc80-4d3c-89f2-006a976da455 None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:16:24.093982 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba9920e-1640-4f3d-b310-4e7c1ba058d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:16:24.094847 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba9920e-1640-4f3d-b310-4e7c1ba058d2 None admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:16:24.095186 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba9920e-1640-4f3d-b310-4e7c1ba058d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:16:24.095470 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba9920e-1640-4f3d-b310-4e7c1ba058d2 None admin] PATH_INFO: `/v3/users` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:16:24.096199 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba9920e-1640-4f3d-b310-4e7c1ba058d2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:16:24.098340 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba9920e-1640-4f3d-b310-4e7c1ba058d2 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:16:24.101345 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 41/81] 10.222.0.18 () {58 vars in 1439 bytes} [Wed Oct 12 02:16:23 2022] PUT /identity/v3/projects/fd1c4db151454810bdf01c589c22b7b7/users/0b038ba692d94cff9a2a3042ea6f6922/roles/3d75c4d7f1a849b9a771504d1583ab28 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 02:16:24.102184 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd29474-fc80-4d3c-89f2-006a976da455 None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:16:24.130683 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 41/82] 10.222.0.18 () {60 vars in 1132 bytes} [Wed Oct 12 02:16:23 2022] POST /identity/v3/users => generated 289 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 02:16:24.136628 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba9920e-1640-4f3d-b310-4e7c1ba058d2 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:16:24.174964 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:16:24.204821 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:16:24.312202 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd29474-fc80-4d3c-89f2-006a976da455 None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:16:24.360601 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc476f9e-ae6c-4f5a-8b25-bc61f74717cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:16:24.361194 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc476f9e-ae6c-4f5a-8b25-bc61f74717cc None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:16:24.361477 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc476f9e-ae6c-4f5a-8b25-bc61f74717cc None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:16:24.361755 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc476f9e-ae6c-4f5a-8b25-bc61f74717cc None admin] PATH_INFO: `/v3/projects/fd1c4db151454810bdf01c589c22b7b7` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:16:24.362910 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc476f9e-ae6c-4f5a-8b25-bc61f74717cc None admin] RBAC: Authorizing `identity:get_project(project_id=fd1c4db151454810bdf01c589c22b7b7)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:16:24.363619 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba9920e-1640-4f3d-b310-4e7c1ba058d2 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:16:24.364369 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc476f9e-ae6c-4f5a-8b25-bc61f74717cc None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:16:24.366177 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 42/83] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Oct 12 02:16:24 2022] GET /identity/v3/projects/fd1c4db151454810bdf01c589c22b7b7 => generated 298 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 02:16:24.373296 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc476f9e-ae6c-4f5a-8b25-bc61f74717cc None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:16:24.410098 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14b400c-8400-47ce-b375-0496553122b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:16:24.410869 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14b400c-8400-47ce-b375-0496553122b4 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:16:24.411082 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14b400c-8400-47ce-b375-0496553122b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:16:24.411387 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14b400c-8400-47ce-b375-0496553122b4 None admin] PATH_INFO: `/v3/projects/153409c77ed94fda8f9531fc436389b1` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:16:24.412590 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14b400c-8400-47ce-b375-0496553122b4 None admin] RBAC: Authorizing `identity:get_project(project_id=153409c77ed94fda8f9531fc436389b1)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:16:24.414607 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14b400c-8400-47ce-b375-0496553122b4 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:16:24.417314 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 42/84] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Oct 12 02:16:24 2022] GET /identity/v3/projects/153409c77ed94fda8f9531fc436389b1 => generated 312 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 02:16:24.423893 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14b400c-8400-47ce-b375-0496553122b4 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:16:24.500609 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc476f9e-ae6c-4f5a-8b25-bc61f74717cc None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:16:24.520860 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:16:24.541576 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:16:24.541943 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14b400c-8400-47ce-b375-0496553122b4 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:16:24.554903 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede64b8f-28b4-4432-b4da-8be95447cf9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:16:24.558491 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede64b8f-28b4-4432-b4da-8be95447cf9d None admin] REQUEST_METHOD: `PUT` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:16:24.559137 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede64b8f-28b4-4432-b4da-8be95447cf9d None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:16:24.559620 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede64b8f-28b4-4432-b4da-8be95447cf9d None admin] PATH_INFO: `/v3/projects/fd1c4db151454810bdf01c589c22b7b7/users/0b038ba692d94cff9a2a3042ea6f6922/roles/7b67553aa5874cca8c47e5fb5ffa1971` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:16:24.562208 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede64b8f-28b4-4432-b4da-8be95447cf9d None admin] RBAC: Authorizing `identity:create_grant(project_id=fd1c4db151454810bdf01c589c22b7b7, user_id=0b038ba692d94cff9a2a3042ea6f6922, role_id=7b67553aa5874cca8c47e5fb5ffa1971)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:16:24.563936 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede64b8f-28b4-4432-b4da-8be95447cf9d None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:16:24.580825 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f105ec3-986c-441b-8701-4e54eae6bec2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:16:24.581679 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f105ec3-986c-441b-8701-4e54eae6bec2 None admin] REQUEST_METHOD: `PUT` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:16:24.581871 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f105ec3-986c-441b-8701-4e54eae6bec2 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:16:24.582056 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 43/85] 10.222.0.18 () {58 vars in 1439 bytes} [Wed Oct 12 02:16:24 2022] PUT /identity/v3/projects/fd1c4db151454810bdf01c589c22b7b7/users/0b038ba692d94cff9a2a3042ea6f6922/roles/7b67553aa5874cca8c47e5fb5ffa1971 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 02:16:24.582151 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f105ec3-986c-441b-8701-4e54eae6bec2 None admin] PATH_INFO: `/v3/projects/153409c77ed94fda8f9531fc436389b1/users/0b038ba692d94cff9a2a3042ea6f6922/roles/3d75c4d7f1a849b9a771504d1583ab28` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:16:24.585770 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f105ec3-986c-441b-8701-4e54eae6bec2 None admin] RBAC: Authorizing `identity:create_grant(project_id=153409c77ed94fda8f9531fc436389b1, user_id=0b038ba692d94cff9a2a3042ea6f6922, role_id=3d75c4d7f1a849b9a771504d1583ab28)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:16:24.585916 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f105ec3-986c-441b-8701-4e54eae6bec2 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:16:24.609039 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 43/86] 10.222.0.18 () {58 vars in 1439 bytes} [Wed Oct 12 02:16:24 2022] PUT /identity/v3/projects/153409c77ed94fda8f9531fc436389b1/users/0b038ba692d94cff9a2a3042ea6f6922/roles/3d75c4d7f1a849b9a771504d1583ab28 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 02:16:26.924677 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf4f74f-8a25-440c-aa24-ec456873f0a7 None None] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:16:26.925698 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf4f74f-8a25-440c-aa24-ec456873f0a7 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:16:26.926195 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf4f74f-8a25-440c-aa24-ec456873f0a7 None None] PATH_INFO: `/` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:16:26.927790 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 44/87] 10.222.0.18 () {54 vars in 927 bytes} [Wed Oct 12 02:16:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 02:16:26.934042 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b93caf-9af2-40b9-b94d-541058f3f42e None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:16:26.934877 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b93caf-9af2-40b9-b94d-541058f3f42e None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:16:26.935346 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b93caf-9af2-40b9-b94d-541058f3f42e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:16:26.956849 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-60b93caf-9af2-40b9-b94d-541058f3f42e None None] MFA Rules not processed for user `a326a5bb7364479382f528a592371656`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:16:26.958382 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-60b93caf-9af2-40b9-b94d-541058f3f42e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:16:27.045377 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 44/88] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Oct 12 02:16:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 12 02:16:27.278168 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bac33c-6c45-42c5-9726-30c1224a1b72 None None] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:16:27.278835 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bac33c-6c45-42c5-9726-30c1224a1b72 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:16:27.279314 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bac33c-6c45-42c5-9726-30c1224a1b72 None None] PATH_INFO: `/` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:16:27.280903 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 45/89] 10.222.0.18 () {54 vars in 927 bytes} [Wed Oct 12 02:16:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 02:16:27.286251 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec3c887-854f-4ac4-af3d-4b095bc741e6 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:16:27.286752 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec3c887-854f-4ac4-af3d-4b095bc741e6 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:16:27.287232 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec3c887-854f-4ac4-af3d-4b095bc741e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:16:27.314096 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-2ec3c887-854f-4ac4-af3d-4b095bc741e6 None None] MFA Rules not processed for user `a326a5bb7364479382f528a592371656`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:16:27.315678 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-2ec3c887-854f-4ac4-af3d-4b095bc741e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:16:27.411615 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 45/90] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Oct 12 02:16:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 12 02:16:27.502449 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e5198a-0336-4312-88f4-647f6ddb04b0 None None] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:16:27.503096 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e5198a-0336-4312-88f4-647f6ddb04b0 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:16:27.503583 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e5198a-0336-4312-88f4-647f6ddb04b0 None None] PATH_INFO: `/` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:16:27.505630 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 46/91] 10.222.0.18 () {54 vars in 927 bytes} [Wed Oct 12 02:16:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 02:16:27.506860 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec3c887-854f-4ac4-af3d-4b095bc741e6 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:16:27.511111 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ff33eb-2f57-4528-b781-2ce3e0653007 None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:16:27.511675 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ff33eb-2f57-4528-b781-2ce3e0653007 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:16:27.512141 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ff33eb-2f57-4528-b781-2ce3e0653007 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:16:27.520765 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:16:27.547475 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-a3ff33eb-2f57-4528-b781-2ce3e0653007 None None] MFA Rules not processed for user `a326a5bb7364479382f528a592371656`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:16:27.548929 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-a3ff33eb-2f57-4528-b781-2ce3e0653007 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:16:27.688487 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 47/92] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Oct 12 02:16:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 12 02:16:27.689757 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb9bb84-86cd-449b-9ffd-399e1c048a0b None None] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:16:27.690046 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb9bb84-86cd-449b-9ffd-399e1c048a0b None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:16:27.690326 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb9bb84-86cd-449b-9ffd-399e1c048a0b None None] PATH_INFO: `/` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:16:27.692234 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 48/93] 10.222.0.18 () {54 vars in 927 bytes} [Wed Oct 12 02:16:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 02:16:27.698003 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876476f1-df41-44ac-8e25-90783456df4f None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:16:27.698285 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876476f1-df41-44ac-8e25-90783456df4f None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:16:27.698558 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876476f1-df41-44ac-8e25-90783456df4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:16:27.718458 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-876476f1-df41-44ac-8e25-90783456df4f None None] MFA Rules not processed for user `a326a5bb7364479382f528a592371656`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:16:27.719642 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-876476f1-df41-44ac-8e25-90783456df4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:16:27.752805 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec3c887-854f-4ac4-af3d-4b095bc741e6 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:16:27.803236 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06514c9-2e67-4d5f-839f-4a3d0945a9a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:16:27.804088 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06514c9-2e67-4d5f-839f-4a3d0945a9a9 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:16:27.804381 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06514c9-2e67-4d5f-839f-4a3d0945a9a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:16:27.804805 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06514c9-2e67-4d5f-839f-4a3d0945a9a9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:16:27.817122 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06514c9-2e67-4d5f-839f-4a3d0945a9a9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 02:16:27.817920 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 49/94] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Oct 12 02:16:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 12 02:16:27.824491 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5dd8ea2-a2b0-4863-9c07-bdebd9de933e None None] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:16:27.824614 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-a06514c9-2e67-4d5f-839f-4a3d0945a9a9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 12 02:16:27.824614 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 02:16:27.824614 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 02:16:27.824614 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 02:16:27.824614 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 02:16:27.824614 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 02:16:27.824614 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 02:16:27.824614 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 02:16:27.824614 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 02:16:27.824614 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 02:16:27.824614 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 02:16:27.824614 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 02:16:27.824614 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 12 02:16:27.824614 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 12 02:16:27.824614 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 12 02:16:27.824614 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 12 02:16:27.825624 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 12 02:16:27.825624 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 12 02:16:27.825624 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 12 02:16:27.825624 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 12 02:16:27.825624 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 02:16:27.825624 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 02:16:27.825624 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 02:16:27.825624 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 02:16:27.825624 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 02:16:27.825624 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 02:16:27.825624 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 02:16:27.825624 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Oct 12 02:16:27.825624 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 02:16:27.825624 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Oct 12 02:16:27.825624 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 02:16:27.825624 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 02:16:27.826368 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 02:16:27.826368 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Oct 12 02:16:27.826368 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 02:16:27.826368 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Oct 12 02:16:27.826368 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 12 02:16:27.826368 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 12 02:16:27.826368 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 12 02:16:27.826368 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 12 02:16:27.826368 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 12 02:16:27.826368 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 12 02:16:27.826368 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 12 02:16:27.826368 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Oct 12 02:16:27.826368 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 46/95] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Oct 12 02:16:27 2022] GET /identity/v3/roles/member => generated 84 bytes in 318 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 02:16:27.826368 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06514c9-2e67-4d5f-839f-4a3d0945a9a9 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:16:27.827638 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5dd8ea2-a2b0-4863-9c07-bdebd9de933e None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:16:27.828057 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5dd8ea2-a2b0-4863-9c07-bdebd9de933e None None] PATH_INFO: `/` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:16:27.830419 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 50/96] 10.222.0.18 () {54 vars in 927 bytes} [Wed Oct 12 02:16:27 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 02:16:27.832305 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5dd8ea2-a2b0-4863-9c07-bdebd9de933e None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:16:27.928204 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:16:27.944358 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:16:28.005955 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06514c9-2e67-4d5f-839f-4a3d0945a9a9 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:16:28.036736 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5dd8ea2-a2b0-4863-9c07-bdebd9de933e None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:16:28.047005 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301592be-f379-43b3-bd43-ceaae8d13eab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:16:28.047784 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301592be-f379-43b3-bd43-ceaae8d13eab None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:16:28.048163 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301592be-f379-43b3-bd43-ceaae8d13eab None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:16:28.048528 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301592be-f379-43b3-bd43-ceaae8d13eab None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:16:28.059876 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301592be-f379-43b3-bd43-ceaae8d13eab None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 02:16:28.064880 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-301592be-f379-43b3-bd43-ceaae8d13eab None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 12 02:16:28.064880 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 02:16:28.064880 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 02:16:28.064880 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 02:16:28.064880 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 02:16:28.064880 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 02:16:28.064880 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 02:16:28.064880 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 02:16:28.064880 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 02:16:28.064880 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 02:16:28.064880 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 02:16:28.064880 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 02:16:28.064880 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 12 02:16:28.064880 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 12 02:16:28.064880 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 12 02:16:28.064880 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 12 02:16:28.065736 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 12 02:16:28.065736 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 12 02:16:28.065736 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 12 02:16:28.065736 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 12 02:16:28.065736 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 02:16:28.065736 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 02:16:28.065736 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 02:16:28.065736 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 02:16:28.065736 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 02:16:28.065736 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 02:16:28.065736 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 02:16:28.065736 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Oct 12 02:16:28.065736 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 02:16:28.065736 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Oct 12 02:16:28.065736 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 02:16:28.065736 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 02:16:28.066511 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 02:16:28.066511 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Oct 12 02:16:28.066511 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 02:16:28.066511 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Oct 12 02:16:28.066511 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 12 02:16:28.066511 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 12 02:16:28.066511 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 12 02:16:28.066511 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 12 02:16:28.066511 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 12 02:16:28.066511 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 12 02:16:28.066511 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 12 02:16:28.066511 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Oct 12 02:16:28.066511 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 47/97] 10.222.0.18 () {56 vars in 1096 bytes} [Wed Oct 12 02:16:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 02:16:28.067584 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39983b9-38ab-4d28-9058-4c86cc07e2cf None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:16:28.068049 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39983b9-38ab-4d28-9058-4c86cc07e2cf None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:16:28.072127 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39983b9-38ab-4d28-9058-4c86cc07e2cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:16:28.083260 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b685fee-795e-49ba-9206-6e431ba7f7ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:16:28.084412 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b685fee-795e-49ba-9206-6e431ba7f7ed None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:16:28.084733 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b685fee-795e-49ba-9206-6e431ba7f7ed None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:16:28.085012 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b685fee-795e-49ba-9206-6e431ba7f7ed None admin] PATH_INFO: `/v3/roles` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:16:28.086009 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b685fee-795e-49ba-9206-6e431ba7f7ed None admin] RBAC: Adding query filter params (name=member) {{(pid=81361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 02:16:28.086319 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b685fee-795e-49ba-9206-6e431ba7f7ed None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:16:28.087835 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b685fee-795e-49ba-9206-6e431ba7f7ed None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:16:28.089571 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-e39983b9-38ab-4d28-9058-4c86cc07e2cf None None] MFA Rules not processed for user `a326a5bb7364479382f528a592371656`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:16:28.090894 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-e39983b9-38ab-4d28-9058-4c86cc07e2cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:16:28.097889 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 51/98] 10.222.0.18 () {56 vars in 1101 bytes} [Wed Oct 12 02:16:27 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 02:16:28.098581 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b685fee-795e-49ba-9206-6e431ba7f7ed None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:16:28.184561 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 48/99] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Oct 12 02:16:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 12 02:16:28.184561 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39983b9-38ab-4d28-9058-4c86cc07e2cf None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:16:28.228187 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b685fee-795e-49ba-9206-6e431ba7f7ed None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:16:28.236905 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:16:28.240879 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:16:28.270222 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b96ee2-5fdc-4d5c-b82d-c32c7f420f34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:16:28.270964 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b96ee2-5fdc-4d5c-b82d-c32c7f420f34 None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:16:28.271241 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b96ee2-5fdc-4d5c-b82d-c32c7f420f34 None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:16:28.271511 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b96ee2-5fdc-4d5c-b82d-c32c7f420f34 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:16:28.283588 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b96ee2-5fdc-4d5c-b82d-c32c7f420f34 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 02:16:28.288825 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application [None req-97b96ee2-5fdc-4d5c-b82d-c32c7f420f34 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 12 02:16:28.288825 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 02:16:28.288825 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 02:16:28.288825 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 02:16:28.288825 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 02:16:28.288825 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 02:16:28.288825 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 02:16:28.288825 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 02:16:28.288825 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 02:16:28.288825 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 02:16:28.288825 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 02:16:28.288825 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 02:16:28.288825 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 12 02:16:28.288825 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 12 02:16:28.288825 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 12 02:16:28.288825 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 12 02:16:28.289717 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 12 02:16:28.289717 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 12 02:16:28.289717 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 12 02:16:28.289717 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 12 02:16:28.289717 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 02:16:28.289717 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 02:16:28.289717 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 02:16:28.289717 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 02:16:28.289717 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 02:16:28.289717 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 02:16:28.289717 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 02:16:28.289717 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application with Lock( Oct 12 02:16:28.289717 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 02:16:28.289717 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._enter() Oct 12 02:16:28.289717 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 02:16:28.289717 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 02:16:28.291296 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 02:16:28.291296 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.creator() Oct 12 02:16:28.291296 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 02:16:28.291296 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application created_value = creator( Oct 12 02:16:28.291296 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 12 02:16:28.291296 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 12 02:16:28.291296 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 12 02:16:28.291296 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 12 02:16:28.291296 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 12 02:16:28.291296 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 12 02:16:28.291296 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 12 02:16:28.291296 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Oct 12 02:16:28.291296 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 52/100] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Oct 12 02:16:28 2022] GET /identity/v3/roles/member => generated 84 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 02:16:28.291926 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b96ee2-5fdc-4d5c-b82d-c32c7f420f34 None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:16:28.299681 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39983b9-38ab-4d28-9058-4c86cc07e2cf None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:16:28.333268 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdac258-b301-4c50-b846-1345f307c044 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:16:28.333860 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdac258-b301-4c50-b846-1345f307c044 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:16:28.334140 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdac258-b301-4c50-b846-1345f307c044 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:16:28.334413 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdac258-b301-4c50-b846-1345f307c044 None admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:16:28.335128 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bdac258-b301-4c50-b846-1345f307c044 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 02:16:28.335435 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bdac258-b301-4c50-b846-1345f307c044 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:16:28.337353 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bdac258-b301-4c50-b846-1345f307c044 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:16:28.350461 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 49/101] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Oct 12 02:16:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 02:16:28.350461 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdac258-b301-4c50-b846-1345f307c044 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:16:28.399000 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b96ee2-5fdc-4d5c-b82d-c32c7f420f34 None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:16:28.433793 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc0778a-63be-4acc-a57e-aaf5d529d0a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:16:28.434426 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc0778a-63be-4acc-a57e-aaf5d529d0a9 None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:16:28.434707 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc0778a-63be-4acc-a57e-aaf5d529d0a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:16:28.434988 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc0778a-63be-4acc-a57e-aaf5d529d0a9 None admin] PATH_INFO: `/v3/users/0b038ba692d94cff9a2a3042ea6f6922` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:16:28.436126 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc0778a-63be-4acc-a57e-aaf5d529d0a9 None admin] RBAC: Authorizing `identity:get_user(user_id=0b038ba692d94cff9a2a3042ea6f6922)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:16:28.437621 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc0778a-63be-4acc-a57e-aaf5d529d0a9 None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:16:28.439205 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 53/102] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Oct 12 02:16:28 2022] GET /identity/v3/users/0b038ba692d94cff9a2a3042ea6f6922 => generated 275 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 02:16:28.440309 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e92f74-d071-4a24-9372-1ee711945ccb None None] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:16:28.440615 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e92f74-d071-4a24-9372-1ee711945ccb None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:16:28.440891 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e92f74-d071-4a24-9372-1ee711945ccb None None] PATH_INFO: `/` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:16:28.444581 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 54/103] 10.222.0.18 () {54 vars in 927 bytes} [Wed Oct 12 02:16:28 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 02:16:28.444581 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e92f74-d071-4a24-9372-1ee711945ccb None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:16:28.462395 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdac258-b301-4c50-b846-1345f307c044 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:16:28.476079 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:16:28.479821 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:16:28.497038 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf1ad1b-a067-4c32-915c-7a568e057eff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:16:28.497661 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf1ad1b-a067-4c32-915c-7a568e057eff None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:16:28.497945 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf1ad1b-a067-4c32-915c-7a568e057eff None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:16:28.498212 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf1ad1b-a067-4c32-915c-7a568e057eff None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:16:28.508378 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf1ad1b-a067-4c32-915c-7a568e057eff None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 02:16:28.513663 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-6bf1ad1b-a067-4c32-915c-7a568e057eff None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 12 02:16:28.513663 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 02:16:28.513663 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 02:16:28.513663 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 02:16:28.513663 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 02:16:28.513663 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 02:16:28.513663 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 02:16:28.513663 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 02:16:28.513663 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 02:16:28.513663 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 02:16:28.513663 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 02:16:28.513663 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 02:16:28.513663 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 12 02:16:28.513663 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 12 02:16:28.513663 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 12 02:16:28.513663 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 12 02:16:28.514553 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 12 02:16:28.514553 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 12 02:16:28.514553 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 12 02:16:28.514553 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 12 02:16:28.514553 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 02:16:28.514553 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 02:16:28.514553 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 02:16:28.514553 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 02:16:28.514553 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 02:16:28.514553 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 02:16:28.514553 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 02:16:28.514553 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Oct 12 02:16:28.514553 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 02:16:28.514553 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Oct 12 02:16:28.514553 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 02:16:28.514553 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 02:16:28.515311 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 02:16:28.515311 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Oct 12 02:16:28.515311 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 02:16:28.515311 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Oct 12 02:16:28.515311 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 12 02:16:28.515311 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 12 02:16:28.515311 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 12 02:16:28.515311 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 12 02:16:28.515311 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 12 02:16:28.515311 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 12 02:16:28.515311 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 12 02:16:28.515311 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Oct 12 02:16:28.515311 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 50/104] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Oct 12 02:16:28 2022] GET /identity/v3/roles/reader => generated 84 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 02:16:28.515952 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf1ad1b-a067-4c32-915c-7a568e057eff None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:16:28.553631 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e92f74-d071-4a24-9372-1ee711945ccb None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:16:28.586766 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd8e074-3e67-4394-ae8c-2297fbb594ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:16:28.587332 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd8e074-3e67-4394-ae8c-2297fbb594ce None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:16:28.587549 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd8e074-3e67-4394-ae8c-2297fbb594ce None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:16:28.587823 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd8e074-3e67-4394-ae8c-2297fbb594ce None admin] PATH_INFO: `/v3/roles` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:16:28.588529 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd8e074-3e67-4394-ae8c-2297fbb594ce None admin] RBAC: Adding query filter params (name=member) {{(pid=81361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 02:16:28.588859 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd8e074-3e67-4394-ae8c-2297fbb594ce None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:16:28.590246 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd8e074-3e67-4394-ae8c-2297fbb594ce None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:16:28.598201 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 55/105] 10.222.0.18 () {56 vars in 1101 bytes} [Wed Oct 12 02:16:28 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 02:16:28.599543 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd8e074-3e67-4394-ae8c-2297fbb594ce None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:16:28.616895 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf1ad1b-a067-4c32-915c-7a568e057eff None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:16:28.651902 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ce05e3-dd29-4d8b-b2f2-f5fc224f5491 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:16:28.652556 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ce05e3-dd29-4d8b-b2f2-f5fc224f5491 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:16:28.652840 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ce05e3-dd29-4d8b-b2f2-f5fc224f5491 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:16:28.653119 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ce05e3-dd29-4d8b-b2f2-f5fc224f5491 None admin] PATH_INFO: `/v3/users/a326a5bb7364479382f528a592371656` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:16:28.654246 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ce05e3-dd29-4d8b-b2f2-f5fc224f5491 None admin] RBAC: Authorizing `identity:get_user(user_id=a326a5bb7364479382f528a592371656)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:16:28.655706 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ce05e3-dd29-4d8b-b2f2-f5fc224f5491 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:16:28.657327 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 51/106] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Oct 12 02:16:28 2022] GET /identity/v3/users/a326a5bb7364479382f528a592371656 => generated 247 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 02:16:28.661769 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afde820-e2ee-4756-8c2f-c1803111b169 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:16:28.662213 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afde820-e2ee-4756-8c2f-c1803111b169 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:16:28.662487 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afde820-e2ee-4756-8c2f-c1803111b169 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:16:28.679973 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-8afde820-e2ee-4756-8c2f-c1803111b169 None None] MFA Rules not processed for user `a326a5bb7364479382f528a592371656`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:16:28.681440 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-8afde820-e2ee-4756-8c2f-c1803111b169 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:16:28.693471 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:16:28.700137 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd8e074-3e67-4394-ae8c-2297fbb594ce None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:16:28.717008 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:16:28.732963 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf16733-24a5-4409-a833-22b0b3a8f1d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:16:28.733567 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf16733-24a5-4409-a833-22b0b3a8f1d3 None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:16:28.733844 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf16733-24a5-4409-a833-22b0b3a8f1d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:16:28.734114 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf16733-24a5-4409-a833-22b0b3a8f1d3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:16:28.748661 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 52/107] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Oct 12 02:16:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 12 02:16:28.754010 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afde820-e2ee-4756-8c2f-c1803111b169 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:16:28.803463 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf16733-24a5-4409-a833-22b0b3a8f1d3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:16:28.804970 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf16733-24a5-4409-a833-22b0b3a8f1d3 None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:16:28.858804 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afde820-e2ee-4756-8c2f-c1803111b169 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:16:28.894780 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b58b8b-fbc1-4a28-91a7-0ca4ad3608ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:16:28.895436 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b58b8b-fbc1-4a28-91a7-0ca4ad3608ac None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:16:28.895719 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b58b8b-fbc1-4a28-91a7-0ca4ad3608ac None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:16:28.895996 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b58b8b-fbc1-4a28-91a7-0ca4ad3608ac None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:16:28.901906 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:16:28.907102 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b58b8b-fbc1-4a28-91a7-0ca4ad3608ac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 02:16:28.914483 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 56/108] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Oct 12 02:16:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 12 02:16:28.914483 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf16733-24a5-4409-a833-22b0b3a8f1d3 None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:16:28.914750 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-78b58b8b-fbc1-4a28-91a7-0ca4ad3608ac None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 12 02:16:28.914750 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 02:16:28.914750 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 02:16:28.914750 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 02:16:28.914750 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 02:16:28.914750 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 02:16:28.914750 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 02:16:28.914750 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 02:16:28.914750 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 02:16:28.914750 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 02:16:28.914750 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 02:16:28.914750 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 02:16:28.914750 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 12 02:16:28.914750 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 12 02:16:28.914750 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 12 02:16:28.914750 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 12 02:16:28.916499 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 12 02:16:28.916499 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 12 02:16:28.916499 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 12 02:16:28.916499 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 12 02:16:28.916499 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 02:16:28.916499 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 02:16:28.916499 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 02:16:28.916499 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 02:16:28.916499 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 02:16:28.916499 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 02:16:28.916499 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 02:16:28.916499 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Oct 12 02:16:28.916499 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 02:16:28.916499 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Oct 12 02:16:28.916499 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 02:16:28.916499 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 02:16:28.917287 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 02:16:28.917287 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Oct 12 02:16:28.917287 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 02:16:28.917287 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Oct 12 02:16:28.917287 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 12 02:16:28.917287 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 12 02:16:28.917287 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 12 02:16:28.917287 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 12 02:16:28.917287 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 12 02:16:28.917287 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 12 02:16:28.917287 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 12 02:16:28.917287 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Oct 12 02:16:28.917287 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 53/109] 10.222.0.18 () {56 vars in 1114 bytes} [Wed Oct 12 02:16:28 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 02:16:28.917287 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b58b8b-fbc1-4a28-91a7-0ca4ad3608ac None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:16:28.948429 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:16:29.022504 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf16733-24a5-4409-a833-22b0b3a8f1d3 None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:16:29.023014 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b58b8b-fbc1-4a28-91a7-0ca4ad3608ac None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:16:29.056645 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1dcf29-cdf3-46c8-85be-5efdd9793e56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:16:29.057254 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1dcf29-cdf3-46c8-85be-5efdd9793e56 None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:16:29.057539 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1dcf29-cdf3-46c8-85be-5efdd9793e56 None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:16:29.057774 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98403e84-88ef-440b-b9f4-b0ab6a62f646 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:16:29.057894 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1dcf29-cdf3-46c8-85be-5efdd9793e56 None admin] PATH_INFO: `/v3/roles` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:16:29.058404 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98403e84-88ef-440b-b9f4-b0ab6a62f646 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:16:29.058495 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1dcf29-cdf3-46c8-85be-5efdd9793e56 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 02:16:29.058686 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98403e84-88ef-440b-b9f4-b0ab6a62f646 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:16:29.058769 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1dcf29-cdf3-46c8-85be-5efdd9793e56 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:16:29.058965 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98403e84-88ef-440b-b9f4-b0ab6a62f646 None admin] PATH_INFO: `/v3/users/0b038ba692d94cff9a2a3042ea6f6922` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:16:29.060090 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98403e84-88ef-440b-b9f4-b0ab6a62f646 None admin] RBAC: Authorizing `identity:get_user(user_id=0b038ba692d94cff9a2a3042ea6f6922)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:16:29.060173 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1dcf29-cdf3-46c8-85be-5efdd9793e56 None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:16:29.061655 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98403e84-88ef-440b-b9f4-b0ab6a62f646 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:16:29.063238 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 54/110] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Oct 12 02:16:28 2022] GET /identity/v3/users/0b038ba692d94cff9a2a3042ea6f6922 => generated 275 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 02:16:29.063999 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98403e84-88ef-440b-b9f4-b0ab6a62f646 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:16:29.068285 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 57/111] 10.222.0.18 () {56 vars in 1101 bytes} [Wed Oct 12 02:16:28 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 02:16:29.073498 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1dcf29-cdf3-46c8-85be-5efdd9793e56 None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:16:29.128894 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:16:29.165497 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:16:29.169290 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98403e84-88ef-440b-b9f4-b0ab6a62f646 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:16:29.174141 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1dcf29-cdf3-46c8-85be-5efdd9793e56 None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:16:29.212887 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325571f2-3954-4a79-878d-cbf4eb7d2714 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:16:29.213515 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325571f2-3954-4a79-878d-cbf4eb7d2714 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:16:29.213801 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325571f2-3954-4a79-878d-cbf4eb7d2714 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:16:29.214039 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b51c90-5df2-4b9f-a614-c0e99952697b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:16:29.214171 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325571f2-3954-4a79-878d-cbf4eb7d2714 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:16:29.215001 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b51c90-5df2-4b9f-a614-c0e99952697b None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:16:29.215420 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b51c90-5df2-4b9f-a614-c0e99952697b None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:16:29.215829 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b51c90-5df2-4b9f-a614-c0e99952697b None admin] PATH_INFO: `/v3/projects/fd1c4db151454810bdf01c589c22b7b7` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:16:29.217163 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b51c90-5df2-4b9f-a614-c0e99952697b None admin] RBAC: Authorizing `identity:get_project(project_id=fd1c4db151454810bdf01c589c22b7b7)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:16:29.218704 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b51c90-5df2-4b9f-a614-c0e99952697b None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:16:29.220530 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 58/112] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Oct 12 02:16:29 2022] GET /identity/v3/projects/fd1c4db151454810bdf01c589c22b7b7 => generated 298 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 02:16:29.221181 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b51c90-5df2-4b9f-a614-c0e99952697b None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:16:29.297568 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325571f2-3954-4a79-878d-cbf4eb7d2714 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:16:29.300004 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325571f2-3954-4a79-878d-cbf4eb7d2714 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:16:29.342844 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b51c90-5df2-4b9f-a614-c0e99952697b None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:16:29.369422 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:16:29.378454 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb4ef26-b538-4bbf-bcfa-84253c778a6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:16:29.379475 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb4ef26-b538-4bbf-bcfa-84253c778a6a None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:16:29.380041 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb4ef26-b538-4bbf-bcfa-84253c778a6a None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:16:29.380322 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb4ef26-b538-4bbf-bcfa-84253c778a6a None admin] PATH_INFO: `/v3/roles` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:16:29.381055 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb4ef26-b538-4bbf-bcfa-84253c778a6a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 02:16:29.381366 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb4ef26-b538-4bbf-bcfa-84253c778a6a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:16:29.382873 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb4ef26-b538-4bbf-bcfa-84253c778a6a None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:16:29.396536 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 59/113] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Oct 12 02:16:29 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 02:16:29.396536 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb4ef26-b538-4bbf-bcfa-84253c778a6a None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:16:29.407859 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:16:29.412517 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 55/114] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Oct 12 02:16:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 12 02:16:29.413236 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325571f2-3954-4a79-878d-cbf4eb7d2714 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:16:29.501295 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb4ef26-b538-4bbf-bcfa-84253c778a6a None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:16:29.520138 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325571f2-3954-4a79-878d-cbf4eb7d2714 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:16:29.536577 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fe09c4-2bcc-4cca-99cb-cceadb0d603f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:16:29.537216 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fe09c4-2bcc-4cca-99cb-cceadb0d603f None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:16:29.537492 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fe09c4-2bcc-4cca-99cb-cceadb0d603f None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:16:29.537766 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fe09c4-2bcc-4cca-99cb-cceadb0d603f None admin] PATH_INFO: `/v3/domains/default` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:16:29.539113 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05fe09c4-2bcc-4cca-99cb-cceadb0d603f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:16:29.540914 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05fe09c4-2bcc-4cca-99cb-cceadb0d603f None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:16:29.542418 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 60/115] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Oct 12 02:16:29 2022] GET /identity/v3/domains/default => generated 199 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 02:16:29.543173 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fe09c4-2bcc-4cca-99cb-cceadb0d603f None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:16:29.562069 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedb7364-8fec-43c6-9dd1-c817bc7d2ba4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:16:29.562686 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedb7364-8fec-43c6-9dd1-c817bc7d2ba4 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:16:29.562971 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedb7364-8fec-43c6-9dd1-c817bc7d2ba4 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:16:29.563250 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedb7364-8fec-43c6-9dd1-c817bc7d2ba4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:16:29.598469 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:16:29.628520 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:16:29.630909 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fedb7364-8fec-43c6-9dd1-c817bc7d2ba4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:16:29.632719 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fedb7364-8fec-43c6-9dd1-c817bc7d2ba4 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:16:29.643766 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fe09c4-2bcc-4cca-99cb-cceadb0d603f None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:16:29.677345 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf48650-8d13-4d6c-83ce-57646ba1ecfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:16:29.677978 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf48650-8d13-4d6c-83ce-57646ba1ecfa None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:16:29.678258 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf48650-8d13-4d6c-83ce-57646ba1ecfa None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:16:29.678534 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf48650-8d13-4d6c-83ce-57646ba1ecfa None admin] PATH_INFO: `/v3/users/456c77d2cb8d46f6b0b1226da090d902` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:16:29.692243 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf48650-8d13-4d6c-83ce-57646ba1ecfa None admin] RBAC: Authorizing `identity:get_user(user_id=456c77d2cb8d46f6b0b1226da090d902)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:16:29.693748 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf48650-8d13-4d6c-83ce-57646ba1ecfa None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:16:29.695360 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 61/116] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Oct 12 02:16:29 2022] GET /identity/v3/users/456c77d2cb8d46f6b0b1226da090d902 => generated 289 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 02:16:29.697334 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf48650-8d13-4d6c-83ce-57646ba1ecfa None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:16:29.735043 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 56/117] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Oct 12 02:16:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 12 02:16:29.737412 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedb7364-8fec-43c6-9dd1-c817bc7d2ba4 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:16:29.798410 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf48650-8d13-4d6c-83ce-57646ba1ecfa None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:16:29.812044 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:16:29.830803 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:16:29.832091 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b292105c-74c5-4c9e-a546-9170ed6b275e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:16:29.832741 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b292105c-74c5-4c9e-a546-9170ed6b275e None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:16:29.833019 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b292105c-74c5-4c9e-a546-9170ed6b275e None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:16:29.833303 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b292105c-74c5-4c9e-a546-9170ed6b275e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:16:29.833952 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedb7364-8fec-43c6-9dd1-c817bc7d2ba4 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:16:29.834067 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b292105c-74c5-4c9e-a546-9170ed6b275e None admin] RBAC: Adding query filter params (role.id=3d75c4d7f1a849b9a771504d1583ab28, scope.project.id=fd1c4db151454810bdf01c589c22b7b7, user.id=0b038ba692d94cff9a2a3042ea6f6922) {{(pid=81361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 02:16:29.834324 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b292105c-74c5-4c9e-a546-9170ed6b275e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:16:29.835779 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b292105c-74c5-4c9e-a546-9170ed6b275e None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:16:29.843211 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 62/118] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Oct 12 02:16:29 2022] GET /identity/v3/role_assignments?user.id=0b038ba692d94cff9a2a3042ea6f6922&scope.project.id=fd1c4db151454810bdf01c589c22b7b7&role.id=3d75c4d7f1a849b9a771504d1583ab28 => generated 608 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 02:16:29.843993 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b292105c-74c5-4c9e-a546-9170ed6b275e None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:16:29.889477 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320b34e2-cd34-45e8-a310-0d936ed27c8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:16:29.890260 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320b34e2-cd34-45e8-a310-0d936ed27c8f None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:16:29.890612 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320b34e2-cd34-45e8-a310-0d936ed27c8f None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:16:29.890895 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320b34e2-cd34-45e8-a310-0d936ed27c8f None admin] PATH_INFO: `/v3/users/0b038ba692d94cff9a2a3042ea6f6922` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:16:29.892080 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320b34e2-cd34-45e8-a310-0d936ed27c8f None admin] RBAC: Authorizing `identity:get_user(user_id=0b038ba692d94cff9a2a3042ea6f6922)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:16:29.893599 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320b34e2-cd34-45e8-a310-0d936ed27c8f None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:16:29.895273 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 57/119] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Oct 12 02:16:29 2022] GET /identity/v3/users/0b038ba692d94cff9a2a3042ea6f6922 => generated 275 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 02:16:29.896074 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320b34e2-cd34-45e8-a310-0d936ed27c8f None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:16:29.956612 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b292105c-74c5-4c9e-a546-9170ed6b275e None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:16:29.995342 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836d06cc-e6eb-4ec4-9d44-940cd724db74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:16:29.996006 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836d06cc-e6eb-4ec4-9d44-940cd724db74 None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:16:29.996290 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836d06cc-e6eb-4ec4-9d44-940cd724db74 None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:16:29.996605 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836d06cc-e6eb-4ec4-9d44-940cd724db74 None admin] PATH_INFO: `/v3/projects/fd1c4db151454810bdf01c589c22b7b7` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:16:29.998329 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836d06cc-e6eb-4ec4-9d44-940cd724db74 None admin] RBAC: Authorizing `identity:get_project(project_id=fd1c4db151454810bdf01c589c22b7b7)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:16:30.000016 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836d06cc-e6eb-4ec4-9d44-940cd724db74 None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:16:30.002023 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 63/120] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Oct 12 02:16:29 2022] GET /identity/v3/projects/fd1c4db151454810bdf01c589c22b7b7 => generated 298 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 02:16:30.002630 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836d06cc-e6eb-4ec4-9d44-940cd724db74 None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:16:30.018456 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320b34e2-cd34-45e8-a310-0d936ed27c8f None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:16:30.059390 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616139a4-c373-442b-acca-98c59e1e3e90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:16:30.060006 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616139a4-c373-442b-acca-98c59e1e3e90 None admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:16:30.060290 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616139a4-c373-442b-acca-98c59e1e3e90 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:16:30.060608 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616139a4-c373-442b-acca-98c59e1e3e90 None admin] PATH_INFO: `/v3/projects` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:16:30.061266 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616139a4-c373-442b-acca-98c59e1e3e90 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:16:30.062174 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:16:30.062702 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616139a4-c373-442b-acca-98c59e1e3e90 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:16:30.090808 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 58/121] 10.222.0.18 () {60 vars in 1141 bytes} [Wed Oct 12 02:16:29 2022] POST /identity/v3/projects => generated 302 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 02:16:30.091650 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616139a4-c373-442b-acca-98c59e1e3e90 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:16:30.119469 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:16:30.125142 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836d06cc-e6eb-4ec4-9d44-940cd724db74 None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:16:30.162943 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da689756-fc5b-46c2-b1bb-81de0e665cb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:16:30.163475 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da689756-fc5b-46c2-b1bb-81de0e665cb0 None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:16:30.163754 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da689756-fc5b-46c2-b1bb-81de0e665cb0 None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:16:30.164027 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da689756-fc5b-46c2-b1bb-81de0e665cb0 None admin] PATH_INFO: `/v3/projects/fd1c4db151454810bdf01c589c22b7b7` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:16:30.166124 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da689756-fc5b-46c2-b1bb-81de0e665cb0 None admin] RBAC: Authorizing `identity:get_project(project_id=fd1c4db151454810bdf01c589c22b7b7)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:16:30.167607 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da689756-fc5b-46c2-b1bb-81de0e665cb0 None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:16:30.169384 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 64/122] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Oct 12 02:16:30 2022] GET /identity/v3/projects/fd1c4db151454810bdf01c589c22b7b7 => generated 298 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 02:16:30.170183 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da689756-fc5b-46c2-b1bb-81de0e665cb0 None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:16:30.226383 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616139a4-c373-442b-acca-98c59e1e3e90 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:16:30.265156 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a10ddbc-3014-426b-8d1c-a58e93398133 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:16:30.265720 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a10ddbc-3014-426b-8d1c-a58e93398133 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:16:30.265989 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a10ddbc-3014-426b-8d1c-a58e93398133 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:16:30.266987 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a10ddbc-3014-426b-8d1c-a58e93398133 None admin] PATH_INFO: `/v3/projects/153409c77ed94fda8f9531fc436389b1` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:16:30.267896 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a10ddbc-3014-426b-8d1c-a58e93398133 None admin] RBAC: Authorizing `identity:get_project(project_id=153409c77ed94fda8f9531fc436389b1)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:16:30.269385 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a10ddbc-3014-426b-8d1c-a58e93398133 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:16:30.271628 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 59/123] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Oct 12 02:16:30 2022] GET /identity/v3/projects/153409c77ed94fda8f9531fc436389b1 => generated 312 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 02:16:30.271777 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a10ddbc-3014-426b-8d1c-a58e93398133 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:16:30.291498 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da689756-fc5b-46c2-b1bb-81de0e665cb0 None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:16:30.308140 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:16:30.332087 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3464c29-7da9-4327-bcc8-5199aa2c716c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:16:30.333092 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3464c29-7da9-4327-bcc8-5199aa2c716c None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:16:30.333375 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3464c29-7da9-4327-bcc8-5199aa2c716c None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:16:30.333649 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3464c29-7da9-4327-bcc8-5199aa2c716c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:16:30.373415 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:16:30.386765 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a10ddbc-3014-426b-8d1c-a58e93398133 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:16:30.408874 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3464c29-7da9-4327-bcc8-5199aa2c716c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:16:30.410360 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3464c29-7da9-4327-bcc8-5199aa2c716c None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:16:30.422839 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c98401-9e08-4aa8-81bb-c01c365953c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:16:30.423943 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c98401-9e08-4aa8-81bb-c01c365953c7 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:16:30.424235 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c98401-9e08-4aa8-81bb-c01c365953c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:16:30.424555 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c98401-9e08-4aa8-81bb-c01c365953c7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:16:30.425309 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c98401-9e08-4aa8-81bb-c01c365953c7 None admin] RBAC: Adding query filter params (role.id=39b1e8108dff402383def3c559f48189, scope.project.id=fd1c4db151454810bdf01c589c22b7b7, user.id=a326a5bb7364479382f528a592371656) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 02:16:30.425623 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c98401-9e08-4aa8-81bb-c01c365953c7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:16:30.427114 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c98401-9e08-4aa8-81bb-c01c365953c7 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:16:30.433771 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 60/124] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Oct 12 02:16:30 2022] GET /identity/v3/role_assignments?user.id=a326a5bb7364479382f528a592371656&scope.project.id=fd1c4db151454810bdf01c589c22b7b7&role.id=39b1e8108dff402383def3c559f48189 => generated 608 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 02:16:30.434390 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c98401-9e08-4aa8-81bb-c01c365953c7 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:16:30.549784 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 65/125] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Oct 12 02:16:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 12 02:16:30.550774 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3464c29-7da9-4327-bcc8-5199aa2c716c None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:16:30.568636 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:16:30.601721 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c98401-9e08-4aa8-81bb-c01c365953c7 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:16:30.645241 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821c0bb6-97e1-47e4-9e8d-b95d5306ff88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:16:30.645925 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821c0bb6-97e1-47e4-9e8d-b95d5306ff88 None admin] REQUEST_METHOD: `PUT` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:16:30.646207 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821c0bb6-97e1-47e4-9e8d-b95d5306ff88 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:16:30.646484 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821c0bb6-97e1-47e4-9e8d-b95d5306ff88 None admin] PATH_INFO: `/v3/projects/fd1c4db151454810bdf01c589c22b7b7/users/456c77d2cb8d46f6b0b1226da090d902/roles/3b01dfb837044fd5b3f01dbf63d8edd1` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:16:30.650544 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821c0bb6-97e1-47e4-9e8d-b95d5306ff88 None admin] RBAC: Authorizing `identity:create_grant(project_id=fd1c4db151454810bdf01c589c22b7b7, user_id=456c77d2cb8d46f6b0b1226da090d902, role_id=3b01dfb837044fd5b3f01dbf63d8edd1)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:16:30.652012 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821c0bb6-97e1-47e4-9e8d-b95d5306ff88 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:16:30.670574 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 61/126] 10.222.0.18 () {58 vars in 1439 bytes} [Wed Oct 12 02:16:30 2022] PUT /identity/v3/projects/fd1c4db151454810bdf01c589c22b7b7/users/456c77d2cb8d46f6b0b1226da090d902/roles/3b01dfb837044fd5b3f01dbf63d8edd1 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 02:16:30.671348 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821c0bb6-97e1-47e4-9e8d-b95d5306ff88 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:16:30.694609 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:16:30.704389 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3464c29-7da9-4327-bcc8-5199aa2c716c None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:16:30.749592 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473c40d7-9803-414d-b6a1-f122b5d4c853 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:16:30.750640 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473c40d7-9803-414d-b6a1-f122b5d4c853 None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:16:30.751146 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473c40d7-9803-414d-b6a1-f122b5d4c853 None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:16:30.751618 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473c40d7-9803-414d-b6a1-f122b5d4c853 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:16:30.752636 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473c40d7-9803-414d-b6a1-f122b5d4c853 None admin] RBAC: Adding query filter params (role.id=3d75c4d7f1a849b9a771504d1583ab28, scope.project.id=153409c77ed94fda8f9531fc436389b1, user.id=0b038ba692d94cff9a2a3042ea6f6922) {{(pid=81361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 02:16:30.753149 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473c40d7-9803-414d-b6a1-f122b5d4c853 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:16:30.754943 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473c40d7-9803-414d-b6a1-f122b5d4c853 None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:16:30.765005 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 66/127] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Oct 12 02:16:30 2022] GET /identity/v3/role_assignments?user.id=0b038ba692d94cff9a2a3042ea6f6922&scope.project.id=153409c77ed94fda8f9531fc436389b1&role.id=3d75c4d7f1a849b9a771504d1583ab28 => generated 608 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 02:16:30.806901 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821c0bb6-97e1-47e4-9e8d-b95d5306ff88 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:16:30.850594 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a25c36c-1173-4803-bc08-101c849e8609 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:16:30.851274 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a25c36c-1173-4803-bc08-101c849e8609 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:16:30.851568 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a25c36c-1173-4803-bc08-101c849e8609 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:16:30.851847 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a25c36c-1173-4803-bc08-101c849e8609 None admin] PATH_INFO: `/v3/projects/fd1c4db151454810bdf01c589c22b7b7` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:16:30.855699 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a25c36c-1173-4803-bc08-101c849e8609 None admin] RBAC: Authorizing `identity:get_project(project_id=fd1c4db151454810bdf01c589c22b7b7)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:16:30.855699 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a25c36c-1173-4803-bc08-101c849e8609 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:16:30.857825 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 62/128] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Oct 12 02:16:30 2022] GET /identity/v3/projects/fd1c4db151454810bdf01c589c22b7b7 => generated 298 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 02:16:30.863595 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473c40d7-9803-414d-b6a1-f122b5d4c853 None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:16:30.959866 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:16:30.984431 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473c40d7-9803-414d-b6a1-f122b5d4c853 None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:16:31.023367 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0943d0-7aee-4530-b009-d30c92bf32a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:16:31.024043 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0943d0-7aee-4530-b009-d30c92bf32a3 None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:16:31.024904 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0943d0-7aee-4530-b009-d30c92bf32a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:16:31.025182 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0943d0-7aee-4530-b009-d30c92bf32a3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:16:31.025915 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0943d0-7aee-4530-b009-d30c92bf32a3 None admin] RBAC: Adding query filter params (role.id=7b67553aa5874cca8c47e5fb5ffa1971, scope.project.id=fd1c4db151454810bdf01c589c22b7b7, user.id=0b038ba692d94cff9a2a3042ea6f6922) {{(pid=81361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 02:16:31.026222 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0943d0-7aee-4530-b009-d30c92bf32a3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:16:31.027668 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0943d0-7aee-4530-b009-d30c92bf32a3 None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:16:31.034083 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 67/129] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Oct 12 02:16:30 2022] GET /identity/v3/role_assignments?user.id=0b038ba692d94cff9a2a3042ea6f6922&scope.project.id=fd1c4db151454810bdf01c589c22b7b7&role.id=7b67553aa5874cca8c47e5fb5ffa1971 => generated 608 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 02:16:32.337117 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a89ff54-b463-4e06-9a29-7ea648d9673e None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:16:32.337642 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a89ff54-b463-4e06-9a29-7ea648d9673e None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:16:32.337642 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a89ff54-b463-4e06-9a29-7ea648d9673e None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:16:32.339006 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 63/130] 10.222.0.18 () {54 vars in 927 bytes} [Wed Oct 12 02:16:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 02:16:32.344108 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ac56a4-9d11-4553-827c-f6eff424d9a9 None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:16:32.344535 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ac56a4-9d11-4553-827c-f6eff424d9a9 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:16:32.344702 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ac56a4-9d11-4553-827c-f6eff424d9a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:16:32.363075 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-51ac56a4-9d11-4553-827c-f6eff424d9a9 None None] MFA Rules not processed for user `a326a5bb7364479382f528a592371656`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:16:32.364278 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-51ac56a4-9d11-4553-827c-f6eff424d9a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:16:32.428863 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 68/131] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Oct 12 02:16:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 12 02:16:32.699754 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a89ff54-b463-4e06-9a29-7ea648d9673e None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:16:32.783460 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:16:32.805591 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a89ff54-b463-4e06-9a29-7ea648d9673e None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:16:32.838885 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2533fe50-6f71-4b3c-b70d-90c3d4810395 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:16:32.839512 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2533fe50-6f71-4b3c-b70d-90c3d4810395 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:16:32.839791 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2533fe50-6f71-4b3c-b70d-90c3d4810395 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:16:32.840060 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2533fe50-6f71-4b3c-b70d-90c3d4810395 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:16:32.841179 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2533fe50-6f71-4b3c-b70d-90c3d4810395 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:16:32.842610 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2533fe50-6f71-4b3c-b70d-90c3d4810395 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:16:32.844172 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 64/132] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Oct 12 02:16:32 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 02:16:32.849586 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ac56a4-9d11-4553-827c-f6eff424d9a9 None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:16:32.887329 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bcf11c-1b6b-44e1-9e7a-919157e01c3d None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:16:32.887619 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bcf11c-1b6b-44e1-9e7a-919157e01c3d None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:16:32.887903 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bcf11c-1b6b-44e1-9e7a-919157e01c3d None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:16:32.889276 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 65/133] 10.222.0.18 () {54 vars in 927 bytes} [Wed Oct 12 02:16:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 02:16:32.894303 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18c8984-9eca-4bd8-aa7a-8264cb0f52c8 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:16:32.894587 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18c8984-9eca-4bd8-aa7a-8264cb0f52c8 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:16:32.894868 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18c8984-9eca-4bd8-aa7a-8264cb0f52c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:16:32.912444 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-b18c8984-9eca-4bd8-aa7a-8264cb0f52c8 None None] MFA Rules not processed for user `a326a5bb7364479382f528a592371656`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:16:32.913684 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-b18c8984-9eca-4bd8-aa7a-8264cb0f52c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:16:32.919051 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:16:32.949464 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ac56a4-9d11-4553-827c-f6eff424d9a9 None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:16:32.981234 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 66/134] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Oct 12 02:16:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 12 02:16:32.981664 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d32ffa-758d-40ce-a128-358340a8da62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:16:32.982271 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d32ffa-758d-40ce-a128-358340a8da62 None admin] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:16:32.982550 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d32ffa-758d-40ce-a128-358340a8da62 None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:16:32.982820 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d32ffa-758d-40ce-a128-358340a8da62 None admin] PATH_INFO: `/v3/users` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:16:32.983464 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d32ffa-758d-40ce-a128-358340a8da62 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:16:32.984937 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d32ffa-758d-40ce-a128-358340a8da62 None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:16:33.006186 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 69/135] 10.222.0.18 () {60 vars in 1132 bytes} [Wed Oct 12 02:16:32 2022] POST /identity/v3/users => generated 283 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 02:16:33.251192 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18c8984-9eca-4bd8-aa7a-8264cb0f52c8 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:16:33.332044 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:16:33.355498 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18c8984-9eca-4bd8-aa7a-8264cb0f52c8 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:16:33.391191 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18211729-6c2d-4991-a3e5-27f6b66478e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:16:33.391828 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18211729-6c2d-4991-a3e5-27f6b66478e5 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:16:33.392103 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18211729-6c2d-4991-a3e5-27f6b66478e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:16:33.392373 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18211729-6c2d-4991-a3e5-27f6b66478e5 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:16:33.403599 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18211729-6c2d-4991-a3e5-27f6b66478e5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 02:16:33.408430 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-18211729-6c2d-4991-a3e5-27f6b66478e5 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 12 02:16:33.408430 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 02:16:33.408430 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 02:16:33.408430 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 02:16:33.408430 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 02:16:33.408430 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 02:16:33.408430 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 02:16:33.408430 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 02:16:33.408430 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 02:16:33.408430 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 02:16:33.408430 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 02:16:33.408430 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 02:16:33.408430 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 12 02:16:33.408430 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 12 02:16:33.408430 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 12 02:16:33.408430 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 12 02:16:33.409316 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 12 02:16:33.409316 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 12 02:16:33.409316 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 12 02:16:33.409316 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 12 02:16:33.409316 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 02:16:33.409316 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 02:16:33.409316 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 02:16:33.409316 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 02:16:33.409316 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 02:16:33.409316 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 02:16:33.409316 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 02:16:33.409316 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Oct 12 02:16:33.409316 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 02:16:33.409316 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Oct 12 02:16:33.409316 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 02:16:33.409316 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 02:16:33.410145 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 02:16:33.410145 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Oct 12 02:16:33.410145 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 02:16:33.410145 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Oct 12 02:16:33.410145 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 12 02:16:33.410145 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 12 02:16:33.410145 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 12 02:16:33.410145 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 12 02:16:33.410145 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 12 02:16:33.410145 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 12 02:16:33.410145 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 12 02:16:33.410145 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Oct 12 02:16:33.410145 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 67/136] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Oct 12 02:16:33 2022] GET /identity/v3/roles/reader => generated 84 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 02:16:33.416759 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d32ffa-758d-40ce-a128-358340a8da62 None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:16:33.528252 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d32ffa-758d-40ce-a128-358340a8da62 None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:16:33.557675 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:16:33.565333 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bf9cc7-03ec-43a1-96be-609c9075283d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:16:33.565964 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bf9cc7-03ec-43a1-96be-609c9075283d None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:16:33.566240 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bf9cc7-03ec-43a1-96be-609c9075283d None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:16:33.566587 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bf9cc7-03ec-43a1-96be-609c9075283d None admin] PATH_INFO: `/v3/roles` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:16:33.567293 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2bf9cc7-03ec-43a1-96be-609c9075283d None admin] RBAC: Adding query filter params (name=reader) {{(pid=81361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 02:16:33.567773 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2bf9cc7-03ec-43a1-96be-609c9075283d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:16:33.573611 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2bf9cc7-03ec-43a1-96be-609c9075283d None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:16:33.582927 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 70/137] 10.222.0.18 () {56 vars in 1101 bytes} [Wed Oct 12 02:16:33 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 02:16:33.589007 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18211729-6c2d-4991-a3e5-27f6b66478e5 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:16:33.700251 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18211729-6c2d-4991-a3e5-27f6b66478e5 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:16:33.737351 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ee72ed-de42-4e4d-98e4-15de4acb3de0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:16:33.737991 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ee72ed-de42-4e4d-98e4-15de4acb3de0 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:16:33.738271 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ee72ed-de42-4e4d-98e4-15de4acb3de0 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:16:33.738545 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ee72ed-de42-4e4d-98e4-15de4acb3de0 None admin] PATH_INFO: `/v3/users/456c77d2cb8d46f6b0b1226da090d902` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:16:33.739707 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ee72ed-de42-4e4d-98e4-15de4acb3de0 None admin] RBAC: Authorizing `identity:get_user(user_id=456c77d2cb8d46f6b0b1226da090d902)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:16:33.741195 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ee72ed-de42-4e4d-98e4-15de4acb3de0 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:16:33.744000 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 68/138] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Oct 12 02:16:33 2022] GET /identity/v3/users/456c77d2cb8d46f6b0b1226da090d902 => generated 289 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 02:16:33.749368 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bf9cc7-03ec-43a1-96be-609c9075283d None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:16:33.860092 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bf9cc7-03ec-43a1-96be-609c9075283d None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:16:33.896759 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3532d2-6b42-4a5a-8f29-b77b09979dcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:16:33.897714 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3532d2-6b42-4a5a-8f29-b77b09979dcd None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:16:33.898218 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3532d2-6b42-4a5a-8f29-b77b09979dcd None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:16:33.898689 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3532d2-6b42-4a5a-8f29-b77b09979dcd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:16:33.960371 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:16:33.972329 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3532d2-6b42-4a5a-8f29-b77b09979dcd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:16:33.974197 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3532d2-6b42-4a5a-8f29-b77b09979dcd None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:16:34.084639 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 71/139] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Oct 12 02:16:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 12 02:16:34.092518 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ee72ed-de42-4e4d-98e4-15de4acb3de0 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:16:34.100097 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:16:34.205093 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ee72ed-de42-4e4d-98e4-15de4acb3de0 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:16:34.240641 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ff52dc-5586-48a6-a15c-65d4a2ae5240 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:16:34.241611 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ff52dc-5586-48a6-a15c-65d4a2ae5240 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:16:34.242112 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ff52dc-5586-48a6-a15c-65d4a2ae5240 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:16:34.243094 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ff52dc-5586-48a6-a15c-65d4a2ae5240 None admin] PATH_INFO: `/v3/projects/fd1c4db151454810bdf01c589c22b7b7` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:16:34.244435 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ff52dc-5586-48a6-a15c-65d4a2ae5240 None admin] RBAC: Authorizing `identity:get_project(project_id=fd1c4db151454810bdf01c589c22b7b7)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:16:34.246119 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ff52dc-5586-48a6-a15c-65d4a2ae5240 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:16:34.248242 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 69/140] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Oct 12 02:16:34 2022] GET /identity/v3/projects/fd1c4db151454810bdf01c589c22b7b7 => generated 298 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 02:16:34.258272 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3532d2-6b42-4a5a-8f29-b77b09979dcd None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:16:34.353580 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:16:34.363645 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3532d2-6b42-4a5a-8f29-b77b09979dcd None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:16:34.399740 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a83edb-01e9-4f4b-855d-e224e2a9bb56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:16:34.400746 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a83edb-01e9-4f4b-855d-e224e2a9bb56 None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:16:34.401245 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a83edb-01e9-4f4b-855d-e224e2a9bb56 None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:16:34.401712 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a83edb-01e9-4f4b-855d-e224e2a9bb56 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:16:34.402626 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a83edb-01e9-4f4b-855d-e224e2a9bb56 None admin] RBAC: Adding query filter params (role.id=3b01dfb837044fd5b3f01dbf63d8edd1, scope.project.id=fd1c4db151454810bdf01c589c22b7b7, user.id=456c77d2cb8d46f6b0b1226da090d902) {{(pid=81361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 02:16:34.403148 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a83edb-01e9-4f4b-855d-e224e2a9bb56 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:16:34.404877 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a83edb-01e9-4f4b-855d-e224e2a9bb56 None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:16:34.411115 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 72/141] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Oct 12 02:16:34 2022] GET /identity/v3/role_assignments?user.id=456c77d2cb8d46f6b0b1226da090d902&scope.project.id=fd1c4db151454810bdf01c589c22b7b7&role.id=3b01dfb837044fd5b3f01dbf63d8edd1 => generated 608 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 02:16:35.325938 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf419d74-0be0-4c67-93cd-774e766962ec None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:16:35.326548 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf419d74-0be0-4c67-93cd-774e766962ec None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:16:35.326548 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf419d74-0be0-4c67-93cd-774e766962ec None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:16:35.327983 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 70/142] 10.222.0.18 () {54 vars in 927 bytes} [Wed Oct 12 02:16:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 02:16:35.332862 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfea38b-0011-4dd1-a453-cb08b07c472e None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:16:35.333256 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfea38b-0011-4dd1-a453-cb08b07c472e None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:16:35.333431 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfea38b-0011-4dd1-a453-cb08b07c472e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:16:35.352563 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-6bfea38b-0011-4dd1-a453-cb08b07c472e None None] MFA Rules not processed for user `a326a5bb7364479382f528a592371656`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:16:35.353760 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-6bfea38b-0011-4dd1-a453-cb08b07c472e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:16:35.423878 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 73/143] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Oct 12 02:16:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 12 02:16:35.533562 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5956ea9a-5988-43a2-b4ef-d25cee93e1d3 None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:16:35.533937 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5956ea9a-5988-43a2-b4ef-d25cee93e1d3 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:16:35.534224 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5956ea9a-5988-43a2-b4ef-d25cee93e1d3 None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:16:35.535587 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 71/144] 10.222.0.18 () {54 vars in 927 bytes} [Wed Oct 12 02:16:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 02:16:35.541849 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1be4ba9-94b8-4f49-8d29-f9d74cd5e824 None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:16:35.542141 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1be4ba9-94b8-4f49-8d29-f9d74cd5e824 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:16:35.542416 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1be4ba9-94b8-4f49-8d29-f9d74cd5e824 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:16:35.560675 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-e1be4ba9-94b8-4f49-8d29-f9d74cd5e824 None None] MFA Rules not processed for user `a326a5bb7364479382f528a592371656`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:16:35.561863 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-e1be4ba9-94b8-4f49-8d29-f9d74cd5e824 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:16:35.579644 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afaf5bd1-4b0a-48f4-b110-ec6320935c88 None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:16:35.579855 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afaf5bd1-4b0a-48f4-b110-ec6320935c88 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:16:35.580139 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afaf5bd1-4b0a-48f4-b110-ec6320935c88 None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:16:35.581637 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 72/145] 10.222.0.18 () {54 vars in 927 bytes} [Wed Oct 12 02:16:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 12 02:16:35.586951 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e43488d-1797-4d6f-ab29-6a0631001138 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:16:35.587244 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e43488d-1797-4d6f-ab29-6a0631001138 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:16:35.587526 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e43488d-1797-4d6f-ab29-6a0631001138 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:16:35.606362 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-9e43488d-1797-4d6f-ab29-6a0631001138 None None] MFA Rules not processed for user `a326a5bb7364479382f528a592371656`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:16:35.607567 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-9e43488d-1797-4d6f-ab29-6a0631001138 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:16:35.630662 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 74/146] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Oct 12 02:16:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 12 02:16:35.679597 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 73/147] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Oct 12 02:16:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 12 02:16:35.700128 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1be4ba9-94b8-4f49-8d29-f9d74cd5e824 None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:16:35.715939 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:16:35.801257 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1be4ba9-94b8-4f49-8d29-f9d74cd5e824 None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:16:35.835445 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f65f48-0af1-4530-adb0-1415958fa877 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:16:35.836010 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f65f48-0af1-4530-adb0-1415958fa877 None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:16:35.836315 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f65f48-0af1-4530-adb0-1415958fa877 None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:16:35.836697 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f65f48-0af1-4530-adb0-1415958fa877 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:16:35.846626 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f65f48-0af1-4530-adb0-1415958fa877 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 02:16:35.851415 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application [None req-48f65f48-0af1-4530-adb0-1415958fa877 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 12 02:16:35.851415 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 02:16:35.851415 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 02:16:35.851415 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 02:16:35.851415 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 02:16:35.851415 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 02:16:35.851415 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 02:16:35.851415 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 02:16:35.851415 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 02:16:35.851415 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 02:16:35.851415 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 02:16:35.851415 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 02:16:35.851415 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 12 02:16:35.851415 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 12 02:16:35.851415 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 12 02:16:35.851415 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 12 02:16:35.852446 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 12 02:16:35.852446 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 12 02:16:35.852446 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 12 02:16:35.852446 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 12 02:16:35.852446 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 02:16:35.852446 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 02:16:35.852446 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 02:16:35.852446 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 02:16:35.852446 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 02:16:35.852446 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 02:16:35.852446 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 02:16:35.852446 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application with Lock( Oct 12 02:16:35.852446 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 02:16:35.852446 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._enter() Oct 12 02:16:35.852446 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 02:16:35.852446 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 02:16:35.853327 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 02:16:35.853327 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.creator() Oct 12 02:16:35.853327 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 02:16:35.853327 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application created_value = creator( Oct 12 02:16:35.853327 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 12 02:16:35.853327 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 12 02:16:35.853327 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 12 02:16:35.853327 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 12 02:16:35.853327 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 12 02:16:35.853327 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 12 02:16:35.853327 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 12 02:16:35.853327 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Oct 12 02:16:35.853327 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 75/148] 10.222.0.18 () {56 vars in 1096 bytes} [Wed Oct 12 02:16:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 02:16:35.860027 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e43488d-1797-4d6f-ab29-6a0631001138 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:16:35.863564 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:16:35.904182 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f65f48-0af1-4530-adb0-1415958fa877 None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:16:35.964146 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e43488d-1797-4d6f-ab29-6a0631001138 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:16:35.981618 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:16:35.998285 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66b458e-c816-4d71-a25e-c98c8f3ee787 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:16:35.998902 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66b458e-c816-4d71-a25e-c98c8f3ee787 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:16:35.999187 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66b458e-c816-4d71-a25e-c98c8f3ee787 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:16:35.999469 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66b458e-c816-4d71-a25e-c98c8f3ee787 None admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:16:36.000140 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66b458e-c816-4d71-a25e-c98c8f3ee787 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 02:16:36.000447 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66b458e-c816-4d71-a25e-c98c8f3ee787 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:16:36.001870 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66b458e-c816-4d71-a25e-c98c8f3ee787 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:16:36.009349 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f65f48-0af1-4530-adb0-1415958fa877 None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:16:36.010312 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 74/149] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Oct 12 02:16:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 02:16:36.010312 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66b458e-c816-4d71-a25e-c98c8f3ee787 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:16:36.049057 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82be8aa5-c6c1-4803-8990-26052653927a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:16:36.049693 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82be8aa5-c6c1-4803-8990-26052653927a None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:16:36.049981 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82be8aa5-c6c1-4803-8990-26052653927a None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:16:36.050253 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82be8aa5-c6c1-4803-8990-26052653927a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:16:36.061345 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82be8aa5-c6c1-4803-8990-26052653927a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 02:16:36.066660 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application [None req-82be8aa5-c6c1-4803-8990-26052653927a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 12 02:16:36.066660 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 02:16:36.066660 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 02:16:36.066660 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 02:16:36.066660 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 02:16:36.066660 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 02:16:36.066660 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 02:16:36.066660 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 02:16:36.066660 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 02:16:36.066660 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 02:16:36.066660 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 02:16:36.066660 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 02:16:36.066660 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 12 02:16:36.066660 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 12 02:16:36.066660 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 12 02:16:36.066660 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 12 02:16:36.067606 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 12 02:16:36.067606 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 12 02:16:36.067606 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 12 02:16:36.067606 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 12 02:16:36.067606 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 02:16:36.067606 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 02:16:36.067606 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 02:16:36.067606 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 02:16:36.067606 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 02:16:36.067606 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 02:16:36.067606 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 02:16:36.067606 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application with Lock( Oct 12 02:16:36.067606 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 02:16:36.067606 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._enter() Oct 12 02:16:36.067606 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 02:16:36.067606 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 02:16:36.068385 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 02:16:36.068385 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.creator() Oct 12 02:16:36.068385 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 02:16:36.068385 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application created_value = creator( Oct 12 02:16:36.068385 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 12 02:16:36.068385 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 12 02:16:36.068385 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 12 02:16:36.068385 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 12 02:16:36.068385 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 12 02:16:36.068385 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 12 02:16:36.068385 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 12 02:16:36.068385 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Oct 12 02:16:36.068385 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 76/150] 10.222.0.18 () {56 vars in 1114 bytes} [Wed Oct 12 02:16:35 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 02:16:36.069878 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82be8aa5-c6c1-4803-8990-26052653927a None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:16:36.075263 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:16:36.111105 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66b458e-c816-4d71-a25e-c98c8f3ee787 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:16:36.144488 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5e12b8-68df-4e21-bebb-b887fd74b55f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:16:36.145136 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5e12b8-68df-4e21-bebb-b887fd74b55f None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:16:36.145429 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5e12b8-68df-4e21-bebb-b887fd74b55f None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:16:36.145710 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5e12b8-68df-4e21-bebb-b887fd74b55f None admin] PATH_INFO: `/v3/domains/default` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:16:36.146820 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5e12b8-68df-4e21-bebb-b887fd74b55f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:16:36.148248 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5e12b8-68df-4e21-bebb-b887fd74b55f None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:16:36.150234 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 75/151] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Oct 12 02:16:36 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 02:16:36.150826 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5e12b8-68df-4e21-bebb-b887fd74b55f None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:16:36.173630 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82be8aa5-c6c1-4803-8990-26052653927a None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:16:36.206571 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc771d0-08e6-40ce-863b-c2477db5d10a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:16:36.207208 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc771d0-08e6-40ce-863b-c2477db5d10a None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:16:36.207486 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc771d0-08e6-40ce-863b-c2477db5d10a None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:16:36.207764 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc771d0-08e6-40ce-863b-c2477db5d10a None admin] PATH_INFO: `/v3/users/3cd66d93df7f4c06b05495a9194839ab` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:16:36.209646 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:16:36.222186 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc771d0-08e6-40ce-863b-c2477db5d10a None admin] RBAC: Authorizing `identity:get_user(user_id=3cd66d93df7f4c06b05495a9194839ab)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:16:36.223697 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc771d0-08e6-40ce-863b-c2477db5d10a None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:16:36.225375 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 77/152] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Oct 12 02:16:36 2022] GET /identity/v3/users/3cd66d93df7f4c06b05495a9194839ab => generated 283 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 02:16:36.228075 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc771d0-08e6-40ce-863b-c2477db5d10a None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:16:36.250898 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5e12b8-68df-4e21-bebb-b887fd74b55f None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:16:36.284776 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09cb478-b703-4b88-82fb-e21ec5a5fb48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:16:36.285379 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09cb478-b703-4b88-82fb-e21ec5a5fb48 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:16:36.285656 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09cb478-b703-4b88-82fb-e21ec5a5fb48 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:16:36.285933 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09cb478-b703-4b88-82fb-e21ec5a5fb48 None admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:16:36.286597 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09cb478-b703-4b88-82fb-e21ec5a5fb48 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 02:16:36.286896 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09cb478-b703-4b88-82fb-e21ec5a5fb48 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:16:36.288256 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09cb478-b703-4b88-82fb-e21ec5a5fb48 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:16:36.290121 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:16:36.297724 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 76/153] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Oct 12 02:16:36 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 02:16:36.297724 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09cb478-b703-4b88-82fb-e21ec5a5fb48 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:16:36.327339 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc771d0-08e6-40ce-863b-c2477db5d10a None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:16:36.363148 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5f6e9e-9a59-4489-a752-665dee3ca68d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:16:36.363831 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5f6e9e-9a59-4489-a752-665dee3ca68d None admin] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:16:36.364118 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5f6e9e-9a59-4489-a752-665dee3ca68d None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:16:36.364390 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5f6e9e-9a59-4489-a752-665dee3ca68d None admin] PATH_INFO: `/v3/users` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:16:36.365057 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5f6e9e-9a59-4489-a752-665dee3ca68d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:16:36.366488 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5f6e9e-9a59-4489-a752-665dee3ca68d None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:16:36.387496 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 78/154] 10.222.0.18 () {60 vars in 1132 bytes} [Wed Oct 12 02:16:36 2022] POST /identity/v3/users => generated 297 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 02:16:36.388386 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5f6e9e-9a59-4489-a752-665dee3ca68d None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:16:36.403525 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09cb478-b703-4b88-82fb-e21ec5a5fb48 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:16:36.445598 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92aca505-83be-4923-b0c2-0e1c4e6000e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:16:36.446269 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92aca505-83be-4923-b0c2-0e1c4e6000e5 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:16:36.446533 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92aca505-83be-4923-b0c2-0e1c4e6000e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:16:36.446807 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92aca505-83be-4923-b0c2-0e1c4e6000e5 None admin] PATH_INFO: `/v3/projects/f4486b89b2274830aff946201a578806` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:16:36.447236 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:16:36.449019 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92aca505-83be-4923-b0c2-0e1c4e6000e5 None admin] RBAC: Authorizing `identity:get_project(project_id=f4486b89b2274830aff946201a578806)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:16:36.450628 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92aca505-83be-4923-b0c2-0e1c4e6000e5 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:16:36.452418 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 77/155] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Oct 12 02:16:36 2022] GET /identity/v3/projects/f4486b89b2274830aff946201a578806 => generated 302 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 02:16:36.458776 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92aca505-83be-4923-b0c2-0e1c4e6000e5 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:16:36.511774 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5f6e9e-9a59-4489-a752-665dee3ca68d None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:16:36.541917 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:16:36.556395 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5d35ee-a5be-452c-8ee7-1884fda38a5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:16:36.557381 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5d35ee-a5be-452c-8ee7-1884fda38a5b None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:16:36.557663 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5d35ee-a5be-452c-8ee7-1884fda38a5b None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:16:36.558093 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5d35ee-a5be-452c-8ee7-1884fda38a5b None admin] PATH_INFO: `/v3/users/3cd66d93df7f4c06b05495a9194839ab` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:16:36.559250 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5d35ee-a5be-452c-8ee7-1884fda38a5b None admin] RBAC: Authorizing `identity:get_user(user_id=3cd66d93df7f4c06b05495a9194839ab)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:16:36.560737 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5d35ee-a5be-452c-8ee7-1884fda38a5b None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:16:36.562355 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 79/156] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Oct 12 02:16:36 2022] GET /identity/v3/users/3cd66d93df7f4c06b05495a9194839ab => generated 283 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 02:16:36.568018 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5d35ee-a5be-452c-8ee7-1884fda38a5b None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:16:36.585040 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92aca505-83be-4923-b0c2-0e1c4e6000e5 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:16:36.629384 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c93e74-3a1b-4a90-81c6-d53dbe9670c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:16:36.629980 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c93e74-3a1b-4a90-81c6-d53dbe9670c9 None admin] REQUEST_METHOD: `PUT` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:16:36.630262 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c93e74-3a1b-4a90-81c6-d53dbe9670c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:16:36.632330 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c93e74-3a1b-4a90-81c6-d53dbe9670c9 None admin] PATH_INFO: `/v3/projects/f4486b89b2274830aff946201a578806/users/3cd66d93df7f4c06b05495a9194839ab/roles/39b1e8108dff402383def3c559f48189` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:16:36.632725 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c93e74-3a1b-4a90-81c6-d53dbe9670c9 None admin] RBAC: Authorizing `identity:create_grant(project_id=f4486b89b2274830aff946201a578806, user_id=3cd66d93df7f4c06b05495a9194839ab, role_id=39b1e8108dff402383def3c559f48189)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:16:36.634372 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c93e74-3a1b-4a90-81c6-d53dbe9670c9 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:16:36.650670 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 78/157] 10.222.0.18 () {58 vars in 1439 bytes} [Wed Oct 12 02:16:36 2022] PUT /identity/v3/projects/f4486b89b2274830aff946201a578806/users/3cd66d93df7f4c06b05495a9194839ab/roles/39b1e8108dff402383def3c559f48189 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 02:16:36.687053 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5d35ee-a5be-452c-8ee7-1884fda38a5b None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:16:36.704862 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:16:36.726533 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30df43b-d5c3-4328-abb2-df557b0ebb4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:16:36.727333 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30df43b-d5c3-4328-abb2-df557b0ebb4d None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:16:36.727610 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30df43b-d5c3-4328-abb2-df557b0ebb4d None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:16:36.727880 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30df43b-d5c3-4328-abb2-df557b0ebb4d None admin] PATH_INFO: `/v3/projects/f4486b89b2274830aff946201a578806` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:16:36.729075 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30df43b-d5c3-4328-abb2-df557b0ebb4d None admin] RBAC: Authorizing `identity:get_project(project_id=f4486b89b2274830aff946201a578806)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:16:36.730571 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30df43b-d5c3-4328-abb2-df557b0ebb4d None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:16:36.732511 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 80/158] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Oct 12 02:16:36 2022] GET /identity/v3/projects/f4486b89b2274830aff946201a578806 => generated 302 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 02:16:36.738377 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c93e74-3a1b-4a90-81c6-d53dbe9670c9 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:16:36.856612 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c93e74-3a1b-4a90-81c6-d53dbe9670c9 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:16:36.882209 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:16:36.894795 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40b26a9-63e9-40da-88c6-965eb3e5741f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:16:36.895467 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40b26a9-63e9-40da-88c6-965eb3e5741f None admin] REQUEST_METHOD: `PUT` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:16:36.895741 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40b26a9-63e9-40da-88c6-965eb3e5741f None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:16:36.896018 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40b26a9-63e9-40da-88c6-965eb3e5741f None admin] PATH_INFO: `/v3/projects/f4486b89b2274830aff946201a578806/users/3cd66d93df7f4c06b05495a9194839ab/roles/7b67553aa5874cca8c47e5fb5ffa1971` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:16:36.898592 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40b26a9-63e9-40da-88c6-965eb3e5741f None admin] RBAC: Authorizing `identity:create_grant(project_id=f4486b89b2274830aff946201a578806, user_id=3cd66d93df7f4c06b05495a9194839ab, role_id=7b67553aa5874cca8c47e5fb5ffa1971)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:16:36.900885 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40b26a9-63e9-40da-88c6-965eb3e5741f None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:16:36.920513 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 79/159] 10.222.0.18 () {58 vars in 1439 bytes} [Wed Oct 12 02:16:36 2022] PUT /identity/v3/projects/f4486b89b2274830aff946201a578806/users/3cd66d93df7f4c06b05495a9194839ab/roles/7b67553aa5874cca8c47e5fb5ffa1971 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 02:16:38.705437 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43de273-e9da-4392-8eac-242bea6ceb94 None None] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:16:38.705975 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43de273-e9da-4392-8eac-242bea6ceb94 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:16:38.705975 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43de273-e9da-4392-8eac-242bea6ceb94 None None] PATH_INFO: `/` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:16:38.707298 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 81/160] 10.222.0.18 () {54 vars in 927 bytes} [Wed Oct 12 02:16:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 02:16:38.713482 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65118706-6c20-425e-b369-ec81aca34791 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:16:38.714263 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65118706-6c20-425e-b369-ec81aca34791 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:16:38.714736 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65118706-6c20-425e-b369-ec81aca34791 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:16:38.733361 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-65118706-6c20-425e-b369-ec81aca34791 None None] MFA Rules not processed for user `a326a5bb7364479382f528a592371656`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:16:38.734802 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-65118706-6c20-425e-b369-ec81aca34791 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:16:38.814047 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 80/161] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Oct 12 02:16:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 12 02:16:38.871207 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38af9413-0018-4d08-8d65-7930338bfb3a None None] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:16:38.871872 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38af9413-0018-4d08-8d65-7930338bfb3a None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:16:38.872351 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38af9413-0018-4d08-8d65-7930338bfb3a None None] PATH_INFO: `/` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:16:38.873927 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 82/162] 10.222.0.18 () {54 vars in 927 bytes} [Wed Oct 12 02:16:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 02:16:38.879348 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56155bea-1e6b-4221-a00b-00b8182bd849 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:16:38.879854 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56155bea-1e6b-4221-a00b-00b8182bd849 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:16:38.880423 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56155bea-1e6b-4221-a00b-00b8182bd849 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:16:38.899785 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-56155bea-1e6b-4221-a00b-00b8182bd849 None None] MFA Rules not processed for user `a326a5bb7364479382f528a592371656`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:16:38.901413 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-56155bea-1e6b-4221-a00b-00b8182bd849 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:16:38.922286 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd79efa-7ead-44ca-b3aa-cf7651ca8d90 None None] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:16:38.922566 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd79efa-7ead-44ca-b3aa-cf7651ca8d90 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:16:38.923039 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd79efa-7ead-44ca-b3aa-cf7651ca8d90 None None] PATH_INFO: `/` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:16:38.924386 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 83/163] 10.222.0.18 () {54 vars in 927 bytes} [Wed Oct 12 02:16:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 02:16:38.929391 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0746967-17c8-42ca-adf5-15a5ec09b1e6 None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:16:38.930232 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0746967-17c8-42ca-adf5-15a5ec09b1e6 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:16:38.931068 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0746967-17c8-42ca-adf5-15a5ec09b1e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:16:38.952553 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-e0746967-17c8-42ca-adf5-15a5ec09b1e6 None None] MFA Rules not processed for user `a326a5bb7364479382f528a592371656`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:16:38.954230 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-e0746967-17c8-42ca-adf5-15a5ec09b1e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:16:38.995452 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 81/164] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Oct 12 02:16:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 12 02:16:39.031805 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 84/165] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Oct 12 02:16:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 12 02:16:39.077528 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f406057b-0b1e-4929-9ab8-ea14a1b96143 None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:16:39.078122 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f406057b-0b1e-4929-9ab8-ea14a1b96143 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:16:39.078603 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f406057b-0b1e-4929-9ab8-ea14a1b96143 None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:16:39.080149 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 82/166] 10.222.0.18 () {54 vars in 927 bytes} [Wed Oct 12 02:16:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 02:16:39.085517 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b117c6-9467-458b-be7e-d3604782a42e None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:16:39.086061 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b117c6-9467-458b-be7e-d3604782a42e None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:16:39.086566 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b117c6-9467-458b-be7e-d3604782a42e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:16:39.092711 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f406057b-0b1e-4929-9ab8-ea14a1b96143 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:16:39.110024 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-b8b117c6-9467-458b-be7e-d3604782a42e None None] MFA Rules not processed for user `a326a5bb7364479382f528a592371656`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:16:39.111720 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-b8b117c6-9467-458b-be7e-d3604782a42e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:16:39.160553 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:16:39.190481 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 85/167] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Oct 12 02:16:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 12 02:16:39.223674 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f406057b-0b1e-4929-9ab8-ea14a1b96143 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:16:39.259621 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68717698-8a0e-4aab-95a0-aeffb4ce29a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:16:39.260253 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68717698-8a0e-4aab-95a0-aeffb4ce29a3 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:16:39.260559 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68717698-8a0e-4aab-95a0-aeffb4ce29a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:16:39.260833 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68717698-8a0e-4aab-95a0-aeffb4ce29a3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:16:39.271145 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68717698-8a0e-4aab-95a0-aeffb4ce29a3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 02:16:39.276431 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-68717698-8a0e-4aab-95a0-aeffb4ce29a3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 12 02:16:39.276431 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 02:16:39.276431 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 02:16:39.276431 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 02:16:39.276431 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 02:16:39.276431 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 02:16:39.276431 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 02:16:39.276431 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 02:16:39.276431 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 02:16:39.276431 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 02:16:39.276431 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 02:16:39.276431 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 02:16:39.276431 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 12 02:16:39.276431 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 12 02:16:39.276431 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 12 02:16:39.276431 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 12 02:16:39.277286 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 12 02:16:39.277286 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 12 02:16:39.277286 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 12 02:16:39.277286 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 12 02:16:39.277286 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 02:16:39.277286 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 02:16:39.277286 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 02:16:39.277286 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 02:16:39.277286 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 02:16:39.277286 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 02:16:39.277286 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 02:16:39.277286 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Oct 12 02:16:39.277286 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 02:16:39.277286 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Oct 12 02:16:39.277286 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 02:16:39.277286 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 02:16:39.278560 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 02:16:39.278560 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Oct 12 02:16:39.278560 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 02:16:39.278560 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Oct 12 02:16:39.278560 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 12 02:16:39.278560 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 12 02:16:39.278560 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 12 02:16:39.278560 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 12 02:16:39.278560 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 12 02:16:39.278560 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 12 02:16:39.278560 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 12 02:16:39.278560 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Oct 12 02:16:39.278560 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 83/168] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Oct 12 02:16:39 2022] GET /identity/v3/roles/member => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 12 02:16:39.283521 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b117c6-9467-458b-be7e-d3604782a42e None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:16:39.285165 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68717698-8a0e-4aab-95a0-aeffb4ce29a3 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:16:39.333510 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:16:39.390504 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b117c6-9467-458b-be7e-d3604782a42e None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:16:39.401464 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68717698-8a0e-4aab-95a0-aeffb4ce29a3 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:16:39.403732 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:16:39.429921 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddc386e-0468-469d-a6e7-3d721f2ba694 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:16:39.430536 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddc386e-0468-469d-a6e7-3d721f2ba694 None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:16:39.430818 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddc386e-0468-469d-a6e7-3d721f2ba694 None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:16:39.431092 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddc386e-0468-469d-a6e7-3d721f2ba694 None admin] PATH_INFO: `/v3/roles` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:16:39.431756 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ddc386e-0468-469d-a6e7-3d721f2ba694 None admin] RBAC: Adding query filter params (name=member) {{(pid=81361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 02:16:39.432056 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ddc386e-0468-469d-a6e7-3d721f2ba694 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:16:39.433471 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ddc386e-0468-469d-a6e7-3d721f2ba694 None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:16:39.441493 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 86/169] 10.222.0.18 () {56 vars in 1101 bytes} [Wed Oct 12 02:16:39 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 02:16:39.442074 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8217f36-c695-4dce-8668-7d39853e8ba6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:16:39.442274 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddc386e-0468-469d-a6e7-3d721f2ba694 None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:16:39.443214 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8217f36-c695-4dce-8668-7d39853e8ba6 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:16:39.443662 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8217f36-c695-4dce-8668-7d39853e8ba6 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:16:39.444083 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8217f36-c695-4dce-8668-7d39853e8ba6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:16:39.457302 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8217f36-c695-4dce-8668-7d39853e8ba6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 02:16:39.462753 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-f8217f36-c695-4dce-8668-7d39853e8ba6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 12 02:16:39.462753 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 02:16:39.462753 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 02:16:39.462753 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 02:16:39.462753 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 02:16:39.462753 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 02:16:39.462753 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 02:16:39.462753 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 02:16:39.462753 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 02:16:39.462753 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 02:16:39.462753 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 02:16:39.462753 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 02:16:39.462753 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 12 02:16:39.462753 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 12 02:16:39.462753 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 12 02:16:39.462753 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 12 02:16:39.463627 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 12 02:16:39.463627 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 12 02:16:39.463627 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 12 02:16:39.463627 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 12 02:16:39.463627 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 02:16:39.463627 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 02:16:39.463627 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 02:16:39.463627 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 02:16:39.463627 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 02:16:39.463627 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 02:16:39.463627 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 02:16:39.463627 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Oct 12 02:16:39.463627 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 02:16:39.463627 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Oct 12 02:16:39.463627 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 02:16:39.463627 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 02:16:39.464408 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 02:16:39.464408 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Oct 12 02:16:39.464408 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 02:16:39.464408 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Oct 12 02:16:39.464408 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 12 02:16:39.464408 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 12 02:16:39.464408 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 12 02:16:39.464408 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 12 02:16:39.464408 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 12 02:16:39.464408 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 12 02:16:39.464408 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 12 02:16:39.464408 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Oct 12 02:16:39.464408 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 84/170] 10.222.0.18 () {56 vars in 1096 bytes} [Wed Oct 12 02:16:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 12 02:16:39.465089 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8217f36-c695-4dce-8668-7d39853e8ba6 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:16:39.547549 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddc386e-0468-469d-a6e7-3d721f2ba694 None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:16:39.554530 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:16:39.566274 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8217f36-c695-4dce-8668-7d39853e8ba6 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:16:39.583450 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279a63ac-8104-465f-83e2-3502a486faf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:16:39.584145 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279a63ac-8104-465f-83e2-3502a486faf7 None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:16:39.584376 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279a63ac-8104-465f-83e2-3502a486faf7 None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:16:39.584682 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279a63ac-8104-465f-83e2-3502a486faf7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:16:39.585793 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279a63ac-8104-465f-83e2-3502a486faf7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:16:39.587788 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279a63ac-8104-465f-83e2-3502a486faf7 None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:16:39.589387 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 87/171] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Oct 12 02:16:39 2022] GET /identity/v3/domains/default => generated 199 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 02:16:39.592715 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279a63ac-8104-465f-83e2-3502a486faf7 None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:16:39.604632 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1502759-5aec-47d3-b5d3-f7d154b60996 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:16:39.605266 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1502759-5aec-47d3-b5d3-f7d154b60996 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:16:39.605547 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1502759-5aec-47d3-b5d3-f7d154b60996 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:16:39.605829 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1502759-5aec-47d3-b5d3-f7d154b60996 None admin] PATH_INFO: `/v3/users/d73bd23f74a64ad987a9138c7f3035c0` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:16:39.619488 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1502759-5aec-47d3-b5d3-f7d154b60996 None admin] RBAC: Authorizing `identity:get_user(user_id=d73bd23f74a64ad987a9138c7f3035c0)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:16:39.621002 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1502759-5aec-47d3-b5d3-f7d154b60996 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:16:39.622767 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 85/172] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Oct 12 02:16:39 2022] GET /identity/v3/users/d73bd23f74a64ad987a9138c7f3035c0 => generated 297 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 02:16:39.623375 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1502759-5aec-47d3-b5d3-f7d154b60996 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:16:39.647619 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:16:39.692086 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279a63ac-8104-465f-83e2-3502a486faf7 None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:16:39.722411 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1502759-5aec-47d3-b5d3-f7d154b60996 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:16:39.724811 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc157c5c-67b7-465e-9831-88803441ad29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:16:39.725420 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc157c5c-67b7-465e-9831-88803441ad29 None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:16:39.725699 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc157c5c-67b7-465e-9831-88803441ad29 None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:16:39.725973 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc157c5c-67b7-465e-9831-88803441ad29 None admin] PATH_INFO: `/v3/roles` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:16:39.726740 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc157c5c-67b7-465e-9831-88803441ad29 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 02:16:39.727073 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc157c5c-67b7-465e-9831-88803441ad29 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:16:39.728492 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc157c5c-67b7-465e-9831-88803441ad29 None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:16:39.736522 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 88/173] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Oct 12 02:16:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 02:16:39.737290 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc157c5c-67b7-465e-9831-88803441ad29 None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:16:39.761890 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc44187-5672-4bc1-97b2-2c01f519da62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:16:39.762519 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc44187-5672-4bc1-97b2-2c01f519da62 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:16:39.762798 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc44187-5672-4bc1-97b2-2c01f519da62 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:16:39.763072 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc44187-5672-4bc1-97b2-2c01f519da62 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:16:39.771555 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:16:39.773476 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc44187-5672-4bc1-97b2-2c01f519da62 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 02:16:39.778328 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-4cc44187-5672-4bc1-97b2-2c01f519da62 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 12 02:16:39.778328 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 02:16:39.778328 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 02:16:39.778328 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 02:16:39.778328 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 02:16:39.778328 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 02:16:39.778328 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 02:16:39.778328 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 02:16:39.778328 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 02:16:39.778328 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 02:16:39.778328 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 02:16:39.778328 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 02:16:39.778328 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 12 02:16:39.778328 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 12 02:16:39.778328 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 12 02:16:39.778328 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 12 02:16:39.779300 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 12 02:16:39.779300 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 12 02:16:39.779300 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 12 02:16:39.779300 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 12 02:16:39.779300 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 02:16:39.779300 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 02:16:39.779300 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 02:16:39.779300 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 02:16:39.779300 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 02:16:39.779300 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 02:16:39.779300 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 02:16:39.779300 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Oct 12 02:16:39.779300 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 02:16:39.779300 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Oct 12 02:16:39.779300 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 02:16:39.779300 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 02:16:39.780078 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 02:16:39.780078 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Oct 12 02:16:39.780078 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 02:16:39.780078 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Oct 12 02:16:39.780078 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 12 02:16:39.780078 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 12 02:16:39.780078 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 12 02:16:39.780078 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 12 02:16:39.780078 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 12 02:16:39.780078 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 12 02:16:39.780078 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 12 02:16:39.780078 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Oct 12 02:16:39.780078 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 86/174] 10.222.0.18 () {56 vars in 1114 bytes} [Wed Oct 12 02:16:39 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 02:16:39.780780 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc44187-5672-4bc1-97b2-2c01f519da62 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:16:39.840720 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc157c5c-67b7-465e-9831-88803441ad29 None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:16:39.860361 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:16:39.874719 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d40fe89-f55a-4108-89a1-3338740327b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:16:39.875323 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d40fe89-f55a-4108-89a1-3338740327b0 None admin] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:16:39.875604 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d40fe89-f55a-4108-89a1-3338740327b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:16:39.875869 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d40fe89-f55a-4108-89a1-3338740327b0 None admin] PATH_INFO: `/v3/users` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:16:39.876533 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d40fe89-f55a-4108-89a1-3338740327b0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:16:39.877971 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d40fe89-f55a-4108-89a1-3338740327b0 None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:16:39.878909 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc44187-5672-4bc1-97b2-2c01f519da62 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:16:39.898711 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 89/175] 10.222.0.18 () {60 vars in 1132 bytes} [Wed Oct 12 02:16:39 2022] POST /identity/v3/users => generated 297 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 02:16:39.899326 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d40fe89-f55a-4108-89a1-3338740327b0 None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:16:39.924290 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585d20ba-f0af-452e-b379-dba61cd8fefd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:16:39.924980 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585d20ba-f0af-452e-b379-dba61cd8fefd None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:16:39.925258 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585d20ba-f0af-452e-b379-dba61cd8fefd None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:16:39.925528 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585d20ba-f0af-452e-b379-dba61cd8fefd None admin] PATH_INFO: `/v3/projects/f4486b89b2274830aff946201a578806` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:16:39.926805 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585d20ba-f0af-452e-b379-dba61cd8fefd None admin] RBAC: Authorizing `identity:get_project(project_id=f4486b89b2274830aff946201a578806)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:16:39.928245 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585d20ba-f0af-452e-b379-dba61cd8fefd None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:16:39.930846 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 87/176] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Oct 12 02:16:39 2022] GET /identity/v3/projects/f4486b89b2274830aff946201a578806 => generated 302 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 02:16:39.930846 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585d20ba-f0af-452e-b379-dba61cd8fefd None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:16:40.013924 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:16:40.024984 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d40fe89-f55a-4108-89a1-3338740327b0 None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:16:40.054950 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585d20ba-f0af-452e-b379-dba61cd8fefd None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:16:40.062696 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd5e943-2b0f-4f42-9135-3dd2e51fe5ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:16:40.063627 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd5e943-2b0f-4f42-9135-3dd2e51fe5ab None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:16:40.063909 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd5e943-2b0f-4f42-9135-3dd2e51fe5ab None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:16:40.064184 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd5e943-2b0f-4f42-9135-3dd2e51fe5ab None admin] PATH_INFO: `/v3/users/3cd66d93df7f4c06b05495a9194839ab` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:16:40.065356 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd5e943-2b0f-4f42-9135-3dd2e51fe5ab None admin] RBAC: Authorizing `identity:get_user(user_id=3cd66d93df7f4c06b05495a9194839ab)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:16:40.066820 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd5e943-2b0f-4f42-9135-3dd2e51fe5ab None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:16:40.068603 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 90/177] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Oct 12 02:16:39 2022] GET /identity/v3/users/3cd66d93df7f4c06b05495a9194839ab => generated 283 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 02:16:40.069181 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd5e943-2b0f-4f42-9135-3dd2e51fe5ab None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:16:40.096075 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284f359d-6b81-48a5-b732-9c9e2cc26ccd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:16:40.096258 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284f359d-6b81-48a5-b732-9c9e2cc26ccd None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:16:40.096923 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284f359d-6b81-48a5-b732-9c9e2cc26ccd None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:16:40.096923 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284f359d-6b81-48a5-b732-9c9e2cc26ccd None admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:16:40.097588 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284f359d-6b81-48a5-b732-9c9e2cc26ccd None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 02:16:40.097867 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284f359d-6b81-48a5-b732-9c9e2cc26ccd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:16:40.099314 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284f359d-6b81-48a5-b732-9c9e2cc26ccd None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:16:40.108266 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 88/178] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Oct 12 02:16:39 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 02:16:40.113665 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284f359d-6b81-48a5-b732-9c9e2cc26ccd None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:16:40.128577 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:16:40.205382 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd5e943-2b0f-4f42-9135-3dd2e51fe5ab None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:16:40.248570 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e850188f-65d0-4f9e-abd4-18b3053b1f2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:16:40.249633 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e850188f-65d0-4f9e-abd4-18b3053b1f2b None admin] REQUEST_METHOD: `PUT` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:16:40.250017 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e850188f-65d0-4f9e-abd4-18b3053b1f2b None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:16:40.250301 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e850188f-65d0-4f9e-abd4-18b3053b1f2b None admin] PATH_INFO: `/v3/projects/f4486b89b2274830aff946201a578806/users/d73bd23f74a64ad987a9138c7f3035c0/roles/3d75c4d7f1a849b9a771504d1583ab28` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:16:40.251948 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284f359d-6b81-48a5-b732-9c9e2cc26ccd None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:16:40.252255 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e850188f-65d0-4f9e-abd4-18b3053b1f2b None admin] RBAC: Authorizing `identity:create_grant(project_id=f4486b89b2274830aff946201a578806, user_id=d73bd23f74a64ad987a9138c7f3035c0, role_id=3d75c4d7f1a849b9a771504d1583ab28)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:16:40.253876 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e850188f-65d0-4f9e-abd4-18b3053b1f2b None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:16:40.271784 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 91/179] 10.222.0.18 () {58 vars in 1439 bytes} [Wed Oct 12 02:16:40 2022] PUT /identity/v3/projects/f4486b89b2274830aff946201a578806/users/d73bd23f74a64ad987a9138c7f3035c0/roles/3d75c4d7f1a849b9a771504d1583ab28 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 02:16:40.273115 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e850188f-65d0-4f9e-abd4-18b3053b1f2b None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:16:40.301222 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:16:40.305331 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a59906-8d59-42f9-8ae6-6ad02904f96c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:16:40.306174 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a59906-8d59-42f9-8ae6-6ad02904f96c None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:16:40.306874 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a59906-8d59-42f9-8ae6-6ad02904f96c None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:16:40.306874 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a59906-8d59-42f9-8ae6-6ad02904f96c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:16:40.422428 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e850188f-65d0-4f9e-abd4-18b3053b1f2b None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:16:40.444462 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a59906-8d59-42f9-8ae6-6ad02904f96c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:16:40.446086 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a59906-8d59-42f9-8ae6-6ad02904f96c None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:16:40.476936 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:16:40.495170 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230b4517-ae25-4745-bd98-bce341baf4e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:16:40.495821 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230b4517-ae25-4745-bd98-bce341baf4e1 None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:16:40.496097 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230b4517-ae25-4745-bd98-bce341baf4e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:16:40.496369 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230b4517-ae25-4745-bd98-bce341baf4e1 None admin] PATH_INFO: `/v3/users/3cd66d93df7f4c06b05495a9194839ab` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:16:40.497554 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230b4517-ae25-4745-bd98-bce341baf4e1 None admin] RBAC: Authorizing `identity:get_user(user_id=3cd66d93df7f4c06b05495a9194839ab)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:16:40.499010 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230b4517-ae25-4745-bd98-bce341baf4e1 None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:16:40.500625 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 92/180] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Oct 12 02:16:40 2022] GET /identity/v3/users/3cd66d93df7f4c06b05495a9194839ab => generated 283 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 02:16:40.506061 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230b4517-ae25-4745-bd98-bce341baf4e1 None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:16:40.590937 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 89/181] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Oct 12 02:16:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 482 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 12 02:16:40.598118 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a59906-8d59-42f9-8ae6-6ad02904f96c None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:16:40.635905 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:16:40.654955 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230b4517-ae25-4745-bd98-bce341baf4e1 None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:16:40.719583 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a66b14f-7a48-4845-9366-c3b92b4370c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:16:40.720123 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a66b14f-7a48-4845-9366-c3b92b4370c9 None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:16:40.720402 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a66b14f-7a48-4845-9366-c3b92b4370c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:16:40.720703 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a66b14f-7a48-4845-9366-c3b92b4370c9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:16:40.778790 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a59906-8d59-42f9-8ae6-6ad02904f96c None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:16:40.803749 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:16:40.842245 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a66b14f-7a48-4845-9366-c3b92b4370c9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:16:40.843719 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a66b14f-7a48-4845-9366-c3b92b4370c9 None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:16:40.847008 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8566375e-2c1f-4681-8739-ac9d57ba0853 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:16:40.847657 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8566375e-2c1f-4681-8739-ac9d57ba0853 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:16:40.847934 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8566375e-2c1f-4681-8739-ac9d57ba0853 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:16:40.848204 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8566375e-2c1f-4681-8739-ac9d57ba0853 None admin] PATH_INFO: `/v3/projects/f4486b89b2274830aff946201a578806` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:16:40.850013 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8566375e-2c1f-4681-8739-ac9d57ba0853 None admin] RBAC: Authorizing `identity:get_project(project_id=f4486b89b2274830aff946201a578806)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:16:40.851984 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8566375e-2c1f-4681-8739-ac9d57ba0853 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:16:40.853675 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 90/182] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Oct 12 02:16:40 2022] GET /identity/v3/projects/f4486b89b2274830aff946201a578806 => generated 302 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 02:16:40.859694 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8566375e-2c1f-4681-8739-ac9d57ba0853 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:16:41.006875 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8566375e-2c1f-4681-8739-ac9d57ba0853 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:16:41.024345 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:16:41.044680 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08349df-b22e-4326-8858-0dc82c1f65b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:16:41.045294 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08349df-b22e-4326-8858-0dc82c1f65b7 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:16:41.045576 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08349df-b22e-4326-8858-0dc82c1f65b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:16:41.045931 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08349df-b22e-4326-8858-0dc82c1f65b7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:16:41.046640 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08349df-b22e-4326-8858-0dc82c1f65b7 None admin] RBAC: Adding query filter params (role.id=39b1e8108dff402383def3c559f48189, scope.project.id=f4486b89b2274830aff946201a578806, user.id=3cd66d93df7f4c06b05495a9194839ab) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 02:16:41.046950 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08349df-b22e-4326-8858-0dc82c1f65b7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:16:41.048512 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08349df-b22e-4326-8858-0dc82c1f65b7 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:16:41.055511 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 91/183] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Oct 12 02:16:40 2022] GET /identity/v3/role_assignments?user.id=3cd66d93df7f4c06b05495a9194839ab&scope.project.id=f4486b89b2274830aff946201a578806&role.id=39b1e8108dff402383def3c559f48189 => generated 608 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 02:16:41.056982 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 93/184] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Oct 12 02:16:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 551 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Oct 12 02:16:41.063512 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08349df-b22e-4326-8858-0dc82c1f65b7 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:16:41.115720 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:16:41.176748 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08349df-b22e-4326-8858-0dc82c1f65b7 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:16:41.214016 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e5c623-00f1-4f57-8fa0-b4c9169fcc98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:16:41.214665 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e5c623-00f1-4f57-8fa0-b4c9169fcc98 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:16:41.214948 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e5c623-00f1-4f57-8fa0-b4c9169fcc98 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:16:41.215224 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e5c623-00f1-4f57-8fa0-b4c9169fcc98 None admin] PATH_INFO: `/v3/projects/f4486b89b2274830aff946201a578806` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:16:41.216375 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e5c623-00f1-4f57-8fa0-b4c9169fcc98 None admin] RBAC: Authorizing `identity:get_project(project_id=f4486b89b2274830aff946201a578806)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:16:41.217869 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e5c623-00f1-4f57-8fa0-b4c9169fcc98 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:16:41.219972 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 92/185] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Oct 12 02:16:41 2022] GET /identity/v3/projects/f4486b89b2274830aff946201a578806 => generated 302 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 02:16:41.225826 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a66b14f-7a48-4845-9366-c3b92b4370c9 None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:16:41.359224 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a66b14f-7a48-4845-9366-c3b92b4370c9 None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:16:41.396936 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad3f968-433a-4019-a1bf-3e8d161901ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:16:41.397544 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad3f968-433a-4019-a1bf-3e8d161901ad None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:16:41.397817 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad3f968-433a-4019-a1bf-3e8d161901ad None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:16:41.398082 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad3f968-433a-4019-a1bf-3e8d161901ad None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:16:41.398963 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad3f968-433a-4019-a1bf-3e8d161901ad None admin] RBAC: Adding query filter params (role.id=7b67553aa5874cca8c47e5fb5ffa1971, scope.project.id=f4486b89b2274830aff946201a578806, user.id=3cd66d93df7f4c06b05495a9194839ab) {{(pid=81361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 02:16:41.399263 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad3f968-433a-4019-a1bf-3e8d161901ad None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:16:41.400732 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad3f968-433a-4019-a1bf-3e8d161901ad None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:16:41.407063 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 94/186] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Oct 12 02:16:41 2022] GET /identity/v3/role_assignments?user.id=3cd66d93df7f4c06b05495a9194839ab&scope.project.id=f4486b89b2274830aff946201a578806&role.id=7b67553aa5874cca8c47e5fb5ffa1971 => generated 608 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 02:16:42.314391 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9820f275-c19b-4383-adff-4782914cc420 None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:16:42.314907 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9820f275-c19b-4383-adff-4782914cc420 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:16:42.314982 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9820f275-c19b-4383-adff-4782914cc420 None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:16:42.316286 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 93/187] 10.222.0.18 () {54 vars in 927 bytes} [Wed Oct 12 02:16:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 02:16:42.322269 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6f2ce9-f23c-4d89-a20d-2f9bc4481448 None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:16:42.322719 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6f2ce9-f23c-4d89-a20d-2f9bc4481448 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:16:42.322804 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6f2ce9-f23c-4d89-a20d-2f9bc4481448 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:16:42.341590 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-cf6f2ce9-f23c-4d89-a20d-2f9bc4481448 None None] MFA Rules not processed for user `a326a5bb7364479382f528a592371656`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:16:42.342791 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-cf6f2ce9-f23c-4d89-a20d-2f9bc4481448 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:16:42.397231 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:16:42.418114 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 95/188] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Oct 12 02:16:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 12 02:16:42.476224 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491598df-2bb2-4ef9-8e4e-cd81476235a5 None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:16:42.476574 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491598df-2bb2-4ef9-8e4e-cd81476235a5 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:16:42.476968 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491598df-2bb2-4ef9-8e4e-cd81476235a5 None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:16:42.480509 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 94/189] 10.222.0.18 () {54 vars in 927 bytes} [Wed Oct 12 02:16:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 02:16:42.483892 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109016be-dd02-4940-a6d5-3bd1b612f9e6 None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:16:42.484187 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109016be-dd02-4940-a6d5-3bd1b612f9e6 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:16:42.484482 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109016be-dd02-4940-a6d5-3bd1b612f9e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:16:42.503694 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-109016be-dd02-4940-a6d5-3bd1b612f9e6 None None] MFA Rules not processed for user `a326a5bb7364479382f528a592371656`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:16:42.504900 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-109016be-dd02-4940-a6d5-3bd1b612f9e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:16:42.584573 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 96/190] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Oct 12 02:16:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 12 02:16:42.684427 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491598df-2bb2-4ef9-8e4e-cd81476235a5 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:16:42.793590 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491598df-2bb2-4ef9-8e4e-cd81476235a5 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:16:42.807155 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:16:42.829164 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5b04df-d0b2-4c1e-856c-f9ee75448ad3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:16:42.832505 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5b04df-d0b2-4c1e-856c-f9ee75448ad3 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:16:42.832505 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5b04df-d0b2-4c1e-856c-f9ee75448ad3 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:16:42.832505 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5b04df-d0b2-4c1e-856c-f9ee75448ad3 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:16:42.832770 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666787e9-f3a7-4140-bdde-475fa36bb00b None None] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:16:42.832770 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666787e9-f3a7-4140-bdde-475fa36bb00b None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:16:42.832770 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666787e9-f3a7-4140-bdde-475fa36bb00b None None] PATH_INFO: `/` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:16:42.833752 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 97/191] 10.222.0.18 () {54 vars in 927 bytes} [Wed Oct 12 02:16:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 12 02:16:42.838846 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e39bcc4-bb90-49fb-8988-226aef0acbf1 None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:16:42.839069 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e39bcc4-bb90-49fb-8988-226aef0acbf1 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:16:42.839344 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e39bcc4-bb90-49fb-8988-226aef0acbf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:16:42.843371 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5b04df-d0b2-4c1e-856c-f9ee75448ad3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 02:16:42.848877 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-bc5b04df-d0b2-4c1e-856c-f9ee75448ad3 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 12 02:16:42.848877 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 02:16:42.848877 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 02:16:42.848877 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 02:16:42.848877 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 02:16:42.848877 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 02:16:42.848877 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 02:16:42.848877 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 02:16:42.848877 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 02:16:42.848877 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 02:16:42.848877 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 02:16:42.848877 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 02:16:42.848877 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 12 02:16:42.848877 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 12 02:16:42.848877 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 12 02:16:42.848877 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 12 02:16:42.849737 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 12 02:16:42.849737 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 12 02:16:42.849737 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 12 02:16:42.849737 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 12 02:16:42.849737 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 02:16:42.849737 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 02:16:42.849737 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 02:16:42.849737 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 02:16:42.849737 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 02:16:42.849737 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 02:16:42.849737 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 02:16:42.849737 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Oct 12 02:16:42.849737 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 02:16:42.849737 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Oct 12 02:16:42.849737 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 02:16:42.849737 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 02:16:42.850530 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 02:16:42.850530 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Oct 12 02:16:42.850530 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 02:16:42.850530 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Oct 12 02:16:42.850530 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 12 02:16:42.850530 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 12 02:16:42.850530 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 12 02:16:42.850530 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 12 02:16:42.850530 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 12 02:16:42.850530 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 12 02:16:42.850530 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 12 02:16:42.850530 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Oct 12 02:16:42.854307 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 95/192] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Oct 12 02:16:42 2022] GET /identity/v3/roles/reader => generated 84 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 02:16:42.855012 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5b04df-d0b2-4c1e-856c-f9ee75448ad3 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:16:42.859111 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-8e39bcc4-bb90-49fb-8988-226aef0acbf1 None None] MFA Rules not processed for user `a326a5bb7364479382f528a592371656`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:16:42.860305 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-8e39bcc4-bb90-49fb-8988-226aef0acbf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:16:42.926877 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 98/193] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Oct 12 02:16:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 12 02:16:42.928668 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e39bcc4-bb90-49fb-8988-226aef0acbf1 None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:16:42.957814 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5b04df-d0b2-4c1e-856c-f9ee75448ad3 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:16:42.971675 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:16:42.994551 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb4a884-a797-4642-bdbc-d51692a91e18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:16:42.995116 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb4a884-a797-4642-bdbc-d51692a91e18 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:16:42.995393 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb4a884-a797-4642-bdbc-d51692a91e18 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:16:42.995662 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb4a884-a797-4642-bdbc-d51692a91e18 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:16:42.996951 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb4a884-a797-4642-bdbc-d51692a91e18 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:16:42.998874 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb4a884-a797-4642-bdbc-d51692a91e18 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:16:43.000771 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 96/194] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Oct 12 02:16:42 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 02:16:43.005969 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb4a884-a797-4642-bdbc-d51692a91e18 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:16:43.032035 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e39bcc4-bb90-49fb-8988-226aef0acbf1 None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:16:43.050059 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:16:43.068939 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8b5a50-4ddc-45d5-9871-37302537ce45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:16:43.069547 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8b5a50-4ddc-45d5-9871-37302537ce45 None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:16:43.069824 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8b5a50-4ddc-45d5-9871-37302537ce45 None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:16:43.070205 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8b5a50-4ddc-45d5-9871-37302537ce45 None admin] PATH_INFO: `/v3/roles` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:16:43.070890 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8b5a50-4ddc-45d5-9871-37302537ce45 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 02:16:43.071190 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8b5a50-4ddc-45d5-9871-37302537ce45 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:16:43.072618 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8b5a50-4ddc-45d5-9871-37302537ce45 None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:16:43.080698 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 99/195] 10.222.0.18 () {56 vars in 1101 bytes} [Wed Oct 12 02:16:42 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 02:16:43.086902 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8b5a50-4ddc-45d5-9871-37302537ce45 None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:16:43.119166 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb4a884-a797-4642-bdbc-d51692a91e18 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:16:43.159493 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6b6373-f7a5-485d-b2b0-fab52d6e7b1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:16:43.160150 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6b6373-f7a5-485d-b2b0-fab52d6e7b1a None admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:16:43.160434 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6b6373-f7a5-485d-b2b0-fab52d6e7b1a None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:16:43.160738 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6b6373-f7a5-485d-b2b0-fab52d6e7b1a None admin] PATH_INFO: `/v3/users` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:16:43.161557 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6b6373-f7a5-485d-b2b0-fab52d6e7b1a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:16:43.163115 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6b6373-f7a5-485d-b2b0-fab52d6e7b1a None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:16:43.187841 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 97/196] 10.222.0.18 () {60 vars in 1132 bytes} [Wed Oct 12 02:16:43 2022] POST /identity/v3/users => generated 293 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 02:16:43.194073 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8b5a50-4ddc-45d5-9871-37302537ce45 None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:16:43.197075 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:16:43.200948 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6b6373-f7a5-485d-b2b0-fab52d6e7b1a None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:16:43.235341 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c43e46d-f16d-4558-93b5-6a11c74a4e37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:16:43.236085 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c43e46d-f16d-4558-93b5-6a11c74a4e37 None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:16:43.236372 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c43e46d-f16d-4558-93b5-6a11c74a4e37 None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:16:43.236680 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c43e46d-f16d-4558-93b5-6a11c74a4e37 None admin] PATH_INFO: `/v3/users/1da30b0296d84369b9f16138fb6c29bf` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:16:43.253257 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c43e46d-f16d-4558-93b5-6a11c74a4e37 None admin] RBAC: Authorizing `identity:get_user(user_id=1da30b0296d84369b9f16138fb6c29bf)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:16:43.254767 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c43e46d-f16d-4558-93b5-6a11c74a4e37 None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:16:43.256710 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 100/197] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Oct 12 02:16:43 2022] GET /identity/v3/users/1da30b0296d84369b9f16138fb6c29bf => generated 297 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 02:16:43.262489 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c43e46d-f16d-4558-93b5-6a11c74a4e37 None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:16:43.313178 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:16:43.321337 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6b6373-f7a5-485d-b2b0-fab52d6e7b1a None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:16:43.359872 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af72953-cac7-4744-b366-5d9e2e8d7163 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:16:43.360539 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af72953-cac7-4744-b366-5d9e2e8d7163 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:16:43.361183 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af72953-cac7-4744-b366-5d9e2e8d7163 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:16:43.361183 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af72953-cac7-4744-b366-5d9e2e8d7163 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:16:43.374339 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c43e46d-f16d-4558-93b5-6a11c74a4e37 None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:16:43.375186 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af72953-cac7-4744-b366-5d9e2e8d7163 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 02:16:43.380443 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-1af72953-cac7-4744-b366-5d9e2e8d7163 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 12 02:16:43.380443 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 02:16:43.380443 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 02:16:43.380443 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 02:16:43.380443 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 02:16:43.380443 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 02:16:43.380443 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 02:16:43.380443 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 02:16:43.380443 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 02:16:43.380443 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 02:16:43.380443 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 02:16:43.380443 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 02:16:43.380443 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 12 02:16:43.380443 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 12 02:16:43.380443 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 12 02:16:43.380443 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 12 02:16:43.381360 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 12 02:16:43.381360 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 12 02:16:43.381360 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 12 02:16:43.381360 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 12 02:16:43.381360 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 02:16:43.381360 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 02:16:43.381360 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 02:16:43.381360 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 02:16:43.381360 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 02:16:43.381360 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 02:16:43.381360 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 02:16:43.381360 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Oct 12 02:16:43.381360 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 02:16:43.381360 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Oct 12 02:16:43.381360 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 02:16:43.381360 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 02:16:43.382220 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 02:16:43.382220 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Oct 12 02:16:43.382220 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 02:16:43.382220 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Oct 12 02:16:43.382220 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 12 02:16:43.382220 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 12 02:16:43.382220 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 12 02:16:43.382220 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 12 02:16:43.382220 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 12 02:16:43.382220 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 12 02:16:43.382220 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 12 02:16:43.382220 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Oct 12 02:16:43.382220 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 98/198] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Oct 12 02:16:43 2022] GET /identity/v3/roles/member => generated 84 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 12 02:16:43.389249 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af72953-cac7-4744-b366-5d9e2e8d7163 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:16:43.412605 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237cd5d8-6a1b-40b7-88b0-d4a1b2612ac9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:16:43.413247 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237cd5d8-6a1b-40b7-88b0-d4a1b2612ac9 None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:16:43.413524 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237cd5d8-6a1b-40b7-88b0-d4a1b2612ac9 None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:16:43.413883 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237cd5d8-6a1b-40b7-88b0-d4a1b2612ac9 None admin] PATH_INFO: `/v3/projects/f4486b89b2274830aff946201a578806` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:16:43.415035 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237cd5d8-6a1b-40b7-88b0-d4a1b2612ac9 None admin] RBAC: Authorizing `identity:get_project(project_id=f4486b89b2274830aff946201a578806)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:16:43.416520 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237cd5d8-6a1b-40b7-88b0-d4a1b2612ac9 None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:16:43.418323 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 101/199] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Oct 12 02:16:43 2022] GET /identity/v3/projects/f4486b89b2274830aff946201a578806 => generated 302 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 02:16:43.424036 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237cd5d8-6a1b-40b7-88b0-d4a1b2612ac9 None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:16:43.456129 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:16:43.510746 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af72953-cac7-4744-b366-5d9e2e8d7163 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:16:43.546867 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237cd5d8-6a1b-40b7-88b0-d4a1b2612ac9 None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:16:43.560250 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daff82d5-c4cf-4ef5-866f-4883ada330f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:16:43.561220 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daff82d5-c4cf-4ef5-866f-4883ada330f2 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:16:43.561674 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daff82d5-c4cf-4ef5-866f-4883ada330f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:16:43.561956 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daff82d5-c4cf-4ef5-866f-4883ada330f2 None admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:16:43.562816 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daff82d5-c4cf-4ef5-866f-4883ada330f2 None admin] RBAC: Adding query filter params (name=member) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 02:16:43.563114 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daff82d5-c4cf-4ef5-866f-4883ada330f2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:16:43.564955 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daff82d5-c4cf-4ef5-866f-4883ada330f2 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:16:43.575634 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 99/200] 10.222.0.18 () {56 vars in 1101 bytes} [Wed Oct 12 02:16:43 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 02:16:43.585120 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daff82d5-c4cf-4ef5-866f-4883ada330f2 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:16:43.587441 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa77dbf5-32b6-4222-866c-1a4f31249617 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:16:43.588112 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa77dbf5-32b6-4222-866c-1a4f31249617 None admin] REQUEST_METHOD: `PUT` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:16:43.588386 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa77dbf5-32b6-4222-866c-1a4f31249617 None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:16:43.588746 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa77dbf5-32b6-4222-866c-1a4f31249617 None admin] PATH_INFO: `/v3/projects/f4486b89b2274830aff946201a578806/users/1da30b0296d84369b9f16138fb6c29bf/roles/3b01dfb837044fd5b3f01dbf63d8edd1` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:16:43.590971 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa77dbf5-32b6-4222-866c-1a4f31249617 None admin] RBAC: Authorizing `identity:create_grant(project_id=f4486b89b2274830aff946201a578806, user_id=1da30b0296d84369b9f16138fb6c29bf, role_id=3b01dfb837044fd5b3f01dbf63d8edd1)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:16:43.592427 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa77dbf5-32b6-4222-866c-1a4f31249617 None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:16:43.609465 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 102/201] 10.222.0.18 () {58 vars in 1439 bytes} [Wed Oct 12 02:16:43 2022] PUT /identity/v3/projects/f4486b89b2274830aff946201a578806/users/1da30b0296d84369b9f16138fb6c29bf/roles/3b01dfb837044fd5b3f01dbf63d8edd1 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 02:16:43.610189 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:16:43.719261 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daff82d5-c4cf-4ef5-866f-4883ada330f2 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:16:43.760885 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e2cb01-3c2f-423a-873b-f2393102a945 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:16:43.761544 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e2cb01-3c2f-423a-873b-f2393102a945 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:16:43.761820 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e2cb01-3c2f-423a-873b-f2393102a945 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:16:43.762090 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e2cb01-3c2f-423a-873b-f2393102a945 None admin] PATH_INFO: `/v3/users/d73bd23f74a64ad987a9138c7f3035c0` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:16:43.763264 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e2cb01-3c2f-423a-873b-f2393102a945 None admin] RBAC: Authorizing `identity:get_user(user_id=d73bd23f74a64ad987a9138c7f3035c0)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:16:43.764789 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e2cb01-3c2f-423a-873b-f2393102a945 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:16:43.766869 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 100/202] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Oct 12 02:16:43 2022] GET /identity/v3/users/d73bd23f74a64ad987a9138c7f3035c0 => generated 297 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 02:16:43.774204 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa77dbf5-32b6-4222-866c-1a4f31249617 None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:16:43.887484 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:16:43.898951 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa77dbf5-32b6-4222-866c-1a4f31249617 None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:16:43.936029 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470c63c1-8bbb-4e07-af8f-9b7c6215238b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:16:43.936733 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470c63c1-8bbb-4e07-af8f-9b7c6215238b None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:16:43.937014 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470c63c1-8bbb-4e07-af8f-9b7c6215238b None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:16:43.937339 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470c63c1-8bbb-4e07-af8f-9b7c6215238b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:16:44.010371 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470c63c1-8bbb-4e07-af8f-9b7c6215238b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:16:44.011767 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470c63c1-8bbb-4e07-af8f-9b7c6215238b None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:16:44.111592 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:16:44.124014 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 103/203] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Oct 12 02:16:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 12 02:16:44.129474 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e2cb01-3c2f-423a-873b-f2393102a945 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:16:44.223498 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:16:44.240702 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e2cb01-3c2f-423a-873b-f2393102a945 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:16:44.280525 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9353ea58-8593-4c07-b4f6-876c667f6b11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:16:44.281087 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9353ea58-8593-4c07-b4f6-876c667f6b11 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:16:44.281366 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9353ea58-8593-4c07-b4f6-876c667f6b11 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:16:44.281635 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9353ea58-8593-4c07-b4f6-876c667f6b11 None admin] PATH_INFO: `/v3/projects/f4486b89b2274830aff946201a578806` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:16:44.282762 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9353ea58-8593-4c07-b4f6-876c667f6b11 None admin] RBAC: Authorizing `identity:get_project(project_id=f4486b89b2274830aff946201a578806)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:16:44.284195 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9353ea58-8593-4c07-b4f6-876c667f6b11 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:16:44.285921 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 101/204] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Oct 12 02:16:44 2022] GET /identity/v3/projects/f4486b89b2274830aff946201a578806 => generated 302 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 02:16:44.292934 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470c63c1-8bbb-4e07-af8f-9b7c6215238b None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:16:44.401660 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470c63c1-8bbb-4e07-af8f-9b7c6215238b None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:16:44.437033 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b47c061-f8d1-4f4a-9b2e-7cdebdde08e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:16:44.437640 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b47c061-f8d1-4f4a-9b2e-7cdebdde08e4 None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:16:44.437916 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b47c061-f8d1-4f4a-9b2e-7cdebdde08e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:16:44.438191 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b47c061-f8d1-4f4a-9b2e-7cdebdde08e4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:16:44.438915 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b47c061-f8d1-4f4a-9b2e-7cdebdde08e4 None admin] RBAC: Adding query filter params (role.id=3d75c4d7f1a849b9a771504d1583ab28, scope.project.id=f4486b89b2274830aff946201a578806, user.id=d73bd23f74a64ad987a9138c7f3035c0) {{(pid=81361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 02:16:44.439217 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b47c061-f8d1-4f4a-9b2e-7cdebdde08e4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:16:44.440677 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b47c061-f8d1-4f4a-9b2e-7cdebdde08e4 None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:16:44.448530 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 104/205] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Oct 12 02:16:44 2022] GET /identity/v3/role_assignments?user.id=d73bd23f74a64ad987a9138c7f3035c0&scope.project.id=f4486b89b2274830aff946201a578806&role.id=3d75c4d7f1a849b9a771504d1583ab28 => generated 608 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 02:16:45.525917 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea23c78-9792-4e4d-bb2a-7f18638d51c0 None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:16:45.526428 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea23c78-9792-4e4d-bb2a-7f18638d51c0 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:16:45.526535 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea23c78-9792-4e4d-bb2a-7f18638d51c0 None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:16:45.527853 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 102/206] 10.222.0.18 () {54 vars in 927 bytes} [Wed Oct 12 02:16:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 02:16:45.533848 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7b426b-3159-46a5-86b9-02dd85b98477 None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:16:45.534366 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7b426b-3159-46a5-86b9-02dd85b98477 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:16:45.534438 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7b426b-3159-46a5-86b9-02dd85b98477 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:16:45.554987 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-ef7b426b-3159-46a5-86b9-02dd85b98477 None None] MFA Rules not processed for user `a326a5bb7364479382f528a592371656`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:16:45.556182 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-ef7b426b-3159-46a5-86b9-02dd85b98477 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:16:45.609557 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:16:45.629870 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 105/207] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Oct 12 02:16:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 12 02:16:45.640220 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7c85db-8626-488b-924c-b350632bfa2d None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:16:45.640600 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7c85db-8626-488b-924c-b350632bfa2d None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:16:45.640941 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7c85db-8626-488b-924c-b350632bfa2d None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:16:45.642486 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 103/208] 10.222.0.18 () {54 vars in 927 bytes} [Wed Oct 12 02:16:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 02:16:45.647591 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d095ef47-6f23-4620-8b20-915cffd0d6fa None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:16:45.647872 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d095ef47-6f23-4620-8b20-915cffd0d6fa None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:16:45.648219 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d095ef47-6f23-4620-8b20-915cffd0d6fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:16:45.666492 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-d095ef47-6f23-4620-8b20-915cffd0d6fa None None] MFA Rules not processed for user `a326a5bb7364479382f528a592371656`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:16:45.667708 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-d095ef47-6f23-4620-8b20-915cffd0d6fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:16:45.738844 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 106/209] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Oct 12 02:16:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 12 02:16:45.791090 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377f80eb-4a81-480e-9bec-0221bffc3b98 None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:16:45.791336 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377f80eb-4a81-480e-9bec-0221bffc3b98 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:16:45.791709 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377f80eb-4a81-480e-9bec-0221bffc3b98 None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:16:45.793198 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 104/210] 10.222.0.18 () {54 vars in 927 bytes} [Wed Oct 12 02:16:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 02:16:45.798349 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7030d28c-57f3-4154-ab88-13f9f47a8270 None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:16:45.798636 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7030d28c-57f3-4154-ab88-13f9f47a8270 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:16:45.798911 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7030d28c-57f3-4154-ab88-13f9f47a8270 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:16:45.817226 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-7030d28c-57f3-4154-ab88-13f9f47a8270 None None] MFA Rules not processed for user `a326a5bb7364479382f528a592371656`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:16:45.818397 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-7030d28c-57f3-4154-ab88-13f9f47a8270 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:16:45.886004 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 107/211] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Oct 12 02:16:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 12 02:16:45.897583 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377f80eb-4a81-480e-9bec-0221bffc3b98 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:16:46.001339 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377f80eb-4a81-480e-9bec-0221bffc3b98 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:16:46.004092 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7030d28c-57f3-4154-ab88-13f9f47a8270 None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:16:46.038997 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c7bc09-4445-44c8-aa95-814c295b0341 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:16:46.039640 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c7bc09-4445-44c8-aa95-814c295b0341 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:16:46.039918 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c7bc09-4445-44c8-aa95-814c295b0341 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:16:46.040192 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c7bc09-4445-44c8-aa95-814c295b0341 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:16:46.050790 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c7bc09-4445-44c8-aa95-814c295b0341 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 02:16:46.052924 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:16:46.056190 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-d3c7bc09-4445-44c8-aa95-814c295b0341 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 12 02:16:46.056190 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 02:16:46.056190 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 02:16:46.056190 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 02:16:46.056190 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 02:16:46.056190 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 02:16:46.056190 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 02:16:46.056190 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 02:16:46.056190 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 02:16:46.056190 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 02:16:46.056190 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 02:16:46.056190 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 02:16:46.056190 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 12 02:16:46.056190 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 12 02:16:46.056190 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 12 02:16:46.056190 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 12 02:16:46.057185 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 12 02:16:46.057185 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 12 02:16:46.057185 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 12 02:16:46.057185 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 12 02:16:46.057185 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 02:16:46.057185 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 02:16:46.057185 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 02:16:46.057185 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 02:16:46.057185 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 02:16:46.057185 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 02:16:46.057185 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 02:16:46.057185 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Oct 12 02:16:46.057185 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 02:16:46.057185 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Oct 12 02:16:46.057185 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 02:16:46.057185 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 02:16:46.058652 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 02:16:46.058652 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Oct 12 02:16:46.058652 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 02:16:46.058652 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Oct 12 02:16:46.058652 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 12 02:16:46.058652 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 12 02:16:46.058652 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 12 02:16:46.058652 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 12 02:16:46.058652 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 12 02:16:46.058652 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 12 02:16:46.058652 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 12 02:16:46.058652 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Oct 12 02:16:46.058652 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 105/212] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Oct 12 02:16:45 2022] GET /identity/v3/roles/member => generated 84 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 02:16:46.063216 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c7bc09-4445-44c8-aa95-814c295b0341 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:16:46.080024 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:16:46.114147 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7030d28c-57f3-4154-ab88-13f9f47a8270 None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:16:46.150132 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857506c7-4ff0-4ce2-a072-d8ced19978ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:16:46.150772 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857506c7-4ff0-4ce2-a072-d8ced19978ef None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:16:46.151052 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857506c7-4ff0-4ce2-a072-d8ced19978ef None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:16:46.151324 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857506c7-4ff0-4ce2-a072-d8ced19978ef None admin] PATH_INFO: `/v3/domains/default` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:16:46.152431 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857506c7-4ff0-4ce2-a072-d8ced19978ef None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:16:46.154011 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857506c7-4ff0-4ce2-a072-d8ced19978ef None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:16:46.155579 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 108/213] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Oct 12 02:16:46 2022] GET /identity/v3/domains/default => generated 199 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 02:16:46.156325 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857506c7-4ff0-4ce2-a072-d8ced19978ef None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:16:46.171939 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c7bc09-4445-44c8-aa95-814c295b0341 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:16:46.206029 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5042428-8ee9-4bb2-9e14-049ee348c3f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:16:46.206634 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5042428-8ee9-4bb2-9e14-049ee348c3f3 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:16:46.206920 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5042428-8ee9-4bb2-9e14-049ee348c3f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:16:46.207194 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5042428-8ee9-4bb2-9e14-049ee348c3f3 None admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:16:46.207868 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5042428-8ee9-4bb2-9e14-049ee348c3f3 None admin] RBAC: Adding query filter params (name=member) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 02:16:46.208170 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5042428-8ee9-4bb2-9e14-049ee348c3f3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:16:46.209576 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5042428-8ee9-4bb2-9e14-049ee348c3f3 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:16:46.217980 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 106/214] 10.222.0.18 () {56 vars in 1101 bytes} [Wed Oct 12 02:16:46 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 02:16:46.218530 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5042428-8ee9-4bb2-9e14-049ee348c3f3 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:16:46.260622 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857506c7-4ff0-4ce2-a072-d8ced19978ef None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:16:46.273600 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:16:46.294393 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28142639-1520-41c8-ab8f-d8ae7203f9f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:16:46.295016 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28142639-1520-41c8-ab8f-d8ae7203f9f3 None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:16:46.295289 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28142639-1520-41c8-ab8f-d8ae7203f9f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:16:46.295556 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28142639-1520-41c8-ab8f-d8ae7203f9f3 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:16:46.298286 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:16:46.307641 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28142639-1520-41c8-ab8f-d8ae7203f9f3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 02:16:46.312846 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application [None req-28142639-1520-41c8-ab8f-d8ae7203f9f3 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 12 02:16:46.312846 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 02:16:46.312846 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 02:16:46.312846 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 02:16:46.312846 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 02:16:46.312846 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 02:16:46.312846 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 02:16:46.312846 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 02:16:46.312846 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 02:16:46.312846 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 02:16:46.312846 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 02:16:46.312846 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 02:16:46.312846 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 12 02:16:46.312846 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 12 02:16:46.312846 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 12 02:16:46.312846 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 12 02:16:46.313906 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 12 02:16:46.313906 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 12 02:16:46.313906 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 12 02:16:46.313906 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 12 02:16:46.313906 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 02:16:46.313906 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 02:16:46.313906 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 02:16:46.313906 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 02:16:46.313906 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 02:16:46.313906 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 02:16:46.313906 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 02:16:46.313906 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application with Lock( Oct 12 02:16:46.313906 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 02:16:46.313906 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._enter() Oct 12 02:16:46.313906 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 02:16:46.313906 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 02:16:46.314802 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 02:16:46.314802 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.creator() Oct 12 02:16:46.314802 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 02:16:46.314802 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application created_value = creator( Oct 12 02:16:46.314802 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 12 02:16:46.314802 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 12 02:16:46.314802 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 12 02:16:46.314802 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 12 02:16:46.314802 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 12 02:16:46.314802 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 12 02:16:46.314802 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 12 02:16:46.314802 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Oct 12 02:16:46.314802 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 109/215] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Oct 12 02:16:46 2022] GET /identity/v3/roles/reader => generated 84 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 02:16:46.314802 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28142639-1520-41c8-ab8f-d8ae7203f9f3 None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:16:46.325922 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5042428-8ee9-4bb2-9e14-049ee348c3f3 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:16:46.360444 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea1f720-2dfe-4f71-91bd-8b467f6bdda3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:16:46.361085 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea1f720-2dfe-4f71-91bd-8b467f6bdda3 None admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:16:46.361423 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea1f720-2dfe-4f71-91bd-8b467f6bdda3 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:16:46.361695 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea1f720-2dfe-4f71-91bd-8b467f6bdda3 None admin] PATH_INFO: `/v3/users` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:16:46.362349 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea1f720-2dfe-4f71-91bd-8b467f6bdda3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:16:46.363789 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea1f720-2dfe-4f71-91bd-8b467f6bdda3 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:16:46.386256 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 107/216] 10.222.0.18 () {60 vars in 1132 bytes} [Wed Oct 12 02:16:46 2022] POST /identity/v3/users => generated 293 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 02:16:46.391820 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea1f720-2dfe-4f71-91bd-8b467f6bdda3 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:16:46.420394 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28142639-1520-41c8-ab8f-d8ae7203f9f3 None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:16:46.460862 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c24ede-5a4c-48df-959c-a298bfe63fd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:16:46.461567 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c24ede-5a4c-48df-959c-a298bfe63fd5 None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:16:46.461855 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c24ede-5a4c-48df-959c-a298bfe63fd5 None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:16:46.462131 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c24ede-5a4c-48df-959c-a298bfe63fd5 None admin] PATH_INFO: `/v3/users/dc04b47661d44e49a1e11ad489b3fa0e` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:16:46.477838 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c24ede-5a4c-48df-959c-a298bfe63fd5 None admin] RBAC: Authorizing `identity:get_user(user_id=dc04b47661d44e49a1e11ad489b3fa0e)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:16:46.479365 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c24ede-5a4c-48df-959c-a298bfe63fd5 None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:16:46.481349 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 110/217] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Oct 12 02:16:46 2022] GET /identity/v3/users/dc04b47661d44e49a1e11ad489b3fa0e => generated 293 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 02:16:46.487116 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c24ede-5a4c-48df-959c-a298bfe63fd5 None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:16:46.510630 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea1f720-2dfe-4f71-91bd-8b467f6bdda3 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:16:46.521562 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:16:46.545580 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:16:46.551560 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1193ba7-25e0-44c7-9651-7dd1a753a848 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:16:46.552373 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1193ba7-25e0-44c7-9651-7dd1a753a848 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:16:46.552678 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1193ba7-25e0-44c7-9651-7dd1a753a848 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:16:46.553342 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1193ba7-25e0-44c7-9651-7dd1a753a848 None admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:16:46.553787 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1193ba7-25e0-44c7-9651-7dd1a753a848 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 02:16:46.554643 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1193ba7-25e0-44c7-9651-7dd1a753a848 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:16:46.556521 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1193ba7-25e0-44c7-9651-7dd1a753a848 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:16:46.569361 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 108/218] 10.222.0.18 () {56 vars in 1101 bytes} [Wed Oct 12 02:16:46 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 02:16:46.576023 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1193ba7-25e0-44c7-9651-7dd1a753a848 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:16:46.611405 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c24ede-5a4c-48df-959c-a298bfe63fd5 None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:16:46.655069 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccfc73d-fd24-4f6f-b328-e8b51478d91b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:16:46.656031 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccfc73d-fd24-4f6f-b328-e8b51478d91b None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:16:46.656560 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccfc73d-fd24-4f6f-b328-e8b51478d91b None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:16:46.657031 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccfc73d-fd24-4f6f-b328-e8b51478d91b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:16:46.657955 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ccfc73d-fd24-4f6f-b328-e8b51478d91b None admin] RBAC: Adding query filter params (role.id=3d75c4d7f1a849b9a771504d1583ab28, user.id=dc04b47661d44e49a1e11ad489b3fa0e, scope.system=all) {{(pid=81361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 02:16:46.658476 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ccfc73d-fd24-4f6f-b328-e8b51478d91b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:16:46.660114 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ccfc73d-fd24-4f6f-b328-e8b51478d91b None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:16:46.666625 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 111/219] 10.222.0.18 () {56 vars in 1308 bytes} [Wed Oct 12 02:16:46 2022] GET /identity/v3/role_assignments?user.id=dc04b47661d44e49a1e11ad489b3fa0e&scope.system=all&role.id=3d75c4d7f1a849b9a771504d1583ab28 => generated 226 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 02:16:46.692396 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1193ba7-25e0-44c7-9651-7dd1a753a848 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:16:46.737011 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7bed0f-f05c-43d9-a841-cba330e7a10f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:16:46.737666 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7bed0f-f05c-43d9-a841-cba330e7a10f None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:16:46.737940 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7bed0f-f05c-43d9-a841-cba330e7a10f None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:16:46.738211 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7bed0f-f05c-43d9-a841-cba330e7a10f None admin] PATH_INFO: `/v3/users/1da30b0296d84369b9f16138fb6c29bf` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:16:46.739561 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7bed0f-f05c-43d9-a841-cba330e7a10f None admin] RBAC: Authorizing `identity:get_user(user_id=1da30b0296d84369b9f16138fb6c29bf)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:16:46.741126 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7bed0f-f05c-43d9-a841-cba330e7a10f None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:16:46.744036 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 109/220] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Oct 12 02:16:46 2022] GET /identity/v3/users/1da30b0296d84369b9f16138fb6c29bf => generated 297 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 02:16:46.749493 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccfc73d-fd24-4f6f-b328-e8b51478d91b None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:16:46.859981 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:16:46.868328 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccfc73d-fd24-4f6f-b328-e8b51478d91b None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:16:46.903304 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56b4a72-4313-4dab-975f-4e632b11e4f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:16:46.903915 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56b4a72-4313-4dab-975f-4e632b11e4f4 None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:16:46.904191 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56b4a72-4313-4dab-975f-4e632b11e4f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:16:46.904460 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56b4a72-4313-4dab-975f-4e632b11e4f4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:16:46.974685 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56b4a72-4313-4dab-975f-4e632b11e4f4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:16:46.976596 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56b4a72-4313-4dab-975f-4e632b11e4f4 None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:16:47.074921 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:16:47.089720 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7bed0f-f05c-43d9-a841-cba330e7a10f None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:16:47.090782 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 112/221] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Oct 12 02:16:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Oct 12 02:16:47.159446 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:16:47.199554 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7bed0f-f05c-43d9-a841-cba330e7a10f None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:16:47.233888 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852326ea-aa3c-4d30-9af2-f918ad585532 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:16:47.234901 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852326ea-aa3c-4d30-9af2-f918ad585532 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:16:47.235371 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852326ea-aa3c-4d30-9af2-f918ad585532 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:16:47.235862 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852326ea-aa3c-4d30-9af2-f918ad585532 None admin] PATH_INFO: `/v3/projects/f4486b89b2274830aff946201a578806` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:16:47.237205 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852326ea-aa3c-4d30-9af2-f918ad585532 None admin] RBAC: Authorizing `identity:get_project(project_id=f4486b89b2274830aff946201a578806)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:16:47.238821 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852326ea-aa3c-4d30-9af2-f918ad585532 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:16:47.241014 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 110/222] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Oct 12 02:16:47 2022] GET /identity/v3/projects/f4486b89b2274830aff946201a578806 => generated 302 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 02:16:47.252500 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56b4a72-4313-4dab-975f-4e632b11e4f4 None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:16:47.354319 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56b4a72-4313-4dab-975f-4e632b11e4f4 None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:16:47.391331 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057567ed-3f0b-4dc4-b797-ccb0f59a8c1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:16:47.391952 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057567ed-3f0b-4dc4-b797-ccb0f59a8c1b None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:16:47.392233 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057567ed-3f0b-4dc4-b797-ccb0f59a8c1b None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:16:47.392524 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057567ed-3f0b-4dc4-b797-ccb0f59a8c1b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:16:47.393259 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057567ed-3f0b-4dc4-b797-ccb0f59a8c1b None admin] RBAC: Adding query filter params (role.id=3b01dfb837044fd5b3f01dbf63d8edd1, scope.project.id=f4486b89b2274830aff946201a578806, user.id=1da30b0296d84369b9f16138fb6c29bf) {{(pid=81361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 02:16:47.393569 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057567ed-3f0b-4dc4-b797-ccb0f59a8c1b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:16:47.395137 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057567ed-3f0b-4dc4-b797-ccb0f59a8c1b None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:16:47.401857 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 113/223] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Oct 12 02:16:47 2022] GET /identity/v3/role_assignments?user.id=1da30b0296d84369b9f16138fb6c29bf&scope.project.id=f4486b89b2274830aff946201a578806&role.id=3b01dfb837044fd5b3f01dbf63d8edd1 => generated 608 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 02:16:48.748939 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b254348f-0f52-472e-a270-3da10ee25dc6 None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:16:48.749468 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b254348f-0f52-472e-a270-3da10ee25dc6 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:16:48.749468 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b254348f-0f52-472e-a270-3da10ee25dc6 None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:16:48.751102 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 111/224] 10.222.0.18 () {54 vars in 927 bytes} [Wed Oct 12 02:16:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 02:16:48.756814 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45fdbb9-f54b-4045-8668-c976645ebed7 None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:16:48.757383 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45fdbb9-f54b-4045-8668-c976645ebed7 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:16:48.757462 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45fdbb9-f54b-4045-8668-c976645ebed7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:16:48.777610 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-d45fdbb9-f54b-4045-8668-c976645ebed7 None None] MFA Rules not processed for user `a326a5bb7364479382f528a592371656`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:16:48.778828 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-d45fdbb9-f54b-4045-8668-c976645ebed7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:16:48.811199 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283cd9c8-20fe-41be-abb9-7fbe98dcdf63 None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:16:48.811469 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283cd9c8-20fe-41be-abb9-7fbe98dcdf63 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:16:48.811645 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283cd9c8-20fe-41be-abb9-7fbe98dcdf63 None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:16:48.813132 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 112/225] 10.222.0.18 () {54 vars in 927 bytes} [Wed Oct 12 02:16:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 02:16:48.817798 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dc5277-945c-4d98-8539-a3be0a7fb751 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:16:48.818074 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dc5277-945c-4d98-8539-a3be0a7fb751 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:16:48.818343 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dc5277-945c-4d98-8539-a3be0a7fb751 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:16:48.836143 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-52dc5277-945c-4d98-8539-a3be0a7fb751 None None] MFA Rules not processed for user `a326a5bb7364479382f528a592371656`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:16:48.837355 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-52dc5277-945c-4d98-8539-a3be0a7fb751 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:16:48.840233 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:16:48.855399 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 114/226] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Oct 12 02:16:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 12 02:16:48.870848 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384a5b77-8ac0-4bc1-b6e4-89c684cab8f8 None None] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:16:48.871143 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384a5b77-8ac0-4bc1-b6e4-89c684cab8f8 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:16:48.871414 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384a5b77-8ac0-4bc1-b6e4-89c684cab8f8 None None] PATH_INFO: `/` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:16:48.872875 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 115/227] 10.222.0.18 () {54 vars in 927 bytes} [Wed Oct 12 02:16:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 12 02:16:48.877616 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a00549-749c-4521-8c33-b7e4b9769684 None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:16:48.877891 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a00549-749c-4521-8c33-b7e4b9769684 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:16:48.878163 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a00549-749c-4521-8c33-b7e4b9769684 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:16:48.895758 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-c1a00549-749c-4521-8c33-b7e4b9769684 None None] MFA Rules not processed for user `a326a5bb7364479382f528a592371656`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:16:48.896960 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-c1a00549-749c-4521-8c33-b7e4b9769684 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:16:48.918118 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 113/228] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Oct 12 02:16:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 12 02:16:48.965696 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 116/229] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Oct 12 02:16:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 12 02:16:49.121102 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52dc5277-945c-4d98-8539-a3be0a7fb751 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:16:49.179124 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:16:49.190671 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a00549-749c-4521-8c33-b7e4b9769684 None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:16:49.222004 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52dc5277-945c-4d98-8539-a3be0a7fb751 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:16:49.258007 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c988f18-c7fb-42f0-ad27-966bfc2656c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:16:49.258641 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c988f18-c7fb-42f0-ad27-966bfc2656c9 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:16:49.258916 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c988f18-c7fb-42f0-ad27-966bfc2656c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:16:49.259188 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c988f18-c7fb-42f0-ad27-966bfc2656c9 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:16:49.268933 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c988f18-c7fb-42f0-ad27-966bfc2656c9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 02:16:49.274341 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-3c988f18-c7fb-42f0-ad27-966bfc2656c9 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 12 02:16:49.274341 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 02:16:49.274341 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 02:16:49.274341 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 02:16:49.274341 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 02:16:49.274341 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 02:16:49.274341 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 02:16:49.274341 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 02:16:49.274341 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 02:16:49.274341 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 02:16:49.274341 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 02:16:49.274341 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 02:16:49.274341 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 12 02:16:49.274341 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 12 02:16:49.274341 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 12 02:16:49.274341 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 12 02:16:49.275254 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 12 02:16:49.275254 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 12 02:16:49.275254 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 12 02:16:49.275254 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 12 02:16:49.275254 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 02:16:49.275254 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 02:16:49.275254 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 02:16:49.275254 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 02:16:49.275254 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 02:16:49.275254 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 02:16:49.275254 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 02:16:49.275254 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Oct 12 02:16:49.275254 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 02:16:49.275254 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Oct 12 02:16:49.275254 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 02:16:49.275254 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 02:16:49.276087 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 02:16:49.276087 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Oct 12 02:16:49.276087 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 02:16:49.276087 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Oct 12 02:16:49.276087 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 12 02:16:49.276087 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 12 02:16:49.276087 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 12 02:16:49.276087 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 12 02:16:49.276087 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 12 02:16:49.276087 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 12 02:16:49.276087 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 12 02:16:49.276087 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Oct 12 02:16:49.276087 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 114/230] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Oct 12 02:16:49 2022] GET /identity/v3/roles/reader => generated 84 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 02:16:49.276777 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c988f18-c7fb-42f0-ad27-966bfc2656c9 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:16:49.298560 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a00549-749c-4521-8c33-b7e4b9769684 None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:16:49.315364 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:16:49.333897 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ef1d61-f757-48b1-811d-9697dc66199e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:16:49.334534 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ef1d61-f757-48b1-811d-9697dc66199e None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:16:49.334812 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ef1d61-f757-48b1-811d-9697dc66199e None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:16:49.335087 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ef1d61-f757-48b1-811d-9697dc66199e None admin] PATH_INFO: `/v3/domains/default` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:16:49.336898 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ef1d61-f757-48b1-811d-9697dc66199e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:16:49.338755 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ef1d61-f757-48b1-811d-9697dc66199e None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:16:49.340366 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 117/231] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Oct 12 02:16:49 2022] GET /identity/v3/domains/default => generated 199 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 02:16:49.341181 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ef1d61-f757-48b1-811d-9697dc66199e None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:16:49.378845 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c988f18-c7fb-42f0-ad27-966bfc2656c9 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:16:49.398519 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:16:49.412458 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1dfa47-c8f0-43f0-b86e-efeec32cf860 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:16:49.413105 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1dfa47-c8f0-43f0-b86e-efeec32cf860 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:16:49.414017 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1dfa47-c8f0-43f0-b86e-efeec32cf860 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:16:49.414501 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1dfa47-c8f0-43f0-b86e-efeec32cf860 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:16:49.424474 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1dfa47-c8f0-43f0-b86e-efeec32cf860 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 02:16:49.429385 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-4c1dfa47-c8f0-43f0-b86e-efeec32cf860 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 12 02:16:49.429385 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 02:16:49.429385 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 02:16:49.429385 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 02:16:49.429385 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 02:16:49.429385 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 02:16:49.429385 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 02:16:49.429385 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 02:16:49.429385 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 02:16:49.429385 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 02:16:49.429385 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 02:16:49.429385 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 02:16:49.429385 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 12 02:16:49.429385 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 12 02:16:49.429385 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 12 02:16:49.429385 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 12 02:16:49.430453 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 12 02:16:49.430453 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 12 02:16:49.430453 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 12 02:16:49.430453 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 12 02:16:49.430453 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 02:16:49.430453 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 02:16:49.430453 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 02:16:49.430453 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 02:16:49.430453 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 02:16:49.430453 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 02:16:49.430453 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 02:16:49.430453 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Oct 12 02:16:49.430453 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 02:16:49.430453 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Oct 12 02:16:49.430453 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 02:16:49.430453 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 02:16:49.431265 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 02:16:49.431265 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Oct 12 02:16:49.431265 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 02:16:49.431265 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Oct 12 02:16:49.431265 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 12 02:16:49.431265 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 12 02:16:49.431265 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 12 02:16:49.431265 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 12 02:16:49.431265 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 12 02:16:49.431265 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 12 02:16:49.431265 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 12 02:16:49.431265 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Oct 12 02:16:49.431265 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 115/232] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Oct 12 02:16:49 2022] GET /identity/v3/roles/member => generated 84 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 02:16:49.431936 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1dfa47-c8f0-43f0-b86e-efeec32cf860 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:16:49.442991 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ef1d61-f757-48b1-811d-9697dc66199e None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:16:49.477418 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926ba2bc-b0f9-4130-b2a9-6041ac886bb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:16:49.478028 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926ba2bc-b0f9-4130-b2a9-6041ac886bb6 None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:16:49.478316 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926ba2bc-b0f9-4130-b2a9-6041ac886bb6 None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:16:49.478589 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926ba2bc-b0f9-4130-b2a9-6041ac886bb6 None admin] PATH_INFO: `/v3/roles` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:16:49.479253 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926ba2bc-b0f9-4130-b2a9-6041ac886bb6 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 02:16:49.479557 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926ba2bc-b0f9-4130-b2a9-6041ac886bb6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:16:49.480973 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926ba2bc-b0f9-4130-b2a9-6041ac886bb6 None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:16:49.488995 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 118/233] 10.222.0.18 () {56 vars in 1101 bytes} [Wed Oct 12 02:16:49 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 02:16:49.489609 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926ba2bc-b0f9-4130-b2a9-6041ac886bb6 None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:16:49.535334 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1dfa47-c8f0-43f0-b86e-efeec32cf860 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:16:49.543609 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:16:49.569496 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0bff18-4fe0-4e5d-9af4-5ba188a7611d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:16:49.570615 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0bff18-4fe0-4e5d-9af4-5ba188a7611d None admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:16:49.570896 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0bff18-4fe0-4e5d-9af4-5ba188a7611d None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:16:49.571164 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0bff18-4fe0-4e5d-9af4-5ba188a7611d None admin] PATH_INFO: `/v3/groups` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:16:49.571792 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0bff18-4fe0-4e5d-9af4-5ba188a7611d None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:16:49.573276 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0bff18-4fe0-4e5d-9af4-5ba188a7611d None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:16:49.588528 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 116/234] 10.222.0.18 () {60 vars in 1134 bytes} [Wed Oct 12 02:16:49 2022] POST /identity/v3/groups => generated 229 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 02:16:49.588528 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0bff18-4fe0-4e5d-9af4-5ba188a7611d None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:16:49.596757 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926ba2bc-b0f9-4130-b2a9-6041ac886bb6 None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:16:49.638868 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a59d66-a012-4fc2-a59c-12f1316886ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:16:49.639371 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:16:49.639677 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a59d66-a012-4fc2-a59c-12f1316886ec None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:16:49.639959 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a59d66-a012-4fc2-a59c-12f1316886ec None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:16:49.640231 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a59d66-a012-4fc2-a59c-12f1316886ec None admin] PATH_INFO: `/v3/roles` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:16:49.641195 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a59d66-a012-4fc2-a59c-12f1316886ec None admin] RBAC: Adding query filter params (name=member) {{(pid=81361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 02:16:49.641322 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a59d66-a012-4fc2-a59c-12f1316886ec None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:16:49.642696 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a59d66-a012-4fc2-a59c-12f1316886ec None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:16:49.653243 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 119/235] 10.222.0.18 () {56 vars in 1101 bytes} [Wed Oct 12 02:16:49 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 02:16:49.659015 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a59d66-a012-4fc2-a59c-12f1316886ec None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:16:49.716965 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0bff18-4fe0-4e5d-9af4-5ba188a7611d None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:16:49.755025 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abeecb2-a07e-49f5-8367-14f5db693000 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:16:49.755704 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abeecb2-a07e-49f5-8367-14f5db693000 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:16:49.755947 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abeecb2-a07e-49f5-8367-14f5db693000 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:16:49.756211 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abeecb2-a07e-49f5-8367-14f5db693000 None admin] PATH_INFO: `/v3/users/2582397faa26450a8ee79196e3a298e7` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:16:49.772662 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abeecb2-a07e-49f5-8367-14f5db693000 None admin] RBAC: Authorizing `identity:get_user(user_id=2582397faa26450a8ee79196e3a298e7)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:16:49.774860 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abeecb2-a07e-49f5-8367-14f5db693000 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:16:49.777247 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 117/236] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Oct 12 02:16:49 2022] GET /identity/v3/users/2582397faa26450a8ee79196e3a298e7 => generated 293 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 02:16:49.782325 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a59d66-a012-4fc2-a59c-12f1316886ec None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:16:49.782844 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abeecb2-a07e-49f5-8367-14f5db693000 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:16:49.794296 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:16:49.822291 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adcb75a-e92f-4267-8106-16269c9ff726 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:16:49.823016 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adcb75a-e92f-4267-8106-16269c9ff726 None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:16:49.823363 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adcb75a-e92f-4267-8106-16269c9ff726 None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:16:49.823704 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adcb75a-e92f-4267-8106-16269c9ff726 None admin] PATH_INFO: `/v3/users/dc04b47661d44e49a1e11ad489b3fa0e` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:16:49.824973 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4adcb75a-e92f-4267-8106-16269c9ff726 None admin] RBAC: Authorizing `identity:get_user(user_id=dc04b47661d44e49a1e11ad489b3fa0e)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:16:49.826489 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4adcb75a-e92f-4267-8106-16269c9ff726 None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:16:49.828156 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 120/237] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Oct 12 02:16:49 2022] GET /identity/v3/users/dc04b47661d44e49a1e11ad489b3fa0e => generated 293 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 02:16:49.833955 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adcb75a-e92f-4267-8106-16269c9ff726 None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:16:49.887406 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:16:49.891961 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abeecb2-a07e-49f5-8367-14f5db693000 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:16:49.930950 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a848e1-9a27-4992-b0b5-19cfc7cce102 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:16:49.931682 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a848e1-9a27-4992-b0b5-19cfc7cce102 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:16:49.931960 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a848e1-9a27-4992-b0b5-19cfc7cce102 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:16:49.932227 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a848e1-9a27-4992-b0b5-19cfc7cce102 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:16:49.932989 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a848e1-9a27-4992-b0b5-19cfc7cce102 None admin] RBAC: Adding query filter params (role.id=3b01dfb837044fd5b3f01dbf63d8edd1, user.id=2582397faa26450a8ee79196e3a298e7, scope.system=all) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 02:16:49.933297 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a848e1-9a27-4992-b0b5-19cfc7cce102 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:16:49.934951 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a848e1-9a27-4992-b0b5-19cfc7cce102 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:16:49.940907 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 118/238] 10.222.0.18 () {56 vars in 1308 bytes} [Wed Oct 12 02:16:49 2022] GET /identity/v3/role_assignments?user.id=2582397faa26450a8ee79196e3a298e7&scope.system=all&role.id=3b01dfb837044fd5b3f01dbf63d8edd1 => generated 226 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 02:16:49.943284 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adcb75a-e92f-4267-8106-16269c9ff726 None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:16:49.981651 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87042df-7d15-41ee-8431-e33fe1157675 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:16:49.982334 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87042df-7d15-41ee-8431-e33fe1157675 None admin] REQUEST_METHOD: `PUT` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:16:49.982617 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87042df-7d15-41ee-8431-e33fe1157675 None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:16:49.982892 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87042df-7d15-41ee-8431-e33fe1157675 None admin] PATH_INFO: `/v3/system/users/dc04b47661d44e49a1e11ad489b3fa0e/roles/3d75c4d7f1a849b9a771504d1583ab28` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:16:49.984358 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87042df-7d15-41ee-8431-e33fe1157675 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=dc04b47661d44e49a1e11ad489b3fa0e, role_id=3d75c4d7f1a849b9a771504d1583ab28)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:16:49.985799 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87042df-7d15-41ee-8431-e33fe1157675 None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:16:49.996196 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 121/239] 10.222.0.18 () {58 vars in 1334 bytes} [Wed Oct 12 02:16:49 2022] PUT /identity/v3/system/users/dc04b47661d44e49a1e11ad489b3fa0e/roles/3d75c4d7f1a849b9a771504d1583ab28 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 02:16:51.784883 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ee48b7-9905-48b4-8fdd-ef1be45134d3 None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:16:51.785397 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ee48b7-9905-48b4-8fdd-ef1be45134d3 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:16:51.785471 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ee48b7-9905-48b4-8fdd-ef1be45134d3 None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:16:51.786915 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 119/240] 10.222.0.18 () {54 vars in 927 bytes} [Wed Oct 12 02:16:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 02:16:51.793065 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdd6c0d-1062-481d-b547-bc0dbb797eae None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:16:51.793479 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdd6c0d-1062-481d-b547-bc0dbb797eae None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:16:51.793553 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdd6c0d-1062-481d-b547-bc0dbb797eae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:16:51.811739 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-bcdd6c0d-1062-481d-b547-bc0dbb797eae None None] MFA Rules not processed for user `a326a5bb7364479382f528a592371656`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:16:51.812951 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-bcdd6c0d-1062-481d-b547-bc0dbb797eae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:16:51.849300 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:16:51.884241 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 122/241] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Oct 12 02:16:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 12 02:16:52.077271 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73486183-e2ca-4936-b4f5-9e16abbd475c None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:16:52.077599 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73486183-e2ca-4936-b4f5-9e16abbd475c None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:16:52.077769 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73486183-e2ca-4936-b4f5-9e16abbd475c None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:16:52.079195 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 120/242] 10.222.0.18 () {54 vars in 927 bytes} [Wed Oct 12 02:16:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 02:16:52.084229 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce3d0e2-f860-4dbc-b8ab-998365680250 None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:16:52.084551 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce3d0e2-f860-4dbc-b8ab-998365680250 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:16:52.084828 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce3d0e2-f860-4dbc-b8ab-998365680250 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:16:52.104172 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-6ce3d0e2-f860-4dbc-b8ab-998365680250 None None] MFA Rules not processed for user `a326a5bb7364479382f528a592371656`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:16:52.105491 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-6ce3d0e2-f860-4dbc-b8ab-998365680250 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:16:52.154497 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73486183-e2ca-4936-b4f5-9e16abbd475c None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:16:52.174280 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 123/243] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Oct 12 02:16:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 12 02:16:52.175581 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286f5972-89ab-45ba-9fb3-a955b79de657 None None] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:16:52.175866 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286f5972-89ab-45ba-9fb3-a955b79de657 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:16:52.176136 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286f5972-89ab-45ba-9fb3-a955b79de657 None None] PATH_INFO: `/` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:16:52.177392 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 124/244] 10.222.0.18 () {54 vars in 927 bytes} [Wed Oct 12 02:16:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 02:16:52.183137 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be2e3d4-53a8-4101-89a6-bf74c66a22c3 None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:16:52.183415 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be2e3d4-53a8-4101-89a6-bf74c66a22c3 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:16:52.183690 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be2e3d4-53a8-4101-89a6-bf74c66a22c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:16:52.202025 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-3be2e3d4-53a8-4101-89a6-bf74c66a22c3 None None] MFA Rules not processed for user `a326a5bb7364479382f528a592371656`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:16:52.203302 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-3be2e3d4-53a8-4101-89a6-bf74c66a22c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:16:52.262665 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73486183-e2ca-4936-b4f5-9e16abbd475c None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:16:52.272172 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 125/245] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Oct 12 02:16:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 12 02:16:52.297603 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9af65ef-ffdc-4749-9c3b-c35313900afb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:16:52.298231 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9af65ef-ffdc-4749-9c3b-c35313900afb None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:16:52.298507 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9af65ef-ffdc-4749-9c3b-c35313900afb None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:16:52.298774 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9af65ef-ffdc-4749-9c3b-c35313900afb None admin] PATH_INFO: `/v3/domains/default` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:16:52.299934 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9af65ef-ffdc-4749-9c3b-c35313900afb None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:16:52.301433 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9af65ef-ffdc-4749-9c3b-c35313900afb None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:16:52.303137 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 121/246] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Oct 12 02:16:52 2022] GET /identity/v3/domains/default => generated 199 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 02:16:52.309131 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be2e3d4-53a8-4101-89a6-bf74c66a22c3 None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:16:52.340370 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:16:52.411566 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be2e3d4-53a8-4101-89a6-bf74c66a22c3 None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:16:52.445093 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9af65ef-ffdc-4749-9c3b-c35313900afb None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:16:52.446544 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c0a5b5-333e-4604-b551-cfb7b9c2f145 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:16:52.447168 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c0a5b5-333e-4604-b551-cfb7b9c2f145 None admin] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:16:52.447448 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c0a5b5-333e-4604-b551-cfb7b9c2f145 None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:16:52.447715 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c0a5b5-333e-4604-b551-cfb7b9c2f145 None admin] PATH_INFO: `/v3/groups` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:16:52.448358 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c0a5b5-333e-4604-b551-cfb7b9c2f145 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:16:52.449845 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c0a5b5-333e-4604-b551-cfb7b9c2f145 None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:16:52.469569 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 126/247] 10.222.0.18 () {60 vars in 1134 bytes} [Wed Oct 12 02:16:52 2022] POST /identity/v3/groups => generated 226 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 02:16:52.481113 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:16:52.541689 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c0a5b5-333e-4604-b551-cfb7b9c2f145 None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:16:52.568406 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9af65ef-ffdc-4749-9c3b-c35313900afb None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:16:52.607651 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aab5dcc-d0fd-4ad7-b8ca-d481cf5dd8b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:16:52.608206 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aab5dcc-d0fd-4ad7-b8ca-d481cf5dd8b7 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:16:52.608501 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aab5dcc-d0fd-4ad7-b8ca-d481cf5dd8b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:16:52.608790 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aab5dcc-d0fd-4ad7-b8ca-d481cf5dd8b7 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:16:52.621028 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aab5dcc-d0fd-4ad7-b8ca-d481cf5dd8b7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 02:16:52.626251 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-0aab5dcc-d0fd-4ad7-b8ca-d481cf5dd8b7 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 12 02:16:52.626251 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 02:16:52.626251 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 02:16:52.626251 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 02:16:52.626251 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 02:16:52.626251 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 02:16:52.626251 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 02:16:52.626251 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 02:16:52.626251 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 02:16:52.626251 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 02:16:52.626251 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 02:16:52.626251 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 02:16:52.626251 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 12 02:16:52.626251 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 12 02:16:52.626251 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 12 02:16:52.626251 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 12 02:16:52.627156 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 12 02:16:52.627156 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 12 02:16:52.627156 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 12 02:16:52.627156 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 12 02:16:52.627156 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 02:16:52.627156 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 02:16:52.627156 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 02:16:52.627156 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 02:16:52.627156 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 02:16:52.627156 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 02:16:52.627156 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 02:16:52.627156 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Oct 12 02:16:52.627156 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 02:16:52.627156 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Oct 12 02:16:52.627156 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 02:16:52.627156 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 02:16:52.628145 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 02:16:52.628145 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Oct 12 02:16:52.628145 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 02:16:52.628145 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Oct 12 02:16:52.628145 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 12 02:16:52.628145 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 12 02:16:52.628145 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 12 02:16:52.628145 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 12 02:16:52.628145 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 12 02:16:52.628145 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 12 02:16:52.628145 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 12 02:16:52.628145 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Oct 12 02:16:52.628145 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 122/248] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Oct 12 02:16:52 2022] GET /identity/v3/roles/reader => generated 84 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 12 02:16:52.636504 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aab5dcc-d0fd-4ad7-b8ca-d481cf5dd8b7 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:16:52.657292 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:16:52.669752 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c0a5b5-333e-4604-b551-cfb7b9c2f145 None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:16:52.713640 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81380e04-ec75-4572-9ac1-4b35ffb12ca1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:16:52.714279 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81380e04-ec75-4572-9ac1-4b35ffb12ca1 None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:16:52.714556 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81380e04-ec75-4572-9ac1-4b35ffb12ca1 None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:16:52.714827 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81380e04-ec75-4572-9ac1-4b35ffb12ca1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:16:52.729343 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81380e04-ec75-4572-9ac1-4b35ffb12ca1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 02:16:52.734224 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application [None req-81380e04-ec75-4572-9ac1-4b35ffb12ca1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 12 02:16:52.734224 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 02:16:52.734224 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 02:16:52.734224 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 02:16:52.734224 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 02:16:52.734224 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 02:16:52.734224 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 02:16:52.734224 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 02:16:52.734224 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 02:16:52.734224 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 02:16:52.734224 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 02:16:52.734224 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 02:16:52.734224 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 12 02:16:52.734224 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 12 02:16:52.734224 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 12 02:16:52.734224 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 12 02:16:52.735103 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 12 02:16:52.735103 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 12 02:16:52.735103 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 12 02:16:52.735103 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 12 02:16:52.735103 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 02:16:52.735103 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 02:16:52.735103 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 02:16:52.735103 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 02:16:52.735103 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 02:16:52.735103 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 02:16:52.735103 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 02:16:52.735103 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application with Lock( Oct 12 02:16:52.735103 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 02:16:52.735103 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._enter() Oct 12 02:16:52.735103 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 02:16:52.735103 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 02:16:52.735916 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 02:16:52.735916 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.creator() Oct 12 02:16:52.735916 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 02:16:52.735916 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application created_value = creator( Oct 12 02:16:52.735916 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 12 02:16:52.735916 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 12 02:16:52.735916 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 12 02:16:52.735916 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 12 02:16:52.735916 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 12 02:16:52.735916 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 12 02:16:52.735916 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 12 02:16:52.735916 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Oct 12 02:16:52.735916 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 127/249] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Oct 12 02:16:52 2022] GET /identity/v3/roles/member => generated 84 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 02:16:52.741436 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81380e04-ec75-4572-9ac1-4b35ffb12ca1 None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:16:52.746974 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:16:52.758761 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aab5dcc-d0fd-4ad7-b8ca-d481cf5dd8b7 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:16:52.803526 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9673f0-b90d-48c0-a0ef-64224af8e05c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:16:52.805558 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9673f0-b90d-48c0-a0ef-64224af8e05c None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:16:52.805759 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9673f0-b90d-48c0-a0ef-64224af8e05c None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:16:52.806031 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9673f0-b90d-48c0-a0ef-64224af8e05c None admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:16:52.806707 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9673f0-b90d-48c0-a0ef-64224af8e05c None admin] RBAC: Adding query filter params (name=reader) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 02:16:52.807009 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9673f0-b90d-48c0-a0ef-64224af8e05c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:16:52.809312 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9673f0-b90d-48c0-a0ef-64224af8e05c None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:16:52.818761 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 123/250] 10.222.0.18 () {56 vars in 1101 bytes} [Wed Oct 12 02:16:52 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 02:16:52.824401 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9673f0-b90d-48c0-a0ef-64224af8e05c None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:16:52.871860 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81380e04-ec75-4572-9ac1-4b35ffb12ca1 None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:16:52.934490 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ebe4c8-67fc-4e3c-b7fa-085b33a60cff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:16:52.935215 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ebe4c8-67fc-4e3c-b7fa-085b33a60cff None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:16:52.935498 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ebe4c8-67fc-4e3c-b7fa-085b33a60cff None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:16:52.935799 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ebe4c8-67fc-4e3c-b7fa-085b33a60cff None admin] PATH_INFO: `/v3/roles` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:16:52.936555 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ebe4c8-67fc-4e3c-b7fa-085b33a60cff None admin] RBAC: Adding query filter params (name=member) {{(pid=81361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 02:16:52.936863 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ebe4c8-67fc-4e3c-b7fa-085b33a60cff None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:16:52.938357 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ebe4c8-67fc-4e3c-b7fa-085b33a60cff None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:16:52.945485 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9673f0-b90d-48c0-a0ef-64224af8e05c None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:16:52.948923 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 128/251] 10.222.0.18 () {56 vars in 1101 bytes} [Wed Oct 12 02:16:52 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 02:16:52.954532 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ebe4c8-67fc-4e3c-b7fa-085b33a60cff None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:16:52.972590 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:16:52.982531 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd9b42c-63ce-4b1a-b932-c0756c3bef13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:16:52.983173 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd9b42c-63ce-4b1a-b932-c0756c3bef13 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:16:52.983452 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd9b42c-63ce-4b1a-b932-c0756c3bef13 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:16:52.983728 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd9b42c-63ce-4b1a-b932-c0756c3bef13 None admin] PATH_INFO: `/v3/users/2582397faa26450a8ee79196e3a298e7` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:16:52.985139 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd9b42c-63ce-4b1a-b932-c0756c3bef13 None admin] RBAC: Authorizing `identity:get_user(user_id=2582397faa26450a8ee79196e3a298e7)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:16:52.986580 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd9b42c-63ce-4b1a-b932-c0756c3bef13 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:16:52.988636 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 124/252] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Oct 12 02:16:52 2022] GET /identity/v3/users/2582397faa26450a8ee79196e3a298e7 => generated 293 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 02:16:52.997672 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd9b42c-63ce-4b1a-b932-c0756c3bef13 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:16:53.032826 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:16:53.097423 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ebe4c8-67fc-4e3c-b7fa-085b33a60cff None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:16:53.140904 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd9b42c-63ce-4b1a-b932-c0756c3bef13 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:16:53.143264 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94630fc3-baf0-4a54-bba8-ca402cae98e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:16:53.145027 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94630fc3-baf0-4a54-bba8-ca402cae98e1 None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:16:53.145458 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94630fc3-baf0-4a54-bba8-ca402cae98e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:16:53.145903 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94630fc3-baf0-4a54-bba8-ca402cae98e1 None admin] PATH_INFO: `/v3/users/dc04b47661d44e49a1e11ad489b3fa0e` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:16:53.147206 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94630fc3-baf0-4a54-bba8-ca402cae98e1 None admin] RBAC: Authorizing `identity:get_user(user_id=dc04b47661d44e49a1e11ad489b3fa0e)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:16:53.149530 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94630fc3-baf0-4a54-bba8-ca402cae98e1 None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:16:53.151920 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 129/253] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Oct 12 02:16:52 2022] GET /identity/v3/users/dc04b47661d44e49a1e11ad489b3fa0e => generated 293 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 02:16:53.158125 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94630fc3-baf0-4a54-bba8-ca402cae98e1 None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:16:53.190906 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e96941-cbb4-496f-a069-923eaa0cbdb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:16:53.191562 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e96941-cbb4-496f-a069-923eaa0cbdb4 None admin] REQUEST_METHOD: `PUT` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:16:53.191837 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e96941-cbb4-496f-a069-923eaa0cbdb4 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:16:53.192105 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e96941-cbb4-496f-a069-923eaa0cbdb4 None admin] PATH_INFO: `/v3/system/users/2582397faa26450a8ee79196e3a298e7/roles/3b01dfb837044fd5b3f01dbf63d8edd1` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:16:53.196633 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e96941-cbb4-496f-a069-923eaa0cbdb4 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=2582397faa26450a8ee79196e3a298e7, role_id=3b01dfb837044fd5b3f01dbf63d8edd1)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:16:53.197980 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e96941-cbb4-496f-a069-923eaa0cbdb4 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:16:53.211650 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 125/254] 10.222.0.18 () {58 vars in 1334 bytes} [Wed Oct 12 02:16:52 2022] PUT /identity/v3/system/users/2582397faa26450a8ee79196e3a298e7/roles/3b01dfb837044fd5b3f01dbf63d8edd1 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 02:16:53.284340 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:16:53.312400 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94630fc3-baf0-4a54-bba8-ca402cae98e1 None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:16:53.358242 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f90fef9-f6fe-45f1-b16a-773a22b30dcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:16:53.358866 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f90fef9-f6fe-45f1-b16a-773a22b30dcc None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:16:53.359143 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f90fef9-f6fe-45f1-b16a-773a22b30dcc None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:16:53.359409 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f90fef9-f6fe-45f1-b16a-773a22b30dcc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:16:53.360135 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f90fef9-f6fe-45f1-b16a-773a22b30dcc None admin] RBAC: Adding query filter params (role.id=3d75c4d7f1a849b9a771504d1583ab28, user.id=dc04b47661d44e49a1e11ad489b3fa0e, scope.system=all) {{(pid=81361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 02:16:53.360437 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f90fef9-f6fe-45f1-b16a-773a22b30dcc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:16:53.361916 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f90fef9-f6fe-45f1-b16a-773a22b30dcc None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:16:53.378142 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 130/255] 10.222.0.18 () {56 vars in 1308 bytes} [Wed Oct 12 02:16:53 2022] GET /identity/v3/role_assignments?user.id=dc04b47661d44e49a1e11ad489b3fa0e&scope.system=all&role.id=3d75c4d7f1a849b9a771504d1583ab28 => generated 510 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 02:16:55.198631 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8464d5-7245-4629-ae3f-aa2b333ee492 None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:16:55.199176 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8464d5-7245-4629-ae3f-aa2b333ee492 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:16:55.199176 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8464d5-7245-4629-ae3f-aa2b333ee492 None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:16:55.200678 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 126/256] 10.222.0.18 () {54 vars in 927 bytes} [Wed Oct 12 02:16:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 02:16:55.214421 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9161469d-5b3a-4a2d-b028-f74ae53cb63a None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:16:55.215334 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9161469d-5b3a-4a2d-b028-f74ae53cb63a None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:16:55.215815 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9161469d-5b3a-4a2d-b028-f74ae53cb63a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:16:55.244755 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-9161469d-5b3a-4a2d-b028-f74ae53cb63a None None] MFA Rules not processed for user `a326a5bb7364479382f528a592371656`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:16:55.246287 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-9161469d-5b3a-4a2d-b028-f74ae53cb63a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:16:55.314112 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 131/257] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Oct 12 02:16:55 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Oct 12 02:16:55.340287 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226574de-59a3-4135-9daf-9480370fe53b None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:16:55.340635 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226574de-59a3-4135-9daf-9480370fe53b None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:16:55.340918 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226574de-59a3-4135-9daf-9480370fe53b None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:16:55.342290 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 127/258] 10.222.0.18 () {54 vars in 927 bytes} [Wed Oct 12 02:16:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 02:16:55.347716 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521bb14b-798b-4233-a767-1165b575f9da None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:16:55.348229 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521bb14b-798b-4233-a767-1165b575f9da None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:16:55.348714 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521bb14b-798b-4233-a767-1165b575f9da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:16:55.389411 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-521bb14b-798b-4233-a767-1165b575f9da None None] MFA Rules not processed for user `a326a5bb7364479382f528a592371656`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:16:55.390912 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-521bb14b-798b-4233-a767-1165b575f9da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:16:55.399679 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 132/259] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Oct 12 02:16:55 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Oct 12 02:16:55.848378 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226574de-59a3-4135-9daf-9480370fe53b None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:16:55.864503 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226574de-59a3-4135-9daf-9480370fe53b None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:16:55.871033 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa4bc3e-422d-44ad-8e78-6b23b0f7aecb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:16:55.871675 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa4bc3e-422d-44ad-8e78-6b23b0f7aecb admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:16:55.871951 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa4bc3e-422d-44ad-8e78-6b23b0f7aecb admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:16:55.872220 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa4bc3e-422d-44ad-8e78-6b23b0f7aecb admin admin] PATH_INFO: `/v3/roles/member` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:16:55.890067 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa4bc3e-422d-44ad-8e78-6b23b0f7aecb admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 02:16:55.895101 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-aaa4bc3e-422d-44ad-8e78-6b23b0f7aecb admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 12 02:16:55.895101 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 02:16:55.895101 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 02:16:55.895101 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 02:16:55.895101 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 02:16:55.895101 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 02:16:55.895101 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 02:16:55.895101 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 02:16:55.895101 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 02:16:55.895101 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 02:16:55.895101 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 02:16:55.895101 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 02:16:55.895101 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 12 02:16:55.895101 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 12 02:16:55.895101 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 12 02:16:55.895101 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 12 02:16:55.895969 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 12 02:16:55.895969 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 12 02:16:55.895969 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 12 02:16:55.895969 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 12 02:16:55.895969 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 02:16:55.895969 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 02:16:55.895969 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 02:16:55.895969 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 02:16:55.895969 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 02:16:55.895969 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 02:16:55.895969 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 02:16:55.895969 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Oct 12 02:16:55.895969 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 02:16:55.895969 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Oct 12 02:16:55.895969 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 02:16:55.895969 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 02:16:55.898400 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 02:16:55.898400 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Oct 12 02:16:55.898400 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 02:16:55.898400 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Oct 12 02:16:55.898400 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 12 02:16:55.898400 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 12 02:16:55.898400 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 12 02:16:55.898400 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 12 02:16:55.898400 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 12 02:16:55.898400 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 12 02:16:55.898400 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 12 02:16:55.898400 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Oct 12 02:16:55.898400 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 128/260] 10.222.0.18 () {56 vars in 1120 bytes} [Wed Oct 12 02:16:55 2022] GET /identity/v3/roles/member => generated 84 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 02:16:55.902589 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521bb14b-798b-4233-a767-1165b575f9da None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:16:55.907223 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa4bc3e-422d-44ad-8e78-6b23b0f7aecb admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:16:55.917729 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521bb14b-798b-4233-a767-1165b575f9da None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:16:55.920020 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa4bc3e-422d-44ad-8e78-6b23b0f7aecb admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:16:55.929178 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9535b907-1b9d-4c1e-a781-7f75a51b2eb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:16:55.930460 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9535b907-1b9d-4c1e-a781-7f75a51b2eb9 admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:16:55.930748 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9535b907-1b9d-4c1e-a781-7f75a51b2eb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:16:55.931025 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9535b907-1b9d-4c1e-a781-7f75a51b2eb9 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:16:55.937695 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a4694c-d5e6-447a-b297-cfeb84861ac4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:16:55.938320 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a4694c-d5e6-447a-b297-cfeb84861ac4 admin admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:16:55.938594 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a4694c-d5e6-447a-b297-cfeb84861ac4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:16:55.938858 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a4694c-d5e6-447a-b297-cfeb84861ac4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:16:55.939529 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a4694c-d5e6-447a-b297-cfeb84861ac4 admin admin] RBAC: Adding query filter params (name=member) {{(pid=81361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 02:16:55.939826 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a4694c-d5e6-447a-b297-cfeb84861ac4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:16:55.941663 dv-cinder-849143-14-smb devstack@keystone.service[81361]: WARNING py.warnings [None req-b8a4694c-d5e6-447a-b297-cfeb84861ac4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 12 02:16:55.941663 dv-cinder-849143-14-smb devstack@keystone.service[81361]: warnings.warn(msg) Oct 12 02:16:55.941663 dv-cinder-849143-14-smb devstack@keystone.service[81361]: Oct 12 02:16:55.942580 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a4694c-d5e6-447a-b297-cfeb84861ac4 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:16:55.950551 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9535b907-1b9d-4c1e-a781-7f75a51b2eb9 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 02:16:55.965893 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-9535b907-1b9d-4c1e-a781-7f75a51b2eb9 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 12 02:16:55.965893 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 02:16:55.965893 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 02:16:55.965893 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 02:16:55.965893 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 02:16:55.965893 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 02:16:55.965893 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 02:16:55.965893 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 02:16:55.965893 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 02:16:55.965893 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 02:16:55.965893 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 02:16:55.965893 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 02:16:55.965893 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 12 02:16:55.965893 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 12 02:16:55.965893 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 12 02:16:55.965893 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 12 02:16:55.966810 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 12 02:16:55.966810 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 12 02:16:55.966810 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 12 02:16:55.966810 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 12 02:16:55.966810 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 02:16:55.966810 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 02:16:55.966810 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 02:16:55.966810 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 02:16:55.966810 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 02:16:55.966810 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 02:16:55.966810 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 02:16:55.966810 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Oct 12 02:16:55.966810 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 02:16:55.966810 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Oct 12 02:16:55.966810 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 02:16:55.966810 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 02:16:55.967619 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 02:16:55.967619 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Oct 12 02:16:55.967619 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 02:16:55.967619 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Oct 12 02:16:55.967619 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 12 02:16:55.967619 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 12 02:16:55.967619 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 12 02:16:55.967619 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 12 02:16:55.967619 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 12 02:16:55.967619 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 12 02:16:55.967619 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 12 02:16:55.967619 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Oct 12 02:16:55.967619 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 129/261] 10.222.0.18 () {56 vars in 1135 bytes} [Wed Oct 12 02:16:55 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 12 02:16:55.970161 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 133/262] 10.222.0.18 () {56 vars in 1122 bytes} [Wed Oct 12 02:16:55 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 02:16:55.972740 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9535b907-1b9d-4c1e-a781-7f75a51b2eb9 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:16:55.976205 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a4694c-d5e6-447a-b297-cfeb84861ac4 admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:16:55.983634 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9535b907-1b9d-4c1e-a781-7f75a51b2eb9 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:16:55.988918 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bc1ac4-28b1-4d65-a303-37ecef53b227 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:16:55.989527 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bc1ac4-28b1-4d65-a303-37ecef53b227 admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:16:55.989805 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bc1ac4-28b1-4d65-a303-37ecef53b227 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:16:55.990074 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bc1ac4-28b1-4d65-a303-37ecef53b227 admin admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:16:55.990746 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84bc1ac4-28b1-4d65-a303-37ecef53b227 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 02:16:55.991609 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84bc1ac4-28b1-4d65-a303-37ecef53b227 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:16:55.994307 dv-cinder-849143-14-smb devstack@keystone.service[81362]: WARNING py.warnings [None req-84bc1ac4-28b1-4d65-a303-37ecef53b227 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 12 02:16:55.994307 dv-cinder-849143-14-smb devstack@keystone.service[81362]: warnings.warn(msg) Oct 12 02:16:55.994307 dv-cinder-849143-14-smb devstack@keystone.service[81362]: Oct 12 02:16:55.995223 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84bc1ac4-28b1-4d65-a303-37ecef53b227 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:16:55.996092 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a4694c-d5e6-447a-b297-cfeb84861ac4 admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:16:56.006210 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 130/263] 10.222.0.18 () {56 vars in 1132 bytes} [Wed Oct 12 02:16:55 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 02:16:56.009184 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e94a981-40b8-46cb-bd01-29b9d37d0699 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:16:56.009839 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e94a981-40b8-46cb-bd01-29b9d37d0699 admin admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:16:56.010120 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e94a981-40b8-46cb-bd01-29b9d37d0699 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:16:56.010397 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e94a981-40b8-46cb-bd01-29b9d37d0699 admin admin] PATH_INFO: `/v3/groups/2b5d93df759a456ab6de5b455fae6322` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:16:56.012564 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bc1ac4-28b1-4d65-a303-37ecef53b227 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:16:56.029193 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e94a981-40b8-46cb-bd01-29b9d37d0699 admin admin] RBAC: Authorizing `identity:get_group(group_id=2b5d93df759a456ab6de5b455fae6322)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:16:56.029487 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bc1ac4-28b1-4d65-a303-37ecef53b227 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:16:56.030248 dv-cinder-849143-14-smb devstack@keystone.service[81361]: WARNING py.warnings [None req-1e94a981-40b8-46cb-bd01-29b9d37d0699 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 12 02:16:56.030248 dv-cinder-849143-14-smb devstack@keystone.service[81361]: warnings.warn(msg) Oct 12 02:16:56.030248 dv-cinder-849143-14-smb devstack@keystone.service[81361]: Oct 12 02:16:56.031481 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e94a981-40b8-46cb-bd01-29b9d37d0699 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:16:56.033527 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 134/264] 10.222.0.18 () {56 vars in 1201 bytes} [Wed Oct 12 02:16:55 2022] GET /identity/v3/groups/2b5d93df759a456ab6de5b455fae6322 => generated 226 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 02:16:56.035037 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d639c9fb-b883-4277-bccf-a8650de9ec7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:16:56.035737 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d639c9fb-b883-4277-bccf-a8650de9ec7c admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:16:56.036017 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d639c9fb-b883-4277-bccf-a8650de9ec7c admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:16:56.036332 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d639c9fb-b883-4277-bccf-a8650de9ec7c admin admin] PATH_INFO: `/v3/groups/2b5d93df759a456ab6de5b455fae6322` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:16:56.038987 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d639c9fb-b883-4277-bccf-a8650de9ec7c admin admin] RBAC: Authorizing `identity:get_group(group_id=2b5d93df759a456ab6de5b455fae6322)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:16:56.039215 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e94a981-40b8-46cb-bd01-29b9d37d0699 admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:16:56.040073 dv-cinder-849143-14-smb devstack@keystone.service[81362]: WARNING py.warnings [None req-d639c9fb-b883-4277-bccf-a8650de9ec7c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 12 02:16:56.040073 dv-cinder-849143-14-smb devstack@keystone.service[81362]: warnings.warn(msg) Oct 12 02:16:56.040073 dv-cinder-849143-14-smb devstack@keystone.service[81362]: Oct 12 02:16:56.041405 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d639c9fb-b883-4277-bccf-a8650de9ec7c admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:16:56.047358 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 131/265] 10.222.0.18 () {56 vars in 1201 bytes} [Wed Oct 12 02:16:56 2022] GET /identity/v3/groups/2b5d93df759a456ab6de5b455fae6322 => generated 226 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 02:16:56.048435 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d639c9fb-b883-4277-bccf-a8650de9ec7c admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:16:56.053376 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e94a981-40b8-46cb-bd01-29b9d37d0699 admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:16:56.062782 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d639c9fb-b883-4277-bccf-a8650de9ec7c admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:16:56.073414 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaea36e5-091a-41c2-8cd1-442b19f1c1b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:16:56.073729 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2c36f5-6b4a-4442-8cc8-c702eaad588d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:16:56.074124 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaea36e5-091a-41c2-8cd1-442b19f1c1b7 admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:16:56.074384 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2c36f5-6b4a-4442-8cc8-c702eaad588d admin admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:16:56.074549 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaea36e5-091a-41c2-8cd1-442b19f1c1b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:16:56.074693 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaea36e5-091a-41c2-8cd1-442b19f1c1b7 admin admin] PATH_INFO: `/v3/projects/fd1c4db151454810bdf01c589c22b7b7` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:16:56.074854 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2c36f5-6b4a-4442-8cc8-c702eaad588d admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:16:56.074995 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2c36f5-6b4a-4442-8cc8-c702eaad588d admin admin] PATH_INFO: `/v3/projects/fd1c4db151454810bdf01c589c22b7b7` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:16:56.077763 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaea36e5-091a-41c2-8cd1-442b19f1c1b7 admin admin] RBAC: Authorizing `identity:get_project(project_id=fd1c4db151454810bdf01c589c22b7b7)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:16:56.080091 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaea36e5-091a-41c2-8cd1-442b19f1c1b7 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:16:56.081192 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2c36f5-6b4a-4442-8cc8-c702eaad588d admin admin] RBAC: Authorizing `identity:get_project(project_id=fd1c4db151454810bdf01c589c22b7b7)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:16:56.082007 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 132/266] 10.222.0.18 () {56 vars in 1207 bytes} [Wed Oct 12 02:16:56 2022] GET /identity/v3/projects/fd1c4db151454810bdf01c589c22b7b7 => generated 298 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 02:16:56.083307 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2c36f5-6b4a-4442-8cc8-c702eaad588d admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:16:56.086775 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 135/267] 10.222.0.18 () {56 vars in 1207 bytes} [Wed Oct 12 02:16:56 2022] GET /identity/v3/projects/fd1c4db151454810bdf01c589c22b7b7 => generated 298 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 02:16:56.088929 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaea36e5-091a-41c2-8cd1-442b19f1c1b7 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:16:56.092400 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2c36f5-6b4a-4442-8cc8-c702eaad588d admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:16:56.099686 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaea36e5-091a-41c2-8cd1-442b19f1c1b7 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:16:56.110113 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bafb93-21f9-4b3f-a343-afafafd6f83a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:16:56.110497 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2c36f5-6b4a-4442-8cc8-c702eaad588d admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:16:56.110830 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bafb93-21f9-4b3f-a343-afafafd6f83a admin admin] REQUEST_METHOD: `PUT` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:16:56.111074 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bafb93-21f9-4b3f-a343-afafafd6f83a admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:16:56.111391 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bafb93-21f9-4b3f-a343-afafafd6f83a admin admin] PATH_INFO: `/v3/projects/fd1c4db151454810bdf01c589c22b7b7/groups/2b5d93df759a456ab6de5b455fae6322/roles/7b67553aa5874cca8c47e5fb5ffa1971` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:16:56.114863 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6bafb93-21f9-4b3f-a343-afafafd6f83a admin admin] RBAC: Authorizing `identity:create_grant(project_id=fd1c4db151454810bdf01c589c22b7b7, group_id=2b5d93df759a456ab6de5b455fae6322, role_id=7b67553aa5874cca8c47e5fb5ffa1971)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:16:56.117058 dv-cinder-849143-14-smb devstack@keystone.service[81362]: WARNING py.warnings [None req-f6bafb93-21f9-4b3f-a343-afafafd6f83a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 12 02:16:56.117058 dv-cinder-849143-14-smb devstack@keystone.service[81362]: warnings.warn(msg) Oct 12 02:16:56.117058 dv-cinder-849143-14-smb devstack@keystone.service[81362]: Oct 12 02:16:56.119497 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6bafb93-21f9-4b3f-a343-afafafd6f83a admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:16:56.120576 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585fce7d-4ca3-4d58-8c68-716c72c13c87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:16:56.121255 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585fce7d-4ca3-4d58-8c68-716c72c13c87 admin admin] REQUEST_METHOD: `PUT` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:16:56.121531 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585fce7d-4ca3-4d58-8c68-716c72c13c87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:16:56.121803 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585fce7d-4ca3-4d58-8c68-716c72c13c87 admin admin] PATH_INFO: `/v3/projects/fd1c4db151454810bdf01c589c22b7b7/groups/2b5d93df759a456ab6de5b455fae6322/roles/3d75c4d7f1a849b9a771504d1583ab28` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:16:56.123865 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585fce7d-4ca3-4d58-8c68-716c72c13c87 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fd1c4db151454810bdf01c589c22b7b7, group_id=2b5d93df759a456ab6de5b455fae6322, role_id=3d75c4d7f1a849b9a771504d1583ab28)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:16:56.124949 dv-cinder-849143-14-smb devstack@keystone.service[81361]: WARNING py.warnings [None req-585fce7d-4ca3-4d58-8c68-716c72c13c87 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 12 02:16:56.124949 dv-cinder-849143-14-smb devstack@keystone.service[81361]: warnings.warn(msg) Oct 12 02:16:56.124949 dv-cinder-849143-14-smb devstack@keystone.service[81361]: Oct 12 02:16:56.126907 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585fce7d-4ca3-4d58-8c68-716c72c13c87 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:16:56.145231 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 133/268] 10.222.0.18 () {58 vars in 1463 bytes} [Wed Oct 12 02:16:56 2022] PUT /identity/v3/projects/fd1c4db151454810bdf01c589c22b7b7/groups/2b5d93df759a456ab6de5b455fae6322/roles/7b67553aa5874cca8c47e5fb5ffa1971 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 02:16:56.148834 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 136/269] 10.222.0.18 () {58 vars in 1463 bytes} [Wed Oct 12 02:16:56 2022] PUT /identity/v3/projects/fd1c4db151454810bdf01c589c22b7b7/groups/2b5d93df759a456ab6de5b455fae6322/roles/3d75c4d7f1a849b9a771504d1583ab28 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 02:16:56.347087 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afe0720-fb4b-41cc-8807-6cb366654499 None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:16:56.347613 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afe0720-fb4b-41cc-8807-6cb366654499 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:16:56.347613 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afe0720-fb4b-41cc-8807-6cb366654499 None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:16:56.349272 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 134/270] 10.222.0.18 () {54 vars in 927 bytes} [Wed Oct 12 02:16:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 02:16:56.356429 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4855fcb6-ff1d-408b-84cf-5f536b6fec90 None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:16:56.356930 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4855fcb6-ff1d-408b-84cf-5f536b6fec90 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:16:56.357031 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4855fcb6-ff1d-408b-84cf-5f536b6fec90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:16:56.379208 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-4855fcb6-ff1d-408b-84cf-5f536b6fec90 None None] MFA Rules not processed for user `a326a5bb7364479382f528a592371656`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:16:56.380505 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-4855fcb6-ff1d-408b-84cf-5f536b6fec90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:16:56.411367 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3bd3bd-de48-47b4-b050-22094932daea None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:16:56.411687 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3bd3bd-de48-47b4-b050-22094932daea None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:16:56.411917 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3bd3bd-de48-47b4-b050-22094932daea None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:16:56.415843 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 135/271] 10.222.0.18 () {54 vars in 927 bytes} [Wed Oct 12 02:16:56 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 12 02:16:56.424373 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a26cf0f-1795-4839-b0aa-821166ccf1be None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:16:56.424716 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a26cf0f-1795-4839-b0aa-821166ccf1be None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:16:56.424952 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a26cf0f-1795-4839-b0aa-821166ccf1be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:16:56.462112 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:16:56.462300 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-9a26cf0f-1795-4839-b0aa-821166ccf1be None None] MFA Rules not processed for user `a326a5bb7364479382f528a592371656`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:16:56.463443 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-9a26cf0f-1795-4839-b0aa-821166ccf1be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:16:56.495829 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 137/272] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Oct 12 02:16:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 12 02:16:56.513517 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:16:56.566005 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 136/273] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Oct 12 02:16:56 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Oct 12 02:16:56.822836 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4855fcb6-ff1d-408b-84cf-5f536b6fec90 None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:16:56.872508 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fb75a7-1134-4f60-a0fa-6b79c8d709be None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:16:56.872854 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fb75a7-1134-4f60-a0fa-6b79c8d709be None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:16:56.873074 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fb75a7-1134-4f60-a0fa-6b79c8d709be None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:16:56.874433 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 137/274] 10.222.0.18 () {54 vars in 927 bytes} [Wed Oct 12 02:16:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 02:16:56.879670 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b68e3b-333a-4268-a3ae-3cf340123c35 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:16:56.879953 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b68e3b-333a-4268-a3ae-3cf340123c35 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:16:56.880226 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b68e3b-333a-4268-a3ae-3cf340123c35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:16:56.917580 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-43b68e3b-333a-4268-a3ae-3cf340123c35 None None] MFA Rules not processed for user `a326a5bb7364479382f528a592371656`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:16:56.918813 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-43b68e3b-333a-4268-a3ae-3cf340123c35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:16:56.938357 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 138/275] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Oct 12 02:16:56 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Oct 12 02:16:56.976135 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4855fcb6-ff1d-408b-84cf-5f536b6fec90 None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:16:57.037196 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50810bf1-e6c8-4cb5-b554-e44325da7efa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:16:57.038349 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50810bf1-e6c8-4cb5-b554-e44325da7efa None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:16:57.038632 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50810bf1-e6c8-4cb5-b554-e44325da7efa None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:16:57.038895 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50810bf1-e6c8-4cb5-b554-e44325da7efa None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:16:57.053742 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50810bf1-e6c8-4cb5-b554-e44325da7efa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 02:16:57.058605 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application [None req-50810bf1-e6c8-4cb5-b554-e44325da7efa None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 12 02:16:57.058605 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 02:16:57.058605 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 02:16:57.058605 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 02:16:57.058605 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 02:16:57.058605 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 02:16:57.058605 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 02:16:57.058605 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 02:16:57.058605 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 02:16:57.058605 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 02:16:57.058605 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 02:16:57.058605 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 02:16:57.058605 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 12 02:16:57.058605 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 12 02:16:57.058605 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 12 02:16:57.058605 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 12 02:16:57.059532 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 12 02:16:57.059532 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 12 02:16:57.059532 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 12 02:16:57.059532 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 12 02:16:57.059532 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 02:16:57.059532 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 02:16:57.059532 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 02:16:57.059532 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 02:16:57.059532 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 02:16:57.059532 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 02:16:57.059532 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 02:16:57.059532 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application with Lock( Oct 12 02:16:57.059532 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 02:16:57.059532 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._enter() Oct 12 02:16:57.059532 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 02:16:57.059532 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 02:16:57.060367 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 02:16:57.060367 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.creator() Oct 12 02:16:57.060367 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 02:16:57.060367 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application created_value = creator( Oct 12 02:16:57.060367 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 12 02:16:57.060367 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 12 02:16:57.060367 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 12 02:16:57.060367 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 12 02:16:57.060367 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 12 02:16:57.060367 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 12 02:16:57.060367 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 12 02:16:57.060367 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Oct 12 02:16:57.060367 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 138/276] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Oct 12 02:16:56 2022] GET /identity/v3/roles/reader => generated 84 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 02:16:57.068230 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b68e3b-333a-4268-a3ae-3cf340123c35 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:16:57.092617 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50810bf1-e6c8-4cb5-b554-e44325da7efa None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:16:57.109528 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50810bf1-e6c8-4cb5-b554-e44325da7efa None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:16:57.117577 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1698b2a7-b7eb-4f5c-bbed-03d04a7781d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:16:57.118215 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1698b2a7-b7eb-4f5c-bbed-03d04a7781d1 admin admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:16:57.118491 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1698b2a7-b7eb-4f5c-bbed-03d04a7781d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:16:57.118761 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1698b2a7-b7eb-4f5c-bbed-03d04a7781d1 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:16:57.139220 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1698b2a7-b7eb-4f5c-bbed-03d04a7781d1 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 02:16:57.149328 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application [None req-1698b2a7-b7eb-4f5c-bbed-03d04a7781d1 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 12 02:16:57.149328 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 02:16:57.149328 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 02:16:57.149328 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 02:16:57.149328 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 02:16:57.149328 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 02:16:57.149328 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 02:16:57.149328 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 02:16:57.149328 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 02:16:57.149328 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 02:16:57.149328 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 02:16:57.149328 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 02:16:57.149328 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 12 02:16:57.149328 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 12 02:16:57.149328 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 12 02:16:57.149328 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 12 02:16:57.150267 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 12 02:16:57.150267 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 12 02:16:57.150267 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 12 02:16:57.150267 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 12 02:16:57.150267 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 02:16:57.150267 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 02:16:57.150267 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 02:16:57.150267 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 02:16:57.150267 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 02:16:57.150267 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 02:16:57.150267 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 02:16:57.150267 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application with Lock( Oct 12 02:16:57.150267 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 02:16:57.150267 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._enter() Oct 12 02:16:57.150267 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 02:16:57.150267 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 02:16:57.151525 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 02:16:57.151525 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.creator() Oct 12 02:16:57.151525 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 02:16:57.151525 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application created_value = creator( Oct 12 02:16:57.151525 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 12 02:16:57.151525 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 12 02:16:57.151525 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 12 02:16:57.151525 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 12 02:16:57.151525 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 12 02:16:57.151525 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 12 02:16:57.151525 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 12 02:16:57.151525 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Oct 12 02:16:57.151525 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 139/277] 10.222.0.18 () {56 vars in 1120 bytes} [Wed Oct 12 02:16:57 2022] GET /identity/v3/roles/member => generated 84 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 12 02:16:57.156432 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1698b2a7-b7eb-4f5c-bbed-03d04a7781d1 admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:16:57.174812 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1698b2a7-b7eb-4f5c-bbed-03d04a7781d1 admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:16:57.185210 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442cfa9d-c098-4b03-988b-e22986310d10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:16:57.185836 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442cfa9d-c098-4b03-988b-e22986310d10 admin admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:16:57.186119 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442cfa9d-c098-4b03-988b-e22986310d10 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:16:57.186394 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442cfa9d-c098-4b03-988b-e22986310d10 admin admin] PATH_INFO: `/v3/roles` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:16:57.187068 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442cfa9d-c098-4b03-988b-e22986310d10 admin admin] RBAC: Adding query filter params (name=member) {{(pid=81361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 02:16:57.187373 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442cfa9d-c098-4b03-988b-e22986310d10 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:16:57.189039 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442cfa9d-c098-4b03-988b-e22986310d10 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:16:57.211310 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 140/278] 10.222.0.18 () {56 vars in 1122 bytes} [Wed Oct 12 02:16:57 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 02:16:57.216998 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442cfa9d-c098-4b03-988b-e22986310d10 admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:16:57.232741 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442cfa9d-c098-4b03-988b-e22986310d10 admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:16:57.242700 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9865454-f283-4051-b8b7-19027dfbdb5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:16:57.243489 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9865454-f283-4051-b8b7-19027dfbdb5c admin admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:16:57.243790 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9865454-f283-4051-b8b7-19027dfbdb5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:16:57.244178 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9865454-f283-4051-b8b7-19027dfbdb5c admin admin] PATH_INFO: `/v3/groups/2b5d93df759a456ab6de5b455fae6322` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:16:57.245332 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9865454-f283-4051-b8b7-19027dfbdb5c admin admin] RBAC: Authorizing `identity:get_group(group_id=2b5d93df759a456ab6de5b455fae6322)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:16:57.247972 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9865454-f283-4051-b8b7-19027dfbdb5c admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:16:57.250141 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 141/279] 10.222.0.18 () {56 vars in 1201 bytes} [Wed Oct 12 02:16:57 2022] GET /identity/v3/groups/2b5d93df759a456ab6de5b455fae6322 => generated 226 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 02:16:57.255434 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9865454-f283-4051-b8b7-19027dfbdb5c admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:16:57.260329 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b68e3b-333a-4268-a3ae-3cf340123c35 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:16:57.271188 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9865454-f283-4051-b8b7-19027dfbdb5c admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:16:57.279527 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b64fed-d15b-42be-a2e6-6c04b7b0edce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:16:57.280433 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b64fed-d15b-42be-a2e6-6c04b7b0edce admin admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:16:57.280742 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b64fed-d15b-42be-a2e6-6c04b7b0edce admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:16:57.281023 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b64fed-d15b-42be-a2e6-6c04b7b0edce admin admin] PATH_INFO: `/v3/projects/f4486b89b2274830aff946201a578806` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:16:57.283008 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b64fed-d15b-42be-a2e6-6c04b7b0edce admin admin] RBAC: Authorizing `identity:get_project(project_id=f4486b89b2274830aff946201a578806)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:16:57.284732 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b64fed-d15b-42be-a2e6-6c04b7b0edce admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:16:57.286367 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 142/280] 10.222.0.18 () {56 vars in 1207 bytes} [Wed Oct 12 02:16:57 2022] GET /identity/v3/projects/f4486b89b2274830aff946201a578806 => generated 302 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 02:16:57.293241 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b64fed-d15b-42be-a2e6-6c04b7b0edce admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:16:57.305886 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b64fed-d15b-42be-a2e6-6c04b7b0edce admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:16:57.308715 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62b783b-e0f4-41cd-8e6b-b7860ffe2ed9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:16:57.309613 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62b783b-e0f4-41cd-8e6b-b7860ffe2ed9 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:16:57.310181 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62b783b-e0f4-41cd-8e6b-b7860ffe2ed9 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:16:57.310651 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62b783b-e0f4-41cd-8e6b-b7860ffe2ed9 None admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:16:57.311566 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62b783b-e0f4-41cd-8e6b-b7860ffe2ed9 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 02:16:57.313557 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62b783b-e0f4-41cd-8e6b-b7860ffe2ed9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:16:57.315209 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62b783b-e0f4-41cd-8e6b-b7860ffe2ed9 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:16:57.318929 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f3d6d9-4f2e-428a-a9c9-a4e97360ffa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:16:57.320161 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f3d6d9-4f2e-428a-a9c9-a4e97360ffa2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:16:57.320446 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f3d6d9-4f2e-428a-a9c9-a4e97360ffa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:16:57.320745 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f3d6d9-4f2e-428a-a9c9-a4e97360ffa2 admin admin] PATH_INFO: `/v3/projects/f4486b89b2274830aff946201a578806/groups/2b5d93df759a456ab6de5b455fae6322/roles/3d75c4d7f1a849b9a771504d1583ab28` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:16:57.322663 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f3d6d9-4f2e-428a-a9c9-a4e97360ffa2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f4486b89b2274830aff946201a578806, group_id=2b5d93df759a456ab6de5b455fae6322, role_id=3d75c4d7f1a849b9a771504d1583ab28)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:16:57.326178 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f3d6d9-4f2e-428a-a9c9-a4e97360ffa2 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:16:57.328716 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:16:57.332058 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 139/281] 10.222.0.18 () {56 vars in 1101 bytes} [Wed Oct 12 02:16:57 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 02:16:57.333466 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62b783b-e0f4-41cd-8e6b-b7860ffe2ed9 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:16:57.358718 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 143/282] 10.222.0.18 () {58 vars in 1463 bytes} [Wed Oct 12 02:16:57 2022] PUT /identity/v3/projects/f4486b89b2274830aff946201a578806/groups/2b5d93df759a456ab6de5b455fae6322/roles/3d75c4d7f1a849b9a771504d1583ab28 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 02:16:57.377899 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:16:57.439846 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f3d6d9-4f2e-428a-a9c9-a4e97360ffa2 admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:16:57.489013 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62b783b-e0f4-41cd-8e6b-b7860ffe2ed9 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:16:57.564952 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f3d6d9-4f2e-428a-a9c9-a4e97360ffa2 admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:16:57.573049 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230d4c9e-0f7f-4d8c-baef-7333eb1e4510 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:16:57.573872 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230d4c9e-0f7f-4d8c-baef-7333eb1e4510 admin admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:16:57.574137 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d42ea3-3fd2-4539-b28e-3895da9d046b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:16:57.574391 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230d4c9e-0f7f-4d8c-baef-7333eb1e4510 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:16:57.574768 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230d4c9e-0f7f-4d8c-baef-7333eb1e4510 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:16:57.575252 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d42ea3-3fd2-4539-b28e-3895da9d046b None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:16:57.575666 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d42ea3-3fd2-4539-b28e-3895da9d046b None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:16:57.576065 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d42ea3-3fd2-4539-b28e-3895da9d046b None admin] PATH_INFO: `/v3/users/2582397faa26450a8ee79196e3a298e7` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:16:57.577403 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d42ea3-3fd2-4539-b28e-3895da9d046b None admin] RBAC: Authorizing `identity:get_user(user_id=2582397faa26450a8ee79196e3a298e7)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:16:57.578972 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d42ea3-3fd2-4539-b28e-3895da9d046b None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:16:57.581084 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 140/283] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Oct 12 02:16:57 2022] GET /identity/v3/users/2582397faa26450a8ee79196e3a298e7 => generated 293 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 02:16:57.595427 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230d4c9e-0f7f-4d8c-baef-7333eb1e4510 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 02:16:57.600838 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application [None req-230d4c9e-0f7f-4d8c-baef-7333eb1e4510 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 12 02:16:57.600838 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 02:16:57.600838 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 02:16:57.600838 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 02:16:57.600838 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 02:16:57.600838 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 02:16:57.600838 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 02:16:57.600838 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 02:16:57.600838 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 02:16:57.600838 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 02:16:57.600838 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 02:16:57.600838 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 02:16:57.600838 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 12 02:16:57.600838 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 12 02:16:57.600838 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 12 02:16:57.600838 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 12 02:16:57.601881 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 12 02:16:57.601881 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 12 02:16:57.601881 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 12 02:16:57.601881 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 12 02:16:57.601881 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 02:16:57.601881 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 02:16:57.601881 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 02:16:57.601881 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 02:16:57.601881 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 02:16:57.601881 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 02:16:57.601881 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 02:16:57.601881 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application with Lock( Oct 12 02:16:57.601881 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 02:16:57.601881 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._enter() Oct 12 02:16:57.601881 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 02:16:57.601881 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 02:16:57.602670 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 02:16:57.602670 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.creator() Oct 12 02:16:57.602670 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 02:16:57.602670 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application created_value = creator( Oct 12 02:16:57.602670 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 12 02:16:57.602670 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 12 02:16:57.602670 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 12 02:16:57.602670 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 12 02:16:57.602670 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 12 02:16:57.602670 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 12 02:16:57.602670 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 12 02:16:57.602670 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Oct 12 02:16:57.602670 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 144/284] 10.222.0.18 () {56 vars in 1135 bytes} [Wed Oct 12 02:16:57 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 02:16:57.611775 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d42ea3-3fd2-4539-b28e-3895da9d046b None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:16:57.611932 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230d4c9e-0f7f-4d8c-baef-7333eb1e4510 admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:16:57.638798 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d42ea3-3fd2-4539-b28e-3895da9d046b None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:16:57.649932 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0782a9-d323-44a0-b7f8-e215eadaa021 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:16:57.651149 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0782a9-d323-44a0-b7f8-e215eadaa021 admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:16:57.651428 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0782a9-d323-44a0-b7f8-e215eadaa021 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:16:57.651702 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0782a9-d323-44a0-b7f8-e215eadaa021 admin admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:16:57.654010 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0782a9-d323-44a0-b7f8-e215eadaa021 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 02:16:57.654315 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0782a9-d323-44a0-b7f8-e215eadaa021 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:16:57.658198 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0782a9-d323-44a0-b7f8-e215eadaa021 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:16:57.677716 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 141/285] 10.222.0.18 () {56 vars in 1132 bytes} [Wed Oct 12 02:16:57 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 02:16:57.685349 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0782a9-d323-44a0-b7f8-e215eadaa021 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:16:57.700579 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0782a9-d323-44a0-b7f8-e215eadaa021 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:16:57.711459 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4673029f-77cc-46a9-aa0b-89239304d1f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:16:57.712163 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4673029f-77cc-46a9-aa0b-89239304d1f4 admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:16:57.712440 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4673029f-77cc-46a9-aa0b-89239304d1f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:16:57.712734 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4673029f-77cc-46a9-aa0b-89239304d1f4 admin admin] PATH_INFO: `/v3/groups/2b5d93df759a456ab6de5b455fae6322` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:16:57.716388 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4673029f-77cc-46a9-aa0b-89239304d1f4 admin admin] RBAC: Authorizing `identity:get_group(group_id=2b5d93df759a456ab6de5b455fae6322)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:16:57.720184 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4673029f-77cc-46a9-aa0b-89239304d1f4 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:16:57.724026 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 142/286] 10.222.0.18 () {56 vars in 1201 bytes} [Wed Oct 12 02:16:57 2022] GET /identity/v3/groups/2b5d93df759a456ab6de5b455fae6322 => generated 226 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 02:16:57.729920 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4673029f-77cc-46a9-aa0b-89239304d1f4 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:16:57.747181 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4673029f-77cc-46a9-aa0b-89239304d1f4 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:16:57.755458 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2407b6-ceec-46d8-a678-213ef7ac15c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:16:57.758981 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2407b6-ceec-46d8-a678-213ef7ac15c3 admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:16:57.759312 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2407b6-ceec-46d8-a678-213ef7ac15c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:16:57.759595 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2407b6-ceec-46d8-a678-213ef7ac15c3 admin admin] PATH_INFO: `/v3/projects/f4486b89b2274830aff946201a578806` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:16:57.762800 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2407b6-ceec-46d8-a678-213ef7ac15c3 admin admin] RBAC: Authorizing `identity:get_project(project_id=f4486b89b2274830aff946201a578806)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:16:57.767638 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2407b6-ceec-46d8-a678-213ef7ac15c3 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:16:57.770234 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 143/287] 10.222.0.18 () {56 vars in 1207 bytes} [Wed Oct 12 02:16:57 2022] GET /identity/v3/projects/f4486b89b2274830aff946201a578806 => generated 302 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 02:16:57.776916 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2407b6-ceec-46d8-a678-213ef7ac15c3 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:16:57.791566 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2407b6-ceec-46d8-a678-213ef7ac15c3 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:16:57.796224 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4dc768-ffbb-41d1-9526-423728cd5ea1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:16:57.796929 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4dc768-ffbb-41d1-9526-423728cd5ea1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:16:57.797259 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4dc768-ffbb-41d1-9526-423728cd5ea1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:16:57.797691 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4dc768-ffbb-41d1-9526-423728cd5ea1 admin admin] PATH_INFO: `/v3/projects/f4486b89b2274830aff946201a578806/groups/2b5d93df759a456ab6de5b455fae6322/roles/7b67553aa5874cca8c47e5fb5ffa1971` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:16:57.800077 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4dc768-ffbb-41d1-9526-423728cd5ea1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f4486b89b2274830aff946201a578806, group_id=2b5d93df759a456ab6de5b455fae6322, role_id=7b67553aa5874cca8c47e5fb5ffa1971)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:16:57.803134 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4dc768-ffbb-41d1-9526-423728cd5ea1 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:16:57.822150 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230d4c9e-0f7f-4d8c-baef-7333eb1e4510 admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:16:57.825873 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 144/288] 10.222.0.18 () {58 vars in 1463 bytes} [Wed Oct 12 02:16:57 2022] PUT /identity/v3/projects/f4486b89b2274830aff946201a578806/groups/2b5d93df759a456ab6de5b455fae6322/roles/7b67553aa5874cca8c47e5fb5ffa1971 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 02:16:57.893939 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0790c1cc-2f54-4e8c-b9f7-5b1aa241d1dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:16:57.894586 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0790c1cc-2f54-4e8c-b9f7-5b1aa241d1dc None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:16:57.894868 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0790c1cc-2f54-4e8c-b9f7-5b1aa241d1dc None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:16:57.895144 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0790c1cc-2f54-4e8c-b9f7-5b1aa241d1dc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:16:57.895922 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0790c1cc-2f54-4e8c-b9f7-5b1aa241d1dc None admin] RBAC: Adding query filter params (role.id=3b01dfb837044fd5b3f01dbf63d8edd1, user.id=2582397faa26450a8ee79196e3a298e7, scope.system=all) {{(pid=81361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 02:16:57.896238 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0790c1cc-2f54-4e8c-b9f7-5b1aa241d1dc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:16:57.898124 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0790c1cc-2f54-4e8c-b9f7-5b1aa241d1dc None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:16:57.900149 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:16:57.920666 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 145/289] 10.222.0.18 () {56 vars in 1308 bytes} [Wed Oct 12 02:16:57 2022] GET /identity/v3/role_assignments?user.id=2582397faa26450a8ee79196e3a298e7&scope.system=all&role.id=3b01dfb837044fd5b3f01dbf63d8edd1 => generated 510 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 02:16:58.380855 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ebde4e-cba1-4847-aaef-c1724b8af4eb None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:16:58.382032 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ebde4e-cba1-4847-aaef-c1724b8af4eb None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:16:58.382677 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ebde4e-cba1-4847-aaef-c1724b8af4eb None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:16:58.384503 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 145/290] 10.222.0.18 () {54 vars in 927 bytes} [Wed Oct 12 02:16:58 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 02:16:58.391622 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad78c6c6-4738-4288-bea4-190a2bb73ba4 None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:16:58.392501 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad78c6c6-4738-4288-bea4-190a2bb73ba4 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:16:58.392991 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad78c6c6-4738-4288-bea4-190a2bb73ba4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:16:58.421445 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-ad78c6c6-4738-4288-bea4-190a2bb73ba4 None None] MFA Rules not processed for user `a326a5bb7364479382f528a592371656`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:16:58.422978 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-ad78c6c6-4738-4288-bea4-190a2bb73ba4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:16:58.491536 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 146/291] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Oct 12 02:16:58 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Oct 12 02:16:58.796334 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ebde4e-cba1-4847-aaef-c1724b8af4eb None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:16:58.814452 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ebde4e-cba1-4847-aaef-c1724b8af4eb None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:16:58.825118 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd3b38b-9f5d-41e0-8b9c-af708d2a0427 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:16:58.826022 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd3b38b-9f5d-41e0-8b9c-af708d2a0427 admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:16:58.826493 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd3b38b-9f5d-41e0-8b9c-af708d2a0427 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:16:58.826973 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd3b38b-9f5d-41e0-8b9c-af708d2a0427 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:16:58.845617 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd3b38b-9f5d-41e0-8b9c-af708d2a0427 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 02:16:58.853352 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-7dd3b38b-9f5d-41e0-8b9c-af708d2a0427 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 12 02:16:58.853352 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 02:16:58.853352 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 02:16:58.853352 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 02:16:58.853352 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 02:16:58.853352 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 02:16:58.853352 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 02:16:58.853352 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 02:16:58.853352 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 02:16:58.853352 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 02:16:58.853352 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 02:16:58.853352 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 02:16:58.853352 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 12 02:16:58.853352 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 12 02:16:58.853352 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 12 02:16:58.853352 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 12 02:16:58.854294 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 12 02:16:58.854294 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 12 02:16:58.854294 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 12 02:16:58.854294 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 12 02:16:58.854294 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 02:16:58.854294 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 02:16:58.854294 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 02:16:58.854294 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 02:16:58.854294 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 02:16:58.854294 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 02:16:58.854294 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 02:16:58.854294 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Oct 12 02:16:58.854294 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 02:16:58.854294 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Oct 12 02:16:58.854294 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 02:16:58.854294 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 02:16:58.855078 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 02:16:58.855078 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Oct 12 02:16:58.855078 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 02:16:58.855078 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Oct 12 02:16:58.855078 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 12 02:16:58.855078 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 12 02:16:58.855078 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 12 02:16:58.855078 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 12 02:16:58.855078 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 12 02:16:58.855078 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 12 02:16:58.855078 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 12 02:16:58.855078 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Oct 12 02:16:58.857764 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 146/292] 10.222.0.18 () {56 vars in 1117 bytes} [Wed Oct 12 02:16:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 62 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 02:16:58.864010 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad78c6c6-4738-4288-bea4-190a2bb73ba4 None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:16:58.873981 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad78c6c6-4738-4288-bea4-190a2bb73ba4 None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:16:58.884606 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bfd1d9-43fb-41eb-a161-95f30a9fddff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:16:58.885475 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bfd1d9-43fb-41eb-a161-95f30a9fddff admin admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:16:58.885974 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bfd1d9-43fb-41eb-a161-95f30a9fddff admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:16:58.886451 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bfd1d9-43fb-41eb-a161-95f30a9fddff admin admin] PATH_INFO: `/v3/roles` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:16:58.887304 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6bfd1d9-43fb-41eb-a161-95f30a9fddff admin admin] RBAC: Adding query filter params (name=admin) {{(pid=81361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 02:16:58.887814 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6bfd1d9-43fb-41eb-a161-95f30a9fddff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:16:58.889638 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6bfd1d9-43fb-41eb-a161-95f30a9fddff admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:16:58.905148 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 147/293] 10.222.0.18 () {56 vars in 1120 bytes} [Wed Oct 12 02:16:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 02:16:58.910901 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd3b38b-9f5d-41e0-8b9c-af708d2a0427 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:16:58.925584 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd3b38b-9f5d-41e0-8b9c-af708d2a0427 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:16:58.933609 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9130fc16-f5f5-4ba7-8ba5-6f53b75a7f03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:16:58.934546 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9130fc16-f5f5-4ba7-8ba5-6f53b75a7f03 admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:16:58.935014 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9130fc16-f5f5-4ba7-8ba5-6f53b75a7f03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:16:58.935496 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9130fc16-f5f5-4ba7-8ba5-6f53b75a7f03 admin admin] PATH_INFO: `/v3/groups/181ca0912dba4e6c81306e40308a3086` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:16:58.942234 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9130fc16-f5f5-4ba7-8ba5-6f53b75a7f03 admin admin] RBAC: Authorizing `identity:get_group(group_id=181ca0912dba4e6c81306e40308a3086)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:16:58.944614 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9130fc16-f5f5-4ba7-8ba5-6f53b75a7f03 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:16:58.950075 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 147/294] 10.222.0.18 () {56 vars in 1201 bytes} [Wed Oct 12 02:16:58 2022] GET /identity/v3/groups/181ca0912dba4e6c81306e40308a3086 => generated 229 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 02:16:58.955772 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bfd1d9-43fb-41eb-a161-95f30a9fddff admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:16:58.971930 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bfd1d9-43fb-41eb-a161-95f30a9fddff admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:16:58.980586 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38550fd8-9f39-4e1a-91e1-b44e44d7f40d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:16:58.981481 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38550fd8-9f39-4e1a-91e1-b44e44d7f40d admin admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:16:58.981975 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38550fd8-9f39-4e1a-91e1-b44e44d7f40d admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:16:58.982453 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38550fd8-9f39-4e1a-91e1-b44e44d7f40d admin admin] PATH_INFO: `/v3/projects/ae04d11182384b63981888ea102e1452` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:16:58.989168 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38550fd8-9f39-4e1a-91e1-b44e44d7f40d admin admin] RBAC: Authorizing `identity:get_project(project_id=ae04d11182384b63981888ea102e1452)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:16:58.992163 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38550fd8-9f39-4e1a-91e1-b44e44d7f40d admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:16:58.994388 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 148/295] 10.222.0.18 () {56 vars in 1207 bytes} [Wed Oct 12 02:16:58 2022] GET /identity/v3/projects/ae04d11182384b63981888ea102e1452 => generated 344 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 02:16:59.000302 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9130fc16-f5f5-4ba7-8ba5-6f53b75a7f03 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:16:59.010924 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9130fc16-f5f5-4ba7-8ba5-6f53b75a7f03 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:16:59.019589 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96edd7aa-df20-4395-b070-299af2925144 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:16:59.020262 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96edd7aa-df20-4395-b070-299af2925144 admin admin] REQUEST_METHOD: `PUT` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:16:59.020615 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96edd7aa-df20-4395-b070-299af2925144 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:16:59.020887 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96edd7aa-df20-4395-b070-299af2925144 admin admin] PATH_INFO: `/v3/projects/ae04d11182384b63981888ea102e1452/groups/181ca0912dba4e6c81306e40308a3086/roles/39b1e8108dff402383def3c559f48189` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:16:59.023546 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96edd7aa-df20-4395-b070-299af2925144 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ae04d11182384b63981888ea102e1452, group_id=181ca0912dba4e6c81306e40308a3086, role_id=39b1e8108dff402383def3c559f48189)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:16:59.026438 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96edd7aa-df20-4395-b070-299af2925144 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:16:59.047918 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 148/296] 10.222.0.18 () {58 vars in 1463 bytes} [Wed Oct 12 02:16:58 2022] PUT /identity/v3/projects/ae04d11182384b63981888ea102e1452/groups/181ca0912dba4e6c81306e40308a3086/roles/39b1e8108dff402383def3c559f48189 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 02:16:59.454358 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6894a43d-b46d-45b4-b0b2-c6820f67b25f None None] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:16:59.454866 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6894a43d-b46d-45b4-b0b2-c6820f67b25f None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:16:59.454866 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6894a43d-b46d-45b4-b0b2-c6820f67b25f None None] PATH_INFO: `/` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:16:59.456514 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 149/297] 10.222.0.18 () {54 vars in 927 bytes} [Wed Oct 12 02:16:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 02:16:59.461767 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae53f39-8179-4fe0-90ab-5da41b9eafee None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:16:59.462174 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae53f39-8179-4fe0-90ab-5da41b9eafee None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:16:59.462359 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae53f39-8179-4fe0-90ab-5da41b9eafee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:16:59.486762 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-9ae53f39-8179-4fe0-90ab-5da41b9eafee None None] MFA Rules not processed for user `a326a5bb7364479382f528a592371656`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:16:59.487971 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-9ae53f39-8179-4fe0-90ab-5da41b9eafee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:16:59.524860 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:16:59.576756 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 149/298] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Oct 12 02:16:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 12 02:16:59.729197 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78db6303-ebbb-4cf0-a22d-8fb7c5b655a7 None None] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:16:59.729487 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78db6303-ebbb-4cf0-a22d-8fb7c5b655a7 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:16:59.729665 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78db6303-ebbb-4cf0-a22d-8fb7c5b655a7 None None] PATH_INFO: `/` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:16:59.731273 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 150/299] 10.222.0.18 () {54 vars in 927 bytes} [Wed Oct 12 02:16:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 02:16:59.736420 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717b1234-2f49-43ee-a08c-d6d40526c19e None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:16:59.736740 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717b1234-2f49-43ee-a08c-d6d40526c19e None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:16:59.737014 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717b1234-2f49-43ee-a08c-d6d40526c19e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:16:59.756631 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-717b1234-2f49-43ee-a08c-d6d40526c19e None None] MFA Rules not processed for user `a326a5bb7364479382f528a592371656`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:16:59.758208 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-717b1234-2f49-43ee-a08c-d6d40526c19e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:16:59.845109 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 150/300] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Oct 12 02:16:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 12 02:17:00.137147 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78db6303-ebbb-4cf0-a22d-8fb7c5b655a7 None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:17:00.148136 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717b1234-2f49-43ee-a08c-d6d40526c19e None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:17:00.273245 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:17:00.276760 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717b1234-2f49-43ee-a08c-d6d40526c19e None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:17:00.325000 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78db6303-ebbb-4cf0-a22d-8fb7c5b655a7 None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:17:00.331610 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c175d9-997f-4081-9066-e8ac9ae747f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:17:00.332459 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c175d9-997f-4081-9066-e8ac9ae747f2 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:00.332976 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c175d9-997f-4081-9066-e8ac9ae747f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:00.333393 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c175d9-997f-4081-9066-e8ac9ae747f2 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:00.346940 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c175d9-997f-4081-9066-e8ac9ae747f2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 02:17:00.352880 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-a8c175d9-997f-4081-9066-e8ac9ae747f2 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 12 02:17:00.352880 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 02:17:00.352880 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 02:17:00.352880 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 02:17:00.352880 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 02:17:00.352880 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 02:17:00.352880 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 02:17:00.352880 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 02:17:00.352880 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 02:17:00.352880 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 02:17:00.352880 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 02:17:00.352880 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 02:17:00.352880 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 12 02:17:00.352880 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 12 02:17:00.352880 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 12 02:17:00.352880 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 12 02:17:00.353965 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 12 02:17:00.353965 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 12 02:17:00.353965 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 12 02:17:00.353965 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 12 02:17:00.353965 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 02:17:00.353965 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 02:17:00.353965 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 02:17:00.353965 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 02:17:00.353965 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 02:17:00.353965 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 02:17:00.353965 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 02:17:00.353965 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Oct 12 02:17:00.353965 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 02:17:00.353965 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Oct 12 02:17:00.353965 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 02:17:00.353965 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 02:17:00.354909 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 02:17:00.354909 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Oct 12 02:17:00.354909 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 02:17:00.354909 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Oct 12 02:17:00.354909 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 12 02:17:00.354909 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 12 02:17:00.354909 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 12 02:17:00.354909 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 12 02:17:00.354909 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 12 02:17:00.354909 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 12 02:17:00.354909 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 12 02:17:00.354909 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Oct 12 02:17:00.355658 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:17:00.357270 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 151/301] 10.222.0.18 () {56 vars in 1114 bytes} [Wed Oct 12 02:17:00 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 02:17:00.358611 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d3d24c-1463-4c4a-b8fb-3f2dc4599875 None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:00.359076 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d3d24c-1463-4c4a-b8fb-3f2dc4599875 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:00.359581 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d3d24c-1463-4c4a-b8fb-3f2dc4599875 None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:00.362226 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 152/302] 10.222.0.18 () {54 vars in 927 bytes} [Wed Oct 12 02:17:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 02:17:00.368956 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d3d24c-1463-4c4a-b8fb-3f2dc4599875 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:17:00.379801 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f256e6-e802-474c-9f42-dc09f996f9c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:17:00.380563 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f256e6-e802-474c-9f42-dc09f996f9c6 None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:00.380922 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f256e6-e802-474c-9f42-dc09f996f9c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:00.381271 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f256e6-e802-474c-9f42-dc09f996f9c6 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:00.394462 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f256e6-e802-474c-9f42-dc09f996f9c6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 02:17:00.400864 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application [None req-79f256e6-e802-474c-9f42-dc09f996f9c6 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 12 02:17:00.400864 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 02:17:00.400864 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 02:17:00.400864 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 02:17:00.400864 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 02:17:00.400864 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 02:17:00.400864 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 02:17:00.400864 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 02:17:00.400864 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 02:17:00.400864 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 02:17:00.400864 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 02:17:00.400864 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 02:17:00.400864 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 12 02:17:00.400864 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 12 02:17:00.400864 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 12 02:17:00.400864 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 12 02:17:00.401798 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 12 02:17:00.401798 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 12 02:17:00.401798 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 12 02:17:00.401798 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 12 02:17:00.401798 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 02:17:00.401798 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 02:17:00.401798 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 02:17:00.401798 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 02:17:00.401798 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 02:17:00.401798 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 02:17:00.401798 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 02:17:00.401798 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application with Lock( Oct 12 02:17:00.401798 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 02:17:00.401798 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._enter() Oct 12 02:17:00.401798 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 02:17:00.401798 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 02:17:00.402630 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 02:17:00.402630 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.creator() Oct 12 02:17:00.402630 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 02:17:00.402630 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application created_value = creator( Oct 12 02:17:00.402630 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 12 02:17:00.402630 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 12 02:17:00.402630 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 12 02:17:00.402630 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 12 02:17:00.402630 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 12 02:17:00.402630 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 12 02:17:00.402630 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 12 02:17:00.402630 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Oct 12 02:17:00.402630 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 151/303] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Oct 12 02:17:00 2022] GET /identity/v3/roles/member => generated 84 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 02:17:00.404159 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564a8ece-cad4-4d7b-9323-67c370df62ff None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:00.404493 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564a8ece-cad4-4d7b-9323-67c370df62ff None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:00.404883 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564a8ece-cad4-4d7b-9323-67c370df62ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:00.425458 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-564a8ece-cad4-4d7b-9323-67c370df62ff None None] MFA Rules not processed for user `a326a5bb7364479382f528a592371656`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:17:00.427233 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-564a8ece-cad4-4d7b-9323-67c370df62ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:17:00.486916 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d3d24c-1463-4c4a-b8fb-3f2dc4599875 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:17:00.506724 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 152/304] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Oct 12 02:17:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 12 02:17:00.507989 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564a8ece-cad4-4d7b-9323-67c370df62ff None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:17:00.531873 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2abc24-d4e0-47b8-8eab-f47744a624df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:17:00.534234 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2abc24-d4e0-47b8-8eab-f47744a624df None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:00.534664 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2abc24-d4e0-47b8-8eab-f47744a624df None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:00.535101 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2abc24-d4e0-47b8-8eab-f47744a624df None admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:00.536764 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2abc24-d4e0-47b8-8eab-f47744a624df None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 02:17:00.538246 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2abc24-d4e0-47b8-8eab-f47744a624df None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:17:00.541973 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2abc24-d4e0-47b8-8eab-f47744a624df None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:17:00.558707 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 153/305] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Oct 12 02:17:00 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 02:17:00.566265 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2abc24-d4e0-47b8-8eab-f47744a624df None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:17:00.607625 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:17:00.706649 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564a8ece-cad4-4d7b-9323-67c370df62ff None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:17:00.732824 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:17:00.756846 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2abc24-d4e0-47b8-8eab-f47744a624df None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:17:00.772825 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c45183-bd6b-421e-9961-097045bb0a56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:17:00.773519 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c45183-bd6b-421e-9961-097045bb0a56 None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:00.773795 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c45183-bd6b-421e-9961-097045bb0a56 None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:00.774073 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c45183-bd6b-421e-9961-097045bb0a56 None admin] PATH_INFO: `/v3/roles` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:00.774825 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c45183-bd6b-421e-9961-097045bb0a56 None admin] RBAC: Adding query filter params (name=member) {{(pid=81361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 02:17:00.775135 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c45183-bd6b-421e-9961-097045bb0a56 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:17:00.776590 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c45183-bd6b-421e-9961-097045bb0a56 None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:17:00.789071 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 153/306] 10.222.0.18 () {56 vars in 1101 bytes} [Wed Oct 12 02:17:00 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 02:17:00.800974 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c45183-bd6b-421e-9961-097045bb0a56 None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:17:00.817358 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38159832-14b4-4c9f-b7e3-44d011da3062 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:17:00.818034 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38159832-14b4-4c9f-b7e3-44d011da3062 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:00.818309 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38159832-14b4-4c9f-b7e3-44d011da3062 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:00.818615 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38159832-14b4-4c9f-b7e3-44d011da3062 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:00.933071 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38159832-14b4-4c9f-b7e3-44d011da3062 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:17:00.934537 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38159832-14b4-4c9f-b7e3-44d011da3062 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:17:00.960050 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:17:00.960330 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c45183-bd6b-421e-9961-097045bb0a56 None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:17:01.004820 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3705e7c-b0eb-4293-91ba-f80af2222924 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:17:01.005435 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3705e7c-b0eb-4293-91ba-f80af2222924 None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:01.005719 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3705e7c-b0eb-4293-91ba-f80af2222924 None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:01.005992 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3705e7c-b0eb-4293-91ba-f80af2222924 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:01.046884 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 154/307] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Oct 12 02:17:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 481 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Oct 12 02:17:01.047927 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38159832-14b4-4c9f-b7e3-44d011da3062 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:17:01.065801 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:17:01.094801 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3705e7c-b0eb-4293-91ba-f80af2222924 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:17:01.096271 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3705e7c-b0eb-4293-91ba-f80af2222924 None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:17:01.170408 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38159832-14b4-4c9f-b7e3-44d011da3062 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:17:01.195490 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:17:01.214505 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3bc73f-5b04-4efc-9c8d-c010477d5b66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:17:01.214505 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3bc73f-5b04-4efc-9c8d-c010477d5b66 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:01.214767 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3bc73f-5b04-4efc-9c8d-c010477d5b66 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:01.215033 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3bc73f-5b04-4efc-9c8d-c010477d5b66 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:01.229382 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 154/308] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Oct 12 02:17:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 430 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 12 02:17:01.230702 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89dbdd6-b718-425f-94d0-dcbdcf01e865 None None] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:01.230996 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89dbdd6-b718-425f-94d0-dcbdcf01e865 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:01.231272 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89dbdd6-b718-425f-94d0-dcbdcf01e865 None None] PATH_INFO: `/` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:01.232145 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3bc73f-5b04-4efc-9c8d-c010477d5b66 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 02:17:01.232811 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 155/309] 10.222.0.18 () {54 vars in 927 bytes} [Wed Oct 12 02:17:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 02:17:01.233523 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89dbdd6-b718-425f-94d0-dcbdcf01e865 None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:17:01.241220 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-5d3bc73f-5b04-4efc-9c8d-c010477d5b66 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 12 02:17:01.241220 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 02:17:01.241220 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 02:17:01.241220 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 02:17:01.241220 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 02:17:01.241220 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 02:17:01.241220 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 02:17:01.241220 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 02:17:01.241220 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 02:17:01.241220 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 02:17:01.241220 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 02:17:01.241220 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 02:17:01.241220 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 12 02:17:01.241220 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 12 02:17:01.241220 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 12 02:17:01.241220 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 12 02:17:01.242714 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 12 02:17:01.242714 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 12 02:17:01.242714 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 12 02:17:01.242714 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 12 02:17:01.242714 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 02:17:01.242714 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 02:17:01.242714 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 02:17:01.242714 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 02:17:01.242714 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 02:17:01.242714 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 02:17:01.242714 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 02:17:01.242714 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Oct 12 02:17:01.242714 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 02:17:01.242714 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Oct 12 02:17:01.242714 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 02:17:01.242714 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 02:17:01.243505 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 02:17:01.243505 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Oct 12 02:17:01.243505 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 02:17:01.243505 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Oct 12 02:17:01.243505 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 12 02:17:01.243505 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 12 02:17:01.243505 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 12 02:17:01.243505 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 12 02:17:01.243505 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 12 02:17:01.243505 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 12 02:17:01.243505 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 12 02:17:01.243505 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Oct 12 02:17:01.243505 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 155/310] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Oct 12 02:17:01 2022] GET /identity/v3/roles/member => generated 84 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 02:17:01.243505 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3bc73f-5b04-4efc-9c8d-c010477d5b66 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:17:01.338349 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:17:01.366971 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89dbdd6-b718-425f-94d0-dcbdcf01e865 None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:17:01.376955 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3bc73f-5b04-4efc-9c8d-c010477d5b66 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:17:01.413504 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca66bea-901b-48a7-b888-5181b4003962 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:17:01.414156 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca66bea-901b-48a7-b888-5181b4003962 None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:01.414494 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca66bea-901b-48a7-b888-5181b4003962 None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:01.414765 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca66bea-901b-48a7-b888-5181b4003962 None admin] PATH_INFO: `/v3/projects/fd1c4db151454810bdf01c589c22b7b7` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:01.415961 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca66bea-901b-48a7-b888-5181b4003962 None admin] RBAC: Authorizing `identity:get_project(project_id=fd1c4db151454810bdf01c589c22b7b7)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:17:01.417562 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca66bea-901b-48a7-b888-5181b4003962 None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:17:01.419231 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 156/311] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Oct 12 02:17:01 2022] GET /identity/v3/projects/fd1c4db151454810bdf01c589c22b7b7 => generated 298 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 02:17:01.420373 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b498a812-6a75-4f4e-bdd0-8906b993164d None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:01.422279 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b498a812-6a75-4f4e-bdd0-8906b993164d None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:01.422279 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b498a812-6a75-4f4e-bdd0-8906b993164d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:01.426534 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4628c4-d396-4e57-8d03-ba3913453032 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:17:01.427420 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4628c4-d396-4e57-8d03-ba3913453032 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:01.427899 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4628c4-d396-4e57-8d03-ba3913453032 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:01.428949 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4628c4-d396-4e57-8d03-ba3913453032 None admin] PATH_INFO: `/v3/projects/fd1c4db151454810bdf01c589c22b7b7` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:01.430435 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4628c4-d396-4e57-8d03-ba3913453032 None admin] RBAC: Authorizing `identity:get_project(project_id=fd1c4db151454810bdf01c589c22b7b7)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:17:01.433032 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4628c4-d396-4e57-8d03-ba3913453032 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:17:01.434871 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 156/312] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Oct 12 02:17:01 2022] GET /identity/v3/projects/fd1c4db151454810bdf01c589c22b7b7 => generated 298 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 02:17:01.435833 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4628c4-d396-4e57-8d03-ba3913453032 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:17:01.444879 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-b498a812-6a75-4f4e-bdd0-8906b993164d None None] MFA Rules not processed for user `a326a5bb7364479382f528a592371656`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:17:01.448296 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-b498a812-6a75-4f4e-bdd0-8906b993164d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:17:01.514158 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:17:01.549641 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 157/313] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Oct 12 02:17:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 12 02:17:01.550520 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b498a812-6a75-4f4e-bdd0-8906b993164d None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:17:01.592598 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4628c4-d396-4e57-8d03-ba3913453032 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:17:01.630005 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da0fd48-8035-47cd-8cc2-efd550fe4236 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:17:01.630614 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da0fd48-8035-47cd-8cc2-efd550fe4236 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:01.630903 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da0fd48-8035-47cd-8cc2-efd550fe4236 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:01.631159 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da0fd48-8035-47cd-8cc2-efd550fe4236 None admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:01.632956 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da0fd48-8035-47cd-8cc2-efd550fe4236 None admin] RBAC: Adding query filter params (name=member) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 02:17:01.633256 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da0fd48-8035-47cd-8cc2-efd550fe4236 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:17:01.634701 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da0fd48-8035-47cd-8cc2-efd550fe4236 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:17:01.642012 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:17:01.649795 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 157/314] 10.222.0.18 () {56 vars in 1101 bytes} [Wed Oct 12 02:17:01 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 02:17:01.650969 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da0fd48-8035-47cd-8cc2-efd550fe4236 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:17:01.677079 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b498a812-6a75-4f4e-bdd0-8906b993164d None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:17:01.731034 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395c0bda-d471-4ea0-b8b6-9f750f8d1d81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:17:01.731604 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395c0bda-d471-4ea0-b8b6-9f750f8d1d81 None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:01.731925 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395c0bda-d471-4ea0-b8b6-9f750f8d1d81 None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:01.732194 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395c0bda-d471-4ea0-b8b6-9f750f8d1d81 None admin] PATH_INFO: `/v3/groups/2b5d93df759a456ab6de5b455fae6322` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:01.733521 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395c0bda-d471-4ea0-b8b6-9f750f8d1d81 None admin] RBAC: Authorizing `identity:get_group(group_id=2b5d93df759a456ab6de5b455fae6322)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:17:01.734960 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395c0bda-d471-4ea0-b8b6-9f750f8d1d81 None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:17:01.739090 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 158/315] 10.222.0.18 () {56 vars in 1180 bytes} [Wed Oct 12 02:17:01 2022] GET /identity/v3/groups/2b5d93df759a456ab6de5b455fae6322 => generated 226 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 02:17:01.740079 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395c0bda-d471-4ea0-b8b6-9f750f8d1d81 None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:17:01.796024 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da0fd48-8035-47cd-8cc2-efd550fe4236 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:17:01.809934 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:17:01.845995 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c7c0fa-b830-4ec4-8f60-985dcd4747e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:17:01.846939 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c7c0fa-b830-4ec4-8f60-985dcd4747e1 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:01.847244 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c7c0fa-b830-4ec4-8f60-985dcd4747e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:01.847518 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c7c0fa-b830-4ec4-8f60-985dcd4747e1 None admin] PATH_INFO: `/v3/groups/2b5d93df759a456ab6de5b455fae6322` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:01.848700 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c7c0fa-b830-4ec4-8f60-985dcd4747e1 None admin] RBAC: Authorizing `identity:get_group(group_id=2b5d93df759a456ab6de5b455fae6322)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:17:01.850745 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c7c0fa-b830-4ec4-8f60-985dcd4747e1 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:17:01.852549 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 158/316] 10.222.0.18 () {56 vars in 1180 bytes} [Wed Oct 12 02:17:01 2022] GET /identity/v3/groups/2b5d93df759a456ab6de5b455fae6322 => generated 226 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 02:17:01.853264 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c7c0fa-b830-4ec4-8f60-985dcd4747e1 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:17:01.864618 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395c0bda-d471-4ea0-b8b6-9f750f8d1d81 None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:17:01.904510 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8296b46b-1478-4ae5-9cf9-f5199e1c19cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:17:01.905109 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8296b46b-1478-4ae5-9cf9-f5199e1c19cf None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:01.905388 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8296b46b-1478-4ae5-9cf9-f5199e1c19cf None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:01.905662 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8296b46b-1478-4ae5-9cf9-f5199e1c19cf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:01.919605 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:17:01.975615 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c7c0fa-b830-4ec4-8f60-985dcd4747e1 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:17:01.982545 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8296b46b-1478-4ae5-9cf9-f5199e1c19cf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:17:01.984008 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8296b46b-1478-4ae5-9cf9-f5199e1c19cf None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:17:02.018318 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e438cb-58ae-4d81-81a0-24bc16b5f13a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:17:02.018930 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e438cb-58ae-4d81-81a0-24bc16b5f13a None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:02.019209 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e438cb-58ae-4d81-81a0-24bc16b5f13a None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:02.019482 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e438cb-58ae-4d81-81a0-24bc16b5f13a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:02.020212 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e438cb-58ae-4d81-81a0-24bc16b5f13a None admin] RBAC: Adding query filter params (group.id=2b5d93df759a456ab6de5b455fae6322, role.id=7b67553aa5874cca8c47e5fb5ffa1971, scope.project.id=fd1c4db151454810bdf01c589c22b7b7) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 02:17:02.020552 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e438cb-58ae-4d81-81a0-24bc16b5f13a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:17:02.022547 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e438cb-58ae-4d81-81a0-24bc16b5f13a None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:17:02.031087 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 159/317] 10.222.0.18 () {56 vars in 1376 bytes} [Wed Oct 12 02:17:01 2022] GET /identity/v3/role_assignments?group.id=2b5d93df759a456ab6de5b455fae6322&scope.project.id=fd1c4db151454810bdf01c589c22b7b7&role.id=7b67553aa5874cca8c47e5fb5ffa1971 => generated 611 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 02:17:02.032339 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adf065a-9c5e-4f1c-97f1-263d76113a1d None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:02.032668 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adf065a-9c5e-4f1c-97f1-263d76113a1d None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:02.032946 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adf065a-9c5e-4f1c-97f1-263d76113a1d None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:02.034170 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 160/318] 10.222.0.18 () {54 vars in 927 bytes} [Wed Oct 12 02:17:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 02:17:02.034882 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8adf065a-9c5e-4f1c-97f1-263d76113a1d None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:17:02.092664 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:17:02.130740 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 159/319] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Oct 12 02:17:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 12 02:17:02.133556 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8296b46b-1478-4ae5-9cf9-f5199e1c19cf None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:17:02.170132 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8adf065a-9c5e-4f1c-97f1-263d76113a1d None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:17:02.191722 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:17:02.218210 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc2f236-7a72-44cb-b56e-46d8cd86a722 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:17:02.219320 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc2f236-7a72-44cb-b56e-46d8cd86a722 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:02.219799 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc2f236-7a72-44cb-b56e-46d8cd86a722 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:02.220800 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc2f236-7a72-44cb-b56e-46d8cd86a722 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:02.233878 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc2f236-7a72-44cb-b56e-46d8cd86a722 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 02:17:02.239318 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-0cc2f236-7a72-44cb-b56e-46d8cd86a722 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 12 02:17:02.239318 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 02:17:02.239318 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 02:17:02.239318 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 02:17:02.239318 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 02:17:02.239318 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 02:17:02.239318 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 02:17:02.239318 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 02:17:02.239318 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 02:17:02.239318 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 02:17:02.239318 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 02:17:02.239318 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 02:17:02.239318 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 12 02:17:02.239318 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 12 02:17:02.239318 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 12 02:17:02.239318 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 12 02:17:02.240206 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 12 02:17:02.240206 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 12 02:17:02.240206 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 12 02:17:02.240206 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 12 02:17:02.240206 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 02:17:02.240206 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 02:17:02.240206 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 02:17:02.240206 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 02:17:02.240206 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 02:17:02.240206 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 02:17:02.240206 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 02:17:02.240206 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Oct 12 02:17:02.240206 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 02:17:02.240206 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Oct 12 02:17:02.240206 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 02:17:02.240206 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 02:17:02.241841 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 02:17:02.241841 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Oct 12 02:17:02.241841 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 02:17:02.241841 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Oct 12 02:17:02.241841 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 12 02:17:02.241841 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 12 02:17:02.241841 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 12 02:17:02.241841 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 12 02:17:02.241841 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 12 02:17:02.241841 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 12 02:17:02.241841 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 12 02:17:02.241841 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Oct 12 02:17:02.241841 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 161/320] 10.222.0.18 () {56 vars in 1114 bytes} [Wed Oct 12 02:17:02 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 02:17:02.242491 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b7a288-ebab-42c5-97c1-063abd8ea9d9 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:02.242723 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b7a288-ebab-42c5-97c1-063abd8ea9d9 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:02.243006 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b7a288-ebab-42c5-97c1-063abd8ea9d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:02.263613 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8296b46b-1478-4ae5-9cf9-f5199e1c19cf None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:17:02.266972 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-b5b7a288-ebab-42c5-97c1-063abd8ea9d9 None None] MFA Rules not processed for user `a326a5bb7364479382f528a592371656`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:17:02.266972 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-b5b7a288-ebab-42c5-97c1-063abd8ea9d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:17:02.304979 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3193e5-8927-4c8c-a12c-2d0707be65d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:17:02.305595 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3193e5-8927-4c8c-a12c-2d0707be65d1 None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:02.305881 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3193e5-8927-4c8c-a12c-2d0707be65d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:02.306158 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3193e5-8927-4c8c-a12c-2d0707be65d1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:02.306894 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3193e5-8927-4c8c-a12c-2d0707be65d1 None admin] RBAC: Adding query filter params (group.id=2b5d93df759a456ab6de5b455fae6322, role.id=3d75c4d7f1a849b9a771504d1583ab28, scope.project.id=fd1c4db151454810bdf01c589c22b7b7) {{(pid=81361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 02:17:02.307201 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3193e5-8927-4c8c-a12c-2d0707be65d1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:17:02.308697 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3193e5-8927-4c8c-a12c-2d0707be65d1 None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:17:02.316991 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 160/321] 10.222.0.18 () {56 vars in 1376 bytes} [Wed Oct 12 02:17:02 2022] GET /identity/v3/role_assignments?group.id=2b5d93df759a456ab6de5b455fae6322&scope.project.id=fd1c4db151454810bdf01c589c22b7b7&role.id=3d75c4d7f1a849b9a771504d1583ab28 => generated 611 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 02:17:02.317428 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3193e5-8927-4c8c-a12c-2d0707be65d1 None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:17:02.342769 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 162/322] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Oct 12 02:17:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 12 02:17:02.344427 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b7a288-ebab-42c5-97c1-063abd8ea9d9 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:17:02.393554 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:17:02.432319 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3193e5-8927-4c8c-a12c-2d0707be65d1 None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:17:02.440603 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:17:02.471894 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7803478-6779-46a3-acba-be53a53b0b28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:17:02.472907 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7803478-6779-46a3-acba-be53a53b0b28 None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:02.473323 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7803478-6779-46a3-acba-be53a53b0b28 None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:02.473732 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7803478-6779-46a3-acba-be53a53b0b28 None admin] PATH_INFO: `/v3/projects/f4486b89b2274830aff946201a578806` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:02.475621 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7803478-6779-46a3-acba-be53a53b0b28 None admin] RBAC: Authorizing `identity:get_project(project_id=f4486b89b2274830aff946201a578806)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:17:02.477376 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7803478-6779-46a3-acba-be53a53b0b28 None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:17:02.479247 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 161/323] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Oct 12 02:17:02 2022] GET /identity/v3/projects/f4486b89b2274830aff946201a578806 => generated 302 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 02:17:02.483503 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b7a288-ebab-42c5-97c1-063abd8ea9d9 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:17:02.485414 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7803478-6779-46a3-acba-be53a53b0b28 None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:17:02.531406 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5ff9f0-5bfd-46c6-aec1-5dd14b890115 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:17:02.532034 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5ff9f0-5bfd-46c6-aec1-5dd14b890115 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:02.532292 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5ff9f0-5bfd-46c6-aec1-5dd14b890115 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:02.532598 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5ff9f0-5bfd-46c6-aec1-5dd14b890115 None admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:02.533276 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5ff9f0-5bfd-46c6-aec1-5dd14b890115 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 02:17:02.533575 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5ff9f0-5bfd-46c6-aec1-5dd14b890115 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:17:02.534942 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5ff9f0-5bfd-46c6-aec1-5dd14b890115 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:17:02.549070 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 163/324] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Oct 12 02:17:02 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 02:17:02.556491 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5ff9f0-5bfd-46c6-aec1-5dd14b890115 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:17:02.613640 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7803478-6779-46a3-acba-be53a53b0b28 None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:17:02.651789 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06de3004-593f-4ed0-b7df-166e4eb2efd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:17:02.652526 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06de3004-593f-4ed0-b7df-166e4eb2efd1 None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:02.652818 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06de3004-593f-4ed0-b7df-166e4eb2efd1 None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:02.653087 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06de3004-593f-4ed0-b7df-166e4eb2efd1 None admin] PATH_INFO: `/v3/groups/2b5d93df759a456ab6de5b455fae6322` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:02.654246 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06de3004-593f-4ed0-b7df-166e4eb2efd1 None admin] RBAC: Authorizing `identity:get_group(group_id=2b5d93df759a456ab6de5b455fae6322)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:17:02.656002 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06de3004-593f-4ed0-b7df-166e4eb2efd1 None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:17:02.657319 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 162/325] 10.222.0.18 () {56 vars in 1180 bytes} [Wed Oct 12 02:17:02 2022] GET /identity/v3/groups/2b5d93df759a456ab6de5b455fae6322 => generated 226 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 02:17:02.658071 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06de3004-593f-4ed0-b7df-166e4eb2efd1 None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:17:02.670495 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:17:02.680197 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5ff9f0-5bfd-46c6-aec1-5dd14b890115 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:17:02.709652 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:17:02.721594 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c17c507-8076-4b5b-8bf3-27ecb24126a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:17:02.722211 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c17c507-8076-4b5b-8bf3-27ecb24126a5 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:02.722504 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c17c507-8076-4b5b-8bf3-27ecb24126a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:02.722763 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c17c507-8076-4b5b-8bf3-27ecb24126a5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:02.778282 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06de3004-593f-4ed0-b7df-166e4eb2efd1 None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:17:02.806508 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c17c507-8076-4b5b-8bf3-27ecb24126a5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:17:02.807947 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c17c507-8076-4b5b-8bf3-27ecb24126a5 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:17:02.817369 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eac42fe-6caf-4239-9d25-0bb5644ce382 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:17:02.818007 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eac42fe-6caf-4239-9d25-0bb5644ce382 None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:02.818288 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eac42fe-6caf-4239-9d25-0bb5644ce382 None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:02.818568 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eac42fe-6caf-4239-9d25-0bb5644ce382 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:02.837023 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eac42fe-6caf-4239-9d25-0bb5644ce382 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 02:17:02.843776 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application [None req-9eac42fe-6caf-4239-9d25-0bb5644ce382 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 12 02:17:02.843776 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 02:17:02.843776 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 02:17:02.843776 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 02:17:02.843776 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 02:17:02.843776 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 02:17:02.843776 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 02:17:02.843776 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 02:17:02.843776 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 02:17:02.843776 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 02:17:02.843776 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 02:17:02.843776 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 02:17:02.843776 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 12 02:17:02.843776 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 12 02:17:02.843776 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 12 02:17:02.843776 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 12 02:17:02.844730 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 12 02:17:02.844730 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 12 02:17:02.844730 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 12 02:17:02.844730 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 12 02:17:02.844730 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 02:17:02.844730 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 02:17:02.844730 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 02:17:02.844730 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 02:17:02.844730 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 02:17:02.844730 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 02:17:02.844730 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 02:17:02.844730 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application with Lock( Oct 12 02:17:02.844730 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 02:17:02.844730 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._enter() Oct 12 02:17:02.844730 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 02:17:02.844730 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 02:17:02.845560 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 02:17:02.845560 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.creator() Oct 12 02:17:02.845560 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 02:17:02.845560 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application created_value = creator( Oct 12 02:17:02.845560 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 12 02:17:02.845560 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 12 02:17:02.845560 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 12 02:17:02.845560 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 12 02:17:02.845560 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 12 02:17:02.845560 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 12 02:17:02.845560 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 12 02:17:02.845560 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Oct 12 02:17:02.845560 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 163/326] 10.222.0.18 () {56 vars in 1096 bytes} [Wed Oct 12 02:17:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 02:17:02.846223 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eac42fe-6caf-4239-9d25-0bb5644ce382 None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:17:02.920457 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:17:02.929734 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 164/327] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Oct 12 02:17:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 12 02:17:02.930576 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c17c507-8076-4b5b-8bf3-27ecb24126a5 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:17:02.961899 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eac42fe-6caf-4239-9d25-0bb5644ce382 None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:17:02.963434 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:17:02.995854 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7179874-6628-4a84-850e-29a310c38656 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:17:02.996454 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7179874-6628-4a84-850e-29a310c38656 None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:02.996759 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7179874-6628-4a84-850e-29a310c38656 None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:02.997031 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7179874-6628-4a84-850e-29a310c38656 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:02.997769 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7179874-6628-4a84-850e-29a310c38656 None admin] RBAC: Adding query filter params (group.id=2b5d93df759a456ab6de5b455fae6322, role.id=3d75c4d7f1a849b9a771504d1583ab28, scope.project.id=f4486b89b2274830aff946201a578806) {{(pid=81361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 02:17:02.998083 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7179874-6628-4a84-850e-29a310c38656 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:17:02.999504 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7179874-6628-4a84-850e-29a310c38656 None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:17:03.005133 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 164/328] 10.222.0.18 () {56 vars in 1376 bytes} [Wed Oct 12 02:17:02 2022] GET /identity/v3/role_assignments?group.id=2b5d93df759a456ab6de5b455fae6322&scope.project.id=f4486b89b2274830aff946201a578806&role.id=3d75c4d7f1a849b9a771504d1583ab28 => generated 611 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 02:17:03.008715 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7179874-6628-4a84-850e-29a310c38656 None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:17:03.039704 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c17c507-8076-4b5b-8bf3-27ecb24126a5 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:17:03.079209 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b993545-afff-4067-aec7-343e011fa1e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:17:03.079947 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b993545-afff-4067-aec7-343e011fa1e3 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:03.080224 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b993545-afff-4067-aec7-343e011fa1e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:03.080514 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b993545-afff-4067-aec7-343e011fa1e3 None admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:03.081186 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b993545-afff-4067-aec7-343e011fa1e3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 02:17:03.081483 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b993545-afff-4067-aec7-343e011fa1e3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:17:03.082943 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b993545-afff-4067-aec7-343e011fa1e3 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:17:03.093981 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 165/329] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Oct 12 02:17:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 02:17:03.099805 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b993545-afff-4067-aec7-343e011fa1e3 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:17:03.125382 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7179874-6628-4a84-850e-29a310c38656 None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:17:03.165069 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247e074f-3d1d-4bfb-80f7-2b193dba95a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:17:03.165570 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:17:03.166500 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247e074f-3d1d-4bfb-80f7-2b193dba95a0 None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:03.166779 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247e074f-3d1d-4bfb-80f7-2b193dba95a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:03.167021 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247e074f-3d1d-4bfb-80f7-2b193dba95a0 None admin] PATH_INFO: `/v3/projects/f4486b89b2274830aff946201a578806` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:03.168252 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247e074f-3d1d-4bfb-80f7-2b193dba95a0 None admin] RBAC: Authorizing `identity:get_project(project_id=f4486b89b2274830aff946201a578806)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:17:03.169740 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247e074f-3d1d-4bfb-80f7-2b193dba95a0 None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:17:03.171440 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 165/330] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Oct 12 02:17:03 2022] GET /identity/v3/projects/f4486b89b2274830aff946201a578806 => generated 302 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 02:17:03.176899 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247e074f-3d1d-4bfb-80f7-2b193dba95a0 None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:17:03.215583 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:17:03.223722 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b993545-afff-4067-aec7-343e011fa1e3 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:17:03.265722 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d20ac26-5cc2-422c-9042-ebba5a8994e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:17:03.266345 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d20ac26-5cc2-422c-9042-ebba5a8994e7 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:03.266629 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d20ac26-5cc2-422c-9042-ebba5a8994e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:03.266907 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d20ac26-5cc2-422c-9042-ebba5a8994e7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:03.296332 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247e074f-3d1d-4bfb-80f7-2b193dba95a0 None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:17:03.338064 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6d9cc1-c070-4fd3-b71d-bb7ddf18c37e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:17:03.339198 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6d9cc1-c070-4fd3-b71d-bb7ddf18c37e None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:03.339743 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6d9cc1-c070-4fd3-b71d-bb7ddf18c37e None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:03.340204 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6d9cc1-c070-4fd3-b71d-bb7ddf18c37e None admin] PATH_INFO: `/v3/groups/2b5d93df759a456ab6de5b455fae6322` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:03.342086 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6d9cc1-c070-4fd3-b71d-bb7ddf18c37e None admin] RBAC: Authorizing `identity:get_group(group_id=2b5d93df759a456ab6de5b455fae6322)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:17:03.344300 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6d9cc1-c070-4fd3-b71d-bb7ddf18c37e None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:17:03.349892 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 166/331] 10.222.0.18 () {56 vars in 1180 bytes} [Wed Oct 12 02:17:03 2022] GET /identity/v3/groups/2b5d93df759a456ab6de5b455fae6322 => generated 226 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 02:17:03.350020 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d20ac26-5cc2-422c-9042-ebba5a8994e7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:17:03.350311 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d20ac26-5cc2-422c-9042-ebba5a8994e7 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:17:03.356790 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6d9cc1-c070-4fd3-b71d-bb7ddf18c37e None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:17:03.420970 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:17:03.465067 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6d9cc1-c070-4fd3-b71d-bb7ddf18c37e None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:17:03.465778 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 166/332] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Oct 12 02:17:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Oct 12 02:17:03.466500 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:17:03.471465 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d20ac26-5cc2-422c-9042-ebba5a8994e7 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:17:03.499816 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf96a164-0f74-4e6a-8b4a-41e65e4b511d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:17:03.500427 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf96a164-0f74-4e6a-8b4a-41e65e4b511d None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:03.500734 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf96a164-0f74-4e6a-8b4a-41e65e4b511d None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:03.501004 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf96a164-0f74-4e6a-8b4a-41e65e4b511d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:03.501714 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf96a164-0f74-4e6a-8b4a-41e65e4b511d None admin] RBAC: Adding query filter params (group.id=2b5d93df759a456ab6de5b455fae6322, role.id=7b67553aa5874cca8c47e5fb5ffa1971, scope.project.id=f4486b89b2274830aff946201a578806) {{(pid=81361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 02:17:03.502017 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf96a164-0f74-4e6a-8b4a-41e65e4b511d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:17:03.503435 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf96a164-0f74-4e6a-8b4a-41e65e4b511d None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:17:03.509727 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 167/333] 10.222.0.18 () {56 vars in 1376 bytes} [Wed Oct 12 02:17:03 2022] GET /identity/v3/role_assignments?group.id=2b5d93df759a456ab6de5b455fae6322&scope.project.id=f4486b89b2274830aff946201a578806&role.id=7b67553aa5874cca8c47e5fb5ffa1971 => generated 611 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 02:17:03.574255 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d20ac26-5cc2-422c-9042-ebba5a8994e7 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:17:03.610058 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6760a9e5-ca90-49a2-b861-cc9320311822 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:17:03.610711 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6760a9e5-ca90-49a2-b861-cc9320311822 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:03.610985 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6760a9e5-ca90-49a2-b861-cc9320311822 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:03.611254 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6760a9e5-ca90-49a2-b861-cc9320311822 None admin] PATH_INFO: `/v3/projects/ae04d11182384b63981888ea102e1452` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:03.612408 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6760a9e5-ca90-49a2-b861-cc9320311822 None admin] RBAC: Authorizing `identity:get_project(project_id=ae04d11182384b63981888ea102e1452)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:17:03.613883 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6760a9e5-ca90-49a2-b861-cc9320311822 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:17:03.615586 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 167/334] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Oct 12 02:17:03 2022] GET /identity/v3/projects/ae04d11182384b63981888ea102e1452 => generated 344 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 02:17:03.621543 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf96a164-0f74-4e6a-8b4a-41e65e4b511d None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:17:03.723325 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf96a164-0f74-4e6a-8b4a-41e65e4b511d None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:17:03.759945 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df5cfb4-c014-426f-a534-f6d5f9db0590 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:17:03.760988 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df5cfb4-c014-426f-a534-f6d5f9db0590 None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:03.761487 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df5cfb4-c014-426f-a534-f6d5f9db0590 None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:03.761937 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df5cfb4-c014-426f-a534-f6d5f9db0590 None admin] PATH_INFO: `/v3/groups/181ca0912dba4e6c81306e40308a3086` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:03.763394 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df5cfb4-c014-426f-a534-f6d5f9db0590 None admin] RBAC: Authorizing `identity:get_group(group_id=181ca0912dba4e6c81306e40308a3086)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:17:03.765199 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df5cfb4-c014-426f-a534-f6d5f9db0590 None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:17:03.766880 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 168/335] 10.222.0.18 () {56 vars in 1180 bytes} [Wed Oct 12 02:17:03 2022] GET /identity/v3/groups/181ca0912dba4e6c81306e40308a3086 => generated 229 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 02:17:03.772989 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6760a9e5-ca90-49a2-b861-cc9320311822 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:17:03.799930 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:17:03.878029 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6760a9e5-ca90-49a2-b861-cc9320311822 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:17:03.911629 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc09d7a2-edcf-438e-b252-e79e93e1af64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:17:03.912234 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc09d7a2-edcf-438e-b252-e79e93e1af64 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:03.912563 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc09d7a2-edcf-438e-b252-e79e93e1af64 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:03.912835 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc09d7a2-edcf-438e-b252-e79e93e1af64 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:03.913561 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc09d7a2-edcf-438e-b252-e79e93e1af64 None admin] RBAC: Adding query filter params (group.id=181ca0912dba4e6c81306e40308a3086, role.id=39b1e8108dff402383def3c559f48189, scope.project.id=ae04d11182384b63981888ea102e1452) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 02:17:03.913864 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc09d7a2-edcf-438e-b252-e79e93e1af64 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:17:03.915280 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc09d7a2-edcf-438e-b252-e79e93e1af64 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:17:03.920836 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 168/336] 10.222.0.18 () {56 vars in 1376 bytes} [Wed Oct 12 02:17:03 2022] GET /identity/v3/role_assignments?group.id=181ca0912dba4e6c81306e40308a3086&scope.project.id=ae04d11182384b63981888ea102e1452&role.id=39b1e8108dff402383def3c559f48189 => generated 611 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 02:17:06.421940 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e94ee61-5f76-4f6f-86b3-a4b3f83d49aa None None] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:06.422560 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e94ee61-5f76-4f6f-86b3-a4b3f83d49aa None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:06.422560 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e94ee61-5f76-4f6f-86b3-a4b3f83d49aa None None] PATH_INFO: `/` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:06.424046 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 169/337] 10.222.0.18 () {54 vars in 927 bytes} [Wed Oct 12 02:17:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 02:17:06.430564 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5eca1e-5ab9-4416-b3cb-4236d7cd5568 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:06.431388 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5eca1e-5ab9-4416-b3cb-4236d7cd5568 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:06.431817 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5eca1e-5ab9-4416-b3cb-4236d7cd5568 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:06.456620 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-cf5eca1e-5ab9-4416-b3cb-4236d7cd5568 None None] MFA Rules not processed for user `a326a5bb7364479382f528a592371656`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:17:06.458182 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-cf5eca1e-5ab9-4416-b3cb-4236d7cd5568 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:17:06.559292 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 169/338] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Oct 12 02:17:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 12 02:17:06.906564 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b751b2c-a305-49e6-9fb5-56131e541c09 None None] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:06.906969 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b751b2c-a305-49e6-9fb5-56131e541c09 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:06.907154 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b751b2c-a305-49e6-9fb5-56131e541c09 None None] PATH_INFO: `/` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:06.908850 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 170/339] 10.222.0.18 () {54 vars in 927 bytes} [Wed Oct 12 02:17:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 02:17:06.915169 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b82a28-bc77-4e8f-b3a0-70b1d3647861 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:06.915507 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b82a28-bc77-4e8f-b3a0-70b1d3647861 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:06.915718 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b82a28-bc77-4e8f-b3a0-70b1d3647861 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:06.940978 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-d1b82a28-bc77-4e8f-b3a0-70b1d3647861 None None] MFA Rules not processed for user `a326a5bb7364479382f528a592371656`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:17:06.941199 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b751b2c-a305-49e6-9fb5-56131e541c09 None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:17:06.942186 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-d1b82a28-bc77-4e8f-b3a0-70b1d3647861 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:17:06.970996 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:17:07.012824 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:17:07.064610 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 170/340] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Oct 12 02:17:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 12 02:17:07.065846 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3537da33-fec9-4111-aeac-2115b633a3fe None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:07.066233 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3537da33-fec9-4111-aeac-2115b633a3fe None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:07.066510 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3537da33-fec9-4111-aeac-2115b633a3fe None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:07.072552 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 171/341] 10.222.0.18 () {54 vars in 927 bytes} [Wed Oct 12 02:17:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 02:17:07.073844 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28f93a9-0f35-446b-99eb-0143024ce516 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:07.074298 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28f93a9-0f35-446b-99eb-0143024ce516 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:07.074643 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28f93a9-0f35-446b-99eb-0143024ce516 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:07.093816 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-e28f93a9-0f35-446b-99eb-0143024ce516 None None] MFA Rules not processed for user `a326a5bb7364479382f528a592371656`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:17:07.095138 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-e28f93a9-0f35-446b-99eb-0143024ce516 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:17:07.102202 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b751b2c-a305-49e6-9fb5-56131e541c09 None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:17:07.148528 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8999dc-9fbb-48bf-8ced-436d5b0b9c18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:17:07.149428 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8999dc-9fbb-48bf-8ced-436d5b0b9c18 None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:07.149703 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8999dc-9fbb-48bf-8ced-436d5b0b9c18 None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:07.149972 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8999dc-9fbb-48bf-8ced-436d5b0b9c18 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:07.164107 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8999dc-9fbb-48bf-8ced-436d5b0b9c18 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:17:07.166207 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8999dc-9fbb-48bf-8ced-436d5b0b9c18 None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:17:07.169465 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 172/342] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Oct 12 02:17:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 12 02:17:07.181818 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application [None req-fe8999dc-9fbb-48bf-8ced-436d5b0b9c18 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 02:17:07.181818 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 02:17:07.181818 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 02:17:07.181818 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 02:17:07.181818 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 02:17:07.181818 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 02:17:07.181818 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 02:17:07.181818 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 02:17:07.181818 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 02:17:07.181818 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 02:17:07.181818 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 02:17:07.181818 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 02:17:07.181818 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 12 02:17:07.181818 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 12 02:17:07.181818 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 12 02:17:07.181818 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 12 02:17:07.182799 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 02:17:07.182799 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 02:17:07.182799 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 02:17:07.182799 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 02:17:07.182799 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 02:17:07.182799 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 02:17:07.182799 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 02:17:07.182799 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application with Lock( Oct 12 02:17:07.182799 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 02:17:07.182799 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._enter() Oct 12 02:17:07.182799 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 02:17:07.182799 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 02:17:07.182799 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 02:17:07.182799 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.creator() Oct 12 02:17:07.182799 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 02:17:07.182799 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application created_value = creator( Oct 12 02:17:07.182799 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 12 02:17:07.184326 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 12 02:17:07.184326 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 02:17:07.184326 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Oct 12 02:17:07.184326 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 171/343] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Oct 12 02:17:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 02:17:07.197506 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28f93a9-0f35-446b-99eb-0143024ce516 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:17:07.324440 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:17:07.355832 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28f93a9-0f35-446b-99eb-0143024ce516 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:17:07.406082 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12326289-013b-4e3f-9623-db7d762f1236 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:17:07.407000 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12326289-013b-4e3f-9623-db7d762f1236 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:07.407439 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12326289-013b-4e3f-9623-db7d762f1236 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:07.407873 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12326289-013b-4e3f-9623-db7d762f1236 None admin] PATH_INFO: `/v3/domains` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:07.408713 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12326289-013b-4e3f-9623-db7d762f1236 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 02:17:07.409177 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12326289-013b-4e3f-9623-db7d762f1236 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:17:07.410688 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12326289-013b-4e3f-9623-db7d762f1236 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:17:07.423336 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 173/344] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Oct 12 02:17:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 02:17:07.432029 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8999dc-9fbb-48bf-8ced-436d5b0b9c18 None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:17:07.433457 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12326289-013b-4e3f-9623-db7d762f1236 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:17:07.580889 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:17:07.585066 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8999dc-9fbb-48bf-8ced-436d5b0b9c18 None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:17:07.596835 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12326289-013b-4e3f-9623-db7d762f1236 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:17:07.635883 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50817563-ca21-448c-9a65-3007e5966048 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:17:07.636548 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50817563-ca21-448c-9a65-3007e5966048 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:07.636830 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50817563-ca21-448c-9a65-3007e5966048 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:07.637102 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50817563-ca21-448c-9a65-3007e5966048 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:07.639186 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee0cae3-12f0-482e-921a-ff84610ede90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:17:07.640196 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee0cae3-12f0-482e-921a-ff84610ede90 None admin] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:07.640482 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee0cae3-12f0-482e-921a-ff84610ede90 None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:07.640761 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee0cae3-12f0-482e-921a-ff84610ede90 None admin] PATH_INFO: `/v3/users` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:07.641461 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee0cae3-12f0-482e-921a-ff84610ede90 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:17:07.642887 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee0cae3-12f0-482e-921a-ff84610ede90 None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:17:07.644770 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:17:07.650153 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50817563-ca21-448c-9a65-3007e5966048 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:17:07.651584 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50817563-ca21-448c-9a65-3007e5966048 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:17:07.666955 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-50817563-ca21-448c-9a65-3007e5966048 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 02:17:07.666955 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 02:17:07.666955 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 02:17:07.666955 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 02:17:07.666955 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 02:17:07.666955 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 02:17:07.666955 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 02:17:07.666955 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 02:17:07.666955 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 02:17:07.666955 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 02:17:07.666955 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 02:17:07.666955 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 02:17:07.666955 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 12 02:17:07.666955 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 12 02:17:07.666955 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 12 02:17:07.666955 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 12 02:17:07.667902 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 02:17:07.667902 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 02:17:07.667902 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 02:17:07.667902 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 02:17:07.667902 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 02:17:07.667902 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 02:17:07.667902 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 02:17:07.667902 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Oct 12 02:17:07.667902 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 02:17:07.667902 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Oct 12 02:17:07.667902 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 02:17:07.667902 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 02:17:07.667902 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 02:17:07.667902 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Oct 12 02:17:07.667902 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 02:17:07.667902 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Oct 12 02:17:07.667902 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 12 02:17:07.668868 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 12 02:17:07.668868 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 02:17:07.668868 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Oct 12 02:17:07.669041 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 172/345] 10.222.0.18 () {60 vars in 1132 bytes} [Wed Oct 12 02:17:07 2022] POST /identity/v3/users => generated 246 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 02:17:07.669041 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee0cae3-12f0-482e-921a-ff84610ede90 None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:17:07.680627 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 174/346] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Oct 12 02:17:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 12 02:17:07.680627 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46864cbe-1c5f-4477-9ecf-008e048dbccb None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:07.680627 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46864cbe-1c5f-4477-9ecf-008e048dbccb None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:07.680627 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46864cbe-1c5f-4477-9ecf-008e048dbccb None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:07.680627 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 175/347] 10.222.0.18 () {54 vars in 927 bytes} [Wed Oct 12 02:17:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 02:17:07.683512 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85121239-23e2-4d92-b52c-0141b76e5acd None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:07.683966 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85121239-23e2-4d92-b52c-0141b76e5acd None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:07.684383 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85121239-23e2-4d92-b52c-0141b76e5acd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:07.705229 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-85121239-23e2-4d92-b52c-0141b76e5acd None None] MFA Rules not processed for user `a326a5bb7364479382f528a592371656`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:17:07.706792 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-85121239-23e2-4d92-b52c-0141b76e5acd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:17:07.788962 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 176/348] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Oct 12 02:17:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 12 02:17:07.790220 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85121239-23e2-4d92-b52c-0141b76e5acd None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:17:07.812441 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee0cae3-12f0-482e-921a-ff84610ede90 None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:17:07.858047 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd9e1ba-c4a7-4f4c-803a-d4c21a82118b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:17:07.859174 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd9e1ba-c4a7-4f4c-803a-d4c21a82118b None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:07.859595 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd9e1ba-c4a7-4f4c-803a-d4c21a82118b None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:07.859976 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd9e1ba-c4a7-4f4c-803a-d4c21a82118b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:07.874628 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd9e1ba-c4a7-4f4c-803a-d4c21a82118b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:17:07.876273 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd9e1ba-c4a7-4f4c-803a-d4c21a82118b None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:17:07.878530 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:17:07.898674 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application [None req-6fd9e1ba-c4a7-4f4c-803a-d4c21a82118b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 02:17:07.898674 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 02:17:07.898674 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 02:17:07.898674 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 02:17:07.898674 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 02:17:07.898674 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 02:17:07.898674 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 02:17:07.898674 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 02:17:07.898674 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 02:17:07.898674 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 02:17:07.898674 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 02:17:07.898674 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 02:17:07.898674 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 12 02:17:07.898674 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 12 02:17:07.898674 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 12 02:17:07.898674 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 12 02:17:07.899645 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 02:17:07.899645 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 02:17:07.899645 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 02:17:07.899645 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 02:17:07.899645 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 02:17:07.899645 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 02:17:07.899645 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 02:17:07.899645 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application with Lock( Oct 12 02:17:07.899645 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 02:17:07.899645 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._enter() Oct 12 02:17:07.899645 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 02:17:07.899645 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 02:17:07.899645 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 02:17:07.899645 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.creator() Oct 12 02:17:07.899645 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 02:17:07.899645 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application created_value = creator( Oct 12 02:17:07.899645 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 12 02:17:07.900905 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 12 02:17:07.900905 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 02:17:07.900905 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Oct 12 02:17:07.900905 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 173/349] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Oct 12 02:17:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 02:17:07.906228 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd9e1ba-c4a7-4f4c-803a-d4c21a82118b None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:17:07.984377 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85121239-23e2-4d92-b52c-0141b76e5acd None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:17:08.012842 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:17:08.029838 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac82b36a-ba7f-45db-91d1-2a9e686df0f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:17:08.030461 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac82b36a-ba7f-45db-91d1-2a9e686df0f6 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:08.030741 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac82b36a-ba7f-45db-91d1-2a9e686df0f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:08.031013 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac82b36a-ba7f-45db-91d1-2a9e686df0f6 None admin] PATH_INFO: `/v3/domains` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:08.031659 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac82b36a-ba7f-45db-91d1-2a9e686df0f6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 02:17:08.031962 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac82b36a-ba7f-45db-91d1-2a9e686df0f6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:17:08.033355 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac82b36a-ba7f-45db-91d1-2a9e686df0f6 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:17:08.034085 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd9e1ba-c4a7-4f4c-803a-d4c21a82118b None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:17:08.045976 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 177/350] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Oct 12 02:17:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 02:17:08.047213 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2835cde4-f379-4b27-a1fe-a3c0c5f8a392 None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:08.047500 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2835cde4-f379-4b27-a1fe-a3c0c5f8a392 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:08.047774 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2835cde4-f379-4b27-a1fe-a3c0c5f8a392 None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:08.054381 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 178/351] 10.222.0.18 () {54 vars in 927 bytes} [Wed Oct 12 02:17:08 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 02:17:08.054996 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2835cde4-f379-4b27-a1fe-a3c0c5f8a392 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:17:08.073045 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e7f142-fcf3-442a-80f5-13fa5a1b1d94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:17:08.073798 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e7f142-fcf3-442a-80f5-13fa5a1b1d94 None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:08.074180 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e7f142-fcf3-442a-80f5-13fa5a1b1d94 None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:08.074574 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e7f142-fcf3-442a-80f5-13fa5a1b1d94 None admin] PATH_INFO: `/v3/domains` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:08.075445 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e7f142-fcf3-442a-80f5-13fa5a1b1d94 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 02:17:08.075844 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e7f142-fcf3-442a-80f5-13fa5a1b1d94 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:17:08.077559 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e7f142-fcf3-442a-80f5-13fa5a1b1d94 None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:17:08.095343 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 174/352] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Oct 12 02:17:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 02:17:08.095343 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cb32f4-0f81-4250-8c86-2be8cf223af5 None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:08.095343 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cb32f4-0f81-4250-8c86-2be8cf223af5 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:08.095343 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cb32f4-0f81-4250-8c86-2be8cf223af5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:08.112954 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-e0cb32f4-0f81-4250-8c86-2be8cf223af5 None None] MFA Rules not processed for user `a326a5bb7364479382f528a592371656`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:17:08.114159 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-e0cb32f4-0f81-4250-8c86-2be8cf223af5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:17:08.165825 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:17:08.175580 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2835cde4-f379-4b27-a1fe-a3c0c5f8a392 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:17:08.184830 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 175/353] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Oct 12 02:17:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 12 02:17:08.193776 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cb32f4-0f81-4250-8c86-2be8cf223af5 None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:17:08.214824 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a6b631-675d-41e6-8fa6-a9b0da947f6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:17:08.215572 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a6b631-675d-41e6-8fa6-a9b0da947f6e None admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:08.215872 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a6b631-675d-41e6-8fa6-a9b0da947f6e None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:08.216223 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a6b631-675d-41e6-8fa6-a9b0da947f6e None admin] PATH_INFO: `/v3/users` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:08.216999 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a6b631-675d-41e6-8fa6-a9b0da947f6e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:17:08.218629 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a6b631-675d-41e6-8fa6-a9b0da947f6e None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:17:08.248588 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 179/354] 10.222.0.18 () {60 vars in 1132 bytes} [Wed Oct 12 02:17:08 2022] POST /identity/v3/users => generated 248 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 02:17:08.248588 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a6b631-675d-41e6-8fa6-a9b0da947f6e None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:17:08.341525 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:17:08.386007 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cb32f4-0f81-4250-8c86-2be8cf223af5 None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:17:08.431563 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e71c91-2534-42ca-a142-f5f81a300fd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:17:08.432614 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e71c91-2534-42ca-a142-f5f81a300fd6 None admin] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:08.433627 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e71c91-2534-42ca-a142-f5f81a300fd6 None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:08.434128 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e71c91-2534-42ca-a142-f5f81a300fd6 None admin] PATH_INFO: `/v3/users` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:08.435012 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e71c91-2534-42ca-a142-f5f81a300fd6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:17:08.436706 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e71c91-2534-42ca-a142-f5f81a300fd6 None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:17:08.464489 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 176/355] 10.222.0.18 () {60 vars in 1132 bytes} [Wed Oct 12 02:17:08 2022] POST /identity/v3/users => generated 248 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 02:17:08.482430 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e71c91-2534-42ca-a142-f5f81a300fd6 None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:17:08.499656 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a6b631-675d-41e6-8fa6-a9b0da947f6e None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:17:08.542201 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:17:08.571478 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08c2e40-9fb0-4306-b325-1a9c93aa7b40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:17:08.572656 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08c2e40-9fb0-4306-b325-1a9c93aa7b40 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:08.573313 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08c2e40-9fb0-4306-b325-1a9c93aa7b40 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:08.573798 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08c2e40-9fb0-4306-b325-1a9c93aa7b40 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:08.587250 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08c2e40-9fb0-4306-b325-1a9c93aa7b40 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:17:08.589192 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08c2e40-9fb0-4306-b325-1a9c93aa7b40 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:17:08.608616 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-c08c2e40-9fb0-4306-b325-1a9c93aa7b40 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 02:17:08.608616 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 02:17:08.608616 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 02:17:08.608616 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 02:17:08.608616 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 02:17:08.608616 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 02:17:08.608616 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 02:17:08.608616 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 02:17:08.608616 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 02:17:08.608616 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 02:17:08.608616 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 02:17:08.608616 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 02:17:08.608616 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 12 02:17:08.608616 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 12 02:17:08.608616 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 12 02:17:08.608616 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 12 02:17:08.609608 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 02:17:08.609608 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 02:17:08.609608 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 02:17:08.609608 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 02:17:08.609608 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 02:17:08.609608 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 02:17:08.609608 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 02:17:08.609608 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Oct 12 02:17:08.609608 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 02:17:08.609608 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Oct 12 02:17:08.609608 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 02:17:08.609608 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 02:17:08.609608 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 02:17:08.609608 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Oct 12 02:17:08.609608 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 02:17:08.609608 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Oct 12 02:17:08.609608 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 12 02:17:08.610448 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 12 02:17:08.610448 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 02:17:08.610448 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Oct 12 02:17:08.612972 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 180/356] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Oct 12 02:17:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 369 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 02:17:08.624602 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08c2e40-9fb0-4306-b325-1a9c93aa7b40 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:17:08.629187 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e71c91-2534-42ca-a142-f5f81a300fd6 None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:17:08.702229 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f98d09-ddaa-4736-a2bd-3e1d96e8bc0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:17:08.703011 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f98d09-ddaa-4736-a2bd-3e1d96e8bc0b None admin] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:08.703295 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f98d09-ddaa-4736-a2bd-3e1d96e8bc0b None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:08.703566 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f98d09-ddaa-4736-a2bd-3e1d96e8bc0b None admin] PATH_INFO: `/v3/roles` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:08.704236 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f98d09-ddaa-4736-a2bd-3e1d96e8bc0b None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:17:08.710690 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f98d09-ddaa-4736-a2bd-3e1d96e8bc0b None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:17:08.722125 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.sql.core [None req-95f98d09-ddaa-4736-a2bd-3e1d96e8bc0b None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Oct 12 02:17:08.722125 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Oct 12 02:17:08.722125 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [parameters: {'id': '3a4e83c0d5614f9da1ee1cd34e0755e4', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Oct 12 02:17:08.722125 dv-cinder-849143-14-smb devstack@keystone.service[81361]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81361) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 12 02:17:08.741560 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application [None req-95f98d09-ddaa-4736-a2bd-3e1d96e8bc0b None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Oct 12 02:17:08.741560 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 02:17:08.741560 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 12 02:17:08.741560 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 12 02:17:08.741560 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 12 02:17:08.741560 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 12 02:17:08.741560 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 12 02:17:08.741560 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application result = self._query(query) Oct 12 02:17:08.741560 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 12 02:17:08.741560 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application conn.query(q) Oct 12 02:17:08.741560 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 12 02:17:08.741560 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 12 02:17:08.741560 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 12 02:17:08.741560 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application result.read() Oct 12 02:17:08.741560 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 12 02:17:08.742502 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 12 02:17:08.742502 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 12 02:17:08.742502 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 12 02:17:08.742502 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 12 02:17:08.742502 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 12 02:17:08.742502 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 12 02:17:08.742502 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 12 02:17:08.742502 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Oct 12 02:17:08.742502 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Oct 12 02:17:08.742502 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 12 02:17:08.742502 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Oct 12 02:17:08.742502 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 02:17:08.742502 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 12 02:17:08.742502 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 12 02:17:08.742502 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Oct 12 02:17:08.742502 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return ref.to_dict() Oct 12 02:17:08.742502 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 12 02:17:08.742502 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application next(self.gen) Oct 12 02:17:08.743434 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Oct 12 02:17:08.743434 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application yield resource Oct 12 02:17:08.743434 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 12 02:17:08.743434 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application next(self.gen) Oct 12 02:17:08.743434 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Oct 12 02:17:08.743434 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application self.session.rollback() Oct 12 02:17:08.743434 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 12 02:17:08.743434 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application self.force_reraise() Oct 12 02:17:08.743434 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 12 02:17:08.743434 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application raise self.value Oct 12 02:17:08.743434 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Oct 12 02:17:08.743434 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 12 02:17:08.743434 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Oct 12 02:17:08.743434 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application session.commit() Oct 12 02:17:08.743434 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 12 02:17:08.743434 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 12 02:17:08.743434 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 12 02:17:08.744285 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application self._prepare_impl() Oct 12 02:17:08.744285 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 12 02:17:08.744285 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application self.session.flush() Oct 12 02:17:08.744285 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 12 02:17:08.744285 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application self._flush(objects) Oct 12 02:17:08.744285 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 12 02:17:08.744285 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 12 02:17:08.744285 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 12 02:17:08.744285 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application compat.raise_( Oct 12 02:17:08.744285 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 12 02:17:08.744285 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application raise exception Oct 12 02:17:08.744285 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 12 02:17:08.744285 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application flush_context.execute() Oct 12 02:17:08.744285 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 12 02:17:08.744285 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application rec.execute(self) Oct 12 02:17:08.744285 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 12 02:17:08.744285 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 12 02:17:08.745930 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 12 02:17:08.745930 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 12 02:17:08.745930 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Oct 12 02:17:08.745930 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application c = connection._execute_20( Oct 12 02:17:08.745930 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 12 02:17:08.745930 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 12 02:17:08.745930 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 12 02:17:08.745930 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 12 02:17:08.745930 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 12 02:17:08.745930 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 12 02:17:08.745930 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 12 02:17:08.745930 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 12 02:17:08.745930 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 12 02:17:08.745930 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 12 02:17:08.745930 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 12 02:17:08.745930 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application raise exception Oct 12 02:17:08.746725 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 12 02:17:08.746725 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 12 02:17:08.746725 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 12 02:17:08.746725 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 12 02:17:08.746725 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 12 02:17:08.746725 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application result = self._query(query) Oct 12 02:17:08.746725 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 12 02:17:08.746725 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application conn.query(q) Oct 12 02:17:08.746725 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 12 02:17:08.746725 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 12 02:17:08.746725 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 12 02:17:08.746725 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application result.read() Oct 12 02:17:08.746725 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 12 02:17:08.746725 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 12 02:17:08.746725 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 12 02:17:08.746725 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 12 02:17:08.747505 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 12 02:17:08.747505 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 12 02:17:08.747505 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 12 02:17:08.747505 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 12 02:17:08.747505 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Oct 12 02:17:08.747505 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Oct 12 02:17:08.747505 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application [parameters: {'id': '3a4e83c0d5614f9da1ee1cd34e0755e4', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Oct 12 02:17:08.747505 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 12 02:17:08.747505 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Oct 12 02:17:08.747505 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 12 02:17:08.747505 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Oct 12 02:17:08.747505 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 02:17:08.747505 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 02:17:08.747505 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 02:17:08.747505 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 02:17:08.747505 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 02:17:08.748305 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 02:17:08.748305 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 02:17:08.748305 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 02:17:08.748305 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 02:17:08.748305 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 02:17:08.748305 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 02:17:08.748305 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Oct 12 02:17:08.748305 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Oct 12 02:17:08.748305 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 02:17:08.748305 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 02:17:08.748305 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Oct 12 02:17:08.748305 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Oct 12 02:17:08.748305 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 12 02:17:08.748305 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 12 02:17:08.748305 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Oct 12 02:17:08.748305 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Oct 12 02:17:08.753253 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 177/357] 10.222.0.18 () {60 vars in 1131 bytes} [Wed Oct 12 02:17:08 2022] POST /identity/v3/roles => generated 144 bytes in 261 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Oct 12 02:17:08.753253 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f98d09-ddaa-4736-a2bd-3e1d96e8bc0b None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:17:08.797826 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:17:08.813700 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08c2e40-9fb0-4306-b325-1a9c93aa7b40 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:17:08.860999 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428822c0-747a-4a64-a724-d403dad26440 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:17:08.861650 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428822c0-747a-4a64-a724-d403dad26440 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:08.861940 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428822c0-747a-4a64-a724-d403dad26440 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:08.862203 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428822c0-747a-4a64-a724-d403dad26440 None admin] PATH_INFO: `/v3/domains` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:08.863429 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428822c0-747a-4a64-a724-d403dad26440 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 02:17:08.863741 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428822c0-747a-4a64-a724-d403dad26440 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:17:08.865699 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428822c0-747a-4a64-a724-d403dad26440 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:17:08.884156 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 181/358] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Oct 12 02:17:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 02:17:08.889130 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428822c0-747a-4a64-a724-d403dad26440 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:17:08.909484 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f98d09-ddaa-4736-a2bd-3e1d96e8bc0b None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:17:08.913491 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:17:08.973167 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f02b3e2-b166-4bcb-b567-6a0c08d02a2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:17:08.975436 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f02b3e2-b166-4bcb-b567-6a0c08d02a2d None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:08.975787 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f02b3e2-b166-4bcb-b567-6a0c08d02a2d None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:08.976069 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f02b3e2-b166-4bcb-b567-6a0c08d02a2d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:08.999897 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f02b3e2-b166-4bcb-b567-6a0c08d02a2d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 02:17:09.011579 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application [None req-4f02b3e2-b166-4bcb-b567-6a0c08d02a2d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 12 02:17:09.011579 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 02:17:09.011579 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 02:17:09.011579 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 02:17:09.011579 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 02:17:09.011579 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 02:17:09.011579 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 02:17:09.011579 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 02:17:09.011579 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 02:17:09.011579 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 02:17:09.011579 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 02:17:09.011579 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 02:17:09.011579 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 12 02:17:09.011579 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 12 02:17:09.011579 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 12 02:17:09.011579 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 12 02:17:09.012554 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 12 02:17:09.012554 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 12 02:17:09.012554 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 12 02:17:09.012554 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 12 02:17:09.012554 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 02:17:09.012554 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 02:17:09.012554 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 02:17:09.012554 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 02:17:09.012554 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 02:17:09.012554 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 02:17:09.012554 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 02:17:09.012554 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application with Lock( Oct 12 02:17:09.012554 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 02:17:09.012554 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._enter() Oct 12 02:17:09.012554 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 02:17:09.012554 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 02:17:09.013386 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 02:17:09.013386 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.creator() Oct 12 02:17:09.013386 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 02:17:09.013386 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application created_value = creator( Oct 12 02:17:09.013386 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 12 02:17:09.013386 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 12 02:17:09.013386 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 12 02:17:09.013386 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 12 02:17:09.013386 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 12 02:17:09.013386 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 12 02:17:09.013386 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 12 02:17:09.013386 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Oct 12 02:17:09.013386 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 178/359] 10.222.0.18 () {56 vars in 1114 bytes} [Wed Oct 12 02:17:08 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 02:17:09.022316 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f02b3e2-b166-4bcb-b567-6a0c08d02a2d None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:17:09.089031 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428822c0-747a-4a64-a724-d403dad26440 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:17:09.155676 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791e2e05-36e7-44c6-88fa-eaf00af21089 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:17:09.156876 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791e2e05-36e7-44c6-88fa-eaf00af21089 None admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:09.157510 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791e2e05-36e7-44c6-88fa-eaf00af21089 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:09.157983 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791e2e05-36e7-44c6-88fa-eaf00af21089 None admin] PATH_INFO: `/v3/users` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:09.158891 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791e2e05-36e7-44c6-88fa-eaf00af21089 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:17:09.160542 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791e2e05-36e7-44c6-88fa-eaf00af21089 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:17:09.192816 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 182/360] 10.222.0.18 () {60 vars in 1132 bytes} [Wed Oct 12 02:17:08 2022] POST /identity/v3/users => generated 249 bytes in 304 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 02:17:09.220971 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f02b3e2-b166-4bcb-b567-6a0c08d02a2d None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:17:09.270255 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c91a20c-f73c-4f03-a9fc-eb5cba3e61dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:17:09.270794 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c91a20c-f73c-4f03-a9fc-eb5cba3e61dd None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:09.271065 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c91a20c-f73c-4f03-a9fc-eb5cba3e61dd None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:09.271490 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c91a20c-f73c-4f03-a9fc-eb5cba3e61dd None admin] PATH_INFO: `/v3/roles` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:09.272518 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c91a20c-f73c-4f03-a9fc-eb5cba3e61dd None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 02:17:09.272828 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c91a20c-f73c-4f03-a9fc-eb5cba3e61dd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:17:09.274277 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c91a20c-f73c-4f03-a9fc-eb5cba3e61dd None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:17:09.283511 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 179/361] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Oct 12 02:17:09 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 02:17:10.193296 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecce7f3a-270a-48b0-8650-b01fa41147f2 None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:10.194316 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecce7f3a-270a-48b0-8650-b01fa41147f2 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:10.194797 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecce7f3a-270a-48b0-8650-b01fa41147f2 None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:10.196374 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 183/362] 10.222.0.18 () {54 vars in 927 bytes} [Wed Oct 12 02:17:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 02:17:10.201839 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6150914-f47f-4930-bc9f-6acde8f05fc9 None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:10.202672 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6150914-f47f-4930-bc9f-6acde8f05fc9 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:10.203173 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6150914-f47f-4930-bc9f-6acde8f05fc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:10.227098 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-b6150914-f47f-4930-bc9f-6acde8f05fc9 None None] MFA Rules not processed for user `a326a5bb7364479382f528a592371656`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:17:10.228713 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-b6150914-f47f-4930-bc9f-6acde8f05fc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:17:10.252035 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:17:10.314760 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 180/363] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Oct 12 02:17:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 12 02:17:10.619195 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecce7f3a-270a-48b0-8650-b01fa41147f2 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:17:10.623107 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:17:10.751161 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecce7f3a-270a-48b0-8650-b01fa41147f2 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:17:10.790473 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb5423d-5f73-40cd-941b-f3e80332b687 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:17:10.791023 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb5423d-5f73-40cd-941b-f3e80332b687 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:10.791296 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb5423d-5f73-40cd-941b-f3e80332b687 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:10.791565 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb5423d-5f73-40cd-941b-f3e80332b687 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:10.802019 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb5423d-5f73-40cd-941b-f3e80332b687 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 02:17:10.807434 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-bfb5423d-5f73-40cd-941b-f3e80332b687 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 12 02:17:10.807434 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 02:17:10.807434 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 02:17:10.807434 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 02:17:10.807434 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 02:17:10.807434 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 02:17:10.807434 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 02:17:10.807434 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 02:17:10.807434 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 02:17:10.807434 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 02:17:10.807434 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 02:17:10.807434 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 02:17:10.807434 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 12 02:17:10.807434 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 12 02:17:10.807434 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 12 02:17:10.807434 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 12 02:17:10.808327 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 12 02:17:10.808327 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 12 02:17:10.808327 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 12 02:17:10.808327 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 12 02:17:10.808327 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 02:17:10.808327 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 02:17:10.808327 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 02:17:10.808327 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 02:17:10.808327 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 02:17:10.808327 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 02:17:10.808327 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 02:17:10.808327 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Oct 12 02:17:10.808327 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 02:17:10.808327 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Oct 12 02:17:10.808327 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 02:17:10.808327 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 02:17:10.809179 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 02:17:10.809179 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Oct 12 02:17:10.809179 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 02:17:10.809179 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Oct 12 02:17:10.809179 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 12 02:17:10.809179 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 12 02:17:10.809179 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 12 02:17:10.809179 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 12 02:17:10.809179 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 12 02:17:10.809179 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 12 02:17:10.809179 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 12 02:17:10.809179 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Oct 12 02:17:10.809179 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 184/364] 10.222.0.18 () {56 vars in 1102 bytes} [Wed Oct 12 02:17:10 2022] GET /identity/v3/roles/service => generated 85 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 02:17:10.814694 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6150914-f47f-4930-bc9f-6acde8f05fc9 None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:17:10.951228 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6150914-f47f-4930-bc9f-6acde8f05fc9 None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:17:11.003684 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe07c9c-78f0-46cc-94ca-c697a42898b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:17:11.004289 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe07c9c-78f0-46cc-94ca-c697a42898b7 None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:11.004587 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe07c9c-78f0-46cc-94ca-c697a42898b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:11.004861 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe07c9c-78f0-46cc-94ca-c697a42898b7 None admin] PATH_INFO: `/v3/roles` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:11.005512 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe07c9c-78f0-46cc-94ca-c697a42898b7 None admin] RBAC: Adding query filter params (name=service) {{(pid=81361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 02:17:11.006036 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe07c9c-78f0-46cc-94ca-c697a42898b7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:17:11.007429 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe07c9c-78f0-46cc-94ca-c697a42898b7 None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:17:11.019673 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 181/365] 10.222.0.18 () {56 vars in 1103 bytes} [Wed Oct 12 02:17:10 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 02:17:11.026039 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb5423d-5f73-40cd-941b-f3e80332b687 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:17:11.120924 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:17:11.164408 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7200cc-0f94-46e1-bf45-3e7eaf47a5a2 None None] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:11.164769 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7200cc-0f94-46e1-bf45-3e7eaf47a5a2 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:11.164988 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7200cc-0f94-46e1-bf45-3e7eaf47a5a2 None None] PATH_INFO: `/` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:11.165752 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb5423d-5f73-40cd-941b-f3e80332b687 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:17:11.166566 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 182/366] 10.222.0.18 () {54 vars in 927 bytes} [Wed Oct 12 02:17:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 02:17:11.171503 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b0b86f-df74-4cac-b7b3-1d2f5b393c1e None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:11.171806 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b0b86f-df74-4cac-b7b3-1d2f5b393c1e None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:11.172042 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b0b86f-df74-4cac-b7b3-1d2f5b393c1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:11.200220 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c4bb0f-3fbc-4ba2-b709-4f22e5e92a70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:17:11.200980 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c4bb0f-3fbc-4ba2-b709-4f22e5e92a70 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:11.201266 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c4bb0f-3fbc-4ba2-b709-4f22e5e92a70 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:11.201540 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c4bb0f-3fbc-4ba2-b709-4f22e5e92a70 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:11.214062 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c4bb0f-3fbc-4ba2-b709-4f22e5e92a70 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:17:11.214520 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-37b0b86f-df74-4cac-b7b3-1d2f5b393c1e None None] MFA Rules not processed for user `a326a5bb7364479382f528a592371656`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:17:11.215522 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c4bb0f-3fbc-4ba2-b709-4f22e5e92a70 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:17:11.215767 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-37b0b86f-df74-4cac-b7b3-1d2f5b393c1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:17:11.230257 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-35c4bb0f-3fbc-4ba2-b709-4f22e5e92a70 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 02:17:11.230257 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 02:17:11.230257 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 02:17:11.230257 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 02:17:11.230257 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 02:17:11.230257 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 02:17:11.230257 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 02:17:11.230257 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 02:17:11.230257 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 02:17:11.230257 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 02:17:11.230257 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 02:17:11.230257 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 02:17:11.230257 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 12 02:17:11.230257 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 12 02:17:11.230257 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 12 02:17:11.230257 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 12 02:17:11.231204 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 02:17:11.231204 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 02:17:11.231204 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 02:17:11.231204 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 02:17:11.231204 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 02:17:11.231204 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 02:17:11.231204 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 02:17:11.231204 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Oct 12 02:17:11.231204 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 02:17:11.231204 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Oct 12 02:17:11.231204 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 02:17:11.231204 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 02:17:11.231204 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 02:17:11.231204 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Oct 12 02:17:11.231204 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 02:17:11.231204 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Oct 12 02:17:11.231204 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 12 02:17:11.232065 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 12 02:17:11.232065 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 02:17:11.232065 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Oct 12 02:17:11.232065 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 185/367] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Oct 12 02:17:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 02:17:11.232915 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91d0dc2-5c99-4950-8a40-5109cea3b5ee None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:11.233189 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91d0dc2-5c99-4950-8a40-5109cea3b5ee None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:11.234798 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91d0dc2-5c99-4950-8a40-5109cea3b5ee None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:11.234798 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 186/368] 10.222.0.18 () {54 vars in 927 bytes} [Wed Oct 12 02:17:11 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 02:17:11.238513 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:17:11.239272 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91d0dc2-5c99-4950-8a40-5109cea3b5ee None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:17:11.303289 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 183/369] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Oct 12 02:17:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 12 02:17:11.304964 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215a8677-e9b8-405f-99a8-0ff6d8550218 None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:11.305391 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215a8677-e9b8-405f-99a8-0ff6d8550218 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:11.305673 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215a8677-e9b8-405f-99a8-0ff6d8550218 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:11.327904 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-215a8677-e9b8-405f-99a8-0ff6d8550218 None None] MFA Rules not processed for user `a326a5bb7364479382f528a592371656`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:17:11.329104 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-215a8677-e9b8-405f-99a8-0ff6d8550218 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:17:11.353176 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91d0dc2-5c99-4950-8a40-5109cea3b5ee None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:17:11.383319 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:17:11.415110 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02b3863-ce76-4324-a0e5-8e6bc289cde1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:17:11.415777 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02b3863-ce76-4324-a0e5-8e6bc289cde1 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:11.416051 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02b3863-ce76-4324-a0e5-8e6bc289cde1 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:11.416319 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02b3863-ce76-4324-a0e5-8e6bc289cde1 None admin] PATH_INFO: `/v3/domains` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:11.417153 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02b3863-ce76-4324-a0e5-8e6bc289cde1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 02:17:11.419104 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02b3863-ce76-4324-a0e5-8e6bc289cde1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:17:11.420493 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02b3863-ce76-4324-a0e5-8e6bc289cde1 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:17:11.442143 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 187/370] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Oct 12 02:17:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 02:17:11.444653 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 184/371] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Oct 12 02:17:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 12 02:17:11.448243 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02b3863-ce76-4324-a0e5-8e6bc289cde1 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:17:11.595162 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02b3863-ce76-4324-a0e5-8e6bc289cde1 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:17:11.641858 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bc617b-bf06-4b10-91ff-04dc9c9a679b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:17:11.642496 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bc617b-bf06-4b10-91ff-04dc9c9a679b None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:11.642826 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bc617b-bf06-4b10-91ff-04dc9c9a679b None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:11.643099 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bc617b-bf06-4b10-91ff-04dc9c9a679b None admin] PATH_INFO: `/v3/users/nova` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:11.651045 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81bc617b-bf06-4b10-91ff-04dc9c9a679b None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:17:11.652483 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81bc617b-bf06-4b10-91ff-04dc9c9a679b None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:17:11.666103 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-81bc617b-bf06-4b10-91ff-04dc9c9a679b None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 12 02:17:11.666103 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 02:17:11.666103 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 02:17:11.666103 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 02:17:11.666103 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 02:17:11.666103 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 02:17:11.666103 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 02:17:11.666103 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 02:17:11.666103 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 02:17:11.666103 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 02:17:11.666103 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 02:17:11.666103 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 02:17:11.666103 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 12 02:17:11.666103 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 12 02:17:11.666103 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 12 02:17:11.666103 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 12 02:17:11.667035 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 02:17:11.667035 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 02:17:11.667035 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 12 02:17:11.667035 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 12 02:17:11.667035 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 12 02:17:11.667035 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 12 02:17:11.667035 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 02:17:11.667035 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 02:17:11.667035 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 02:17:11.667035 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 02:17:11.667035 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 02:17:11.667035 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Oct 12 02:17:11.667035 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 02:17:11.667035 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Oct 12 02:17:11.667035 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 02:17:11.667035 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 02:17:11.667035 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 02:17:11.667035 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Oct 12 02:17:11.667967 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 02:17:11.667967 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Oct 12 02:17:11.667967 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 12 02:17:11.667967 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 12 02:17:11.667967 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 12 02:17:11.667967 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 12 02:17:11.667967 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 12 02:17:11.667967 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 12 02:17:11.667967 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 12 02:17:11.667967 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Oct 12 02:17:11.667967 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 188/372] 10.222.0.18 () {56 vars in 1093 bytes} [Wed Oct 12 02:17:11 2022] GET /identity/v3/users/nova => generated 82 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 12 02:17:11.673787 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215a8677-e9b8-405f-99a8-0ff6d8550218 None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:17:11.685387 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bc617b-bf06-4b10-91ff-04dc9c9a679b None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:17:11.764872 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:17:11.822188 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:17:11.858112 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215a8677-e9b8-405f-99a8-0ff6d8550218 None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:17:11.869675 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bc617b-bf06-4b10-91ff-04dc9c9a679b None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:17:11.903337 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ca8dd8-0989-48fc-973f-58b506e78c0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:17:11.903889 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ca8dd8-0989-48fc-973f-58b506e78c0f None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:11.904169 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ca8dd8-0989-48fc-973f-58b506e78c0f None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:11.904549 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ca8dd8-0989-48fc-973f-58b506e78c0f None admin] PATH_INFO: `/v3/roles/service` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:11.906037 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3778f41-552b-4141-ae20-587475d30941 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:17:11.906698 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3778f41-552b-4141-ae20-587475d30941 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:11.907037 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3778f41-552b-4141-ae20-587475d30941 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:11.907310 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3778f41-552b-4141-ae20-587475d30941 None admin] PATH_INFO: `/v3/users` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:11.908052 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3778f41-552b-4141-ae20-587475d30941 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 02:17:11.908353 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3778f41-552b-4141-ae20-587475d30941 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:17:11.909819 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3778f41-552b-4141-ae20-587475d30941 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:17:11.916063 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ca8dd8-0989-48fc-973f-58b506e78c0f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 02:17:11.921356 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application [None req-46ca8dd8-0989-48fc-973f-58b506e78c0f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 12 02:17:11.921356 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 02:17:11.921356 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 02:17:11.921356 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 02:17:11.921356 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 02:17:11.921356 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 02:17:11.921356 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 02:17:11.921356 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 02:17:11.921356 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 02:17:11.921356 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 02:17:11.921356 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 02:17:11.921356 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 02:17:11.921356 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 12 02:17:11.921356 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 12 02:17:11.921356 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 12 02:17:11.921356 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 12 02:17:11.922269 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 12 02:17:11.922269 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 12 02:17:11.922269 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 12 02:17:11.922269 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 12 02:17:11.922269 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 02:17:11.922269 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 02:17:11.922269 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 02:17:11.922269 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 02:17:11.922269 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 02:17:11.922269 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 02:17:11.922269 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 02:17:11.922269 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application with Lock( Oct 12 02:17:11.922269 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 02:17:11.922269 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._enter() Oct 12 02:17:11.922269 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 02:17:11.922269 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 02:17:11.923081 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 02:17:11.923081 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.creator() Oct 12 02:17:11.923081 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 02:17:11.923081 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application created_value = creator( Oct 12 02:17:11.923081 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 12 02:17:11.923081 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 12 02:17:11.923081 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 12 02:17:11.923081 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 12 02:17:11.923081 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 12 02:17:11.923081 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 12 02:17:11.923081 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 12 02:17:11.923081 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Oct 12 02:17:11.929719 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 185/373] 10.222.0.18 () {56 vars in 1102 bytes} [Wed Oct 12 02:17:11 2022] GET /identity/v3/roles/service => generated 85 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 02:17:11.930997 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ca8dd8-0989-48fc-973f-58b506e78c0f None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:17:11.960537 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 189/374] 10.222.0.18 () {56 vars in 1133 bytes} [Wed Oct 12 02:17:11 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 02:17:11.961565 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3778f41-552b-4141-ae20-587475d30941 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:17:12.044097 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ca8dd8-0989-48fc-973f-58b506e78c0f None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:17:12.072304 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:17:12.079474 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8305c62-4aa5-42df-ac33-918a127e8253 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:17:12.080116 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8305c62-4aa5-42df-ac33-918a127e8253 None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:12.080450 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8305c62-4aa5-42df-ac33-918a127e8253 None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:12.080747 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8305c62-4aa5-42df-ac33-918a127e8253 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:12.081766 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3778f41-552b-4141-ae20-587475d30941 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:17:12.088510 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:17:12.092302 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8305c62-4aa5-42df-ac33-918a127e8253 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 02:17:12.097522 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application [None req-d8305c62-4aa5-42df-ac33-918a127e8253 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 12 02:17:12.097522 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 02:17:12.097522 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 02:17:12.097522 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 02:17:12.097522 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 02:17:12.097522 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 02:17:12.097522 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 02:17:12.097522 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 02:17:12.097522 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 02:17:12.097522 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 02:17:12.097522 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 02:17:12.097522 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 02:17:12.097522 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 12 02:17:12.097522 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 12 02:17:12.097522 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 12 02:17:12.097522 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 12 02:17:12.098407 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 12 02:17:12.098407 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 12 02:17:12.098407 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 12 02:17:12.098407 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 12 02:17:12.098407 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 02:17:12.098407 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 02:17:12.098407 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 02:17:12.098407 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 02:17:12.098407 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 02:17:12.098407 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 02:17:12.098407 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 02:17:12.098407 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application with Lock( Oct 12 02:17:12.098407 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 02:17:12.098407 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._enter() Oct 12 02:17:12.098407 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 02:17:12.098407 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 02:17:12.099855 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 02:17:12.099855 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.creator() Oct 12 02:17:12.099855 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 02:17:12.099855 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application created_value = creator( Oct 12 02:17:12.099855 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 12 02:17:12.099855 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 12 02:17:12.099855 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 12 02:17:12.099855 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 12 02:17:12.099855 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 12 02:17:12.099855 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 12 02:17:12.099855 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 12 02:17:12.099855 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Oct 12 02:17:12.099855 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 186/375] 10.222.0.18 () {56 vars in 1102 bytes} [Wed Oct 12 02:17:11 2022] GET /identity/v3/roles/service => generated 85 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 02:17:12.100597 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8305c62-4aa5-42df-ac33-918a127e8253 None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:17:12.125599 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349a798a-a426-4294-8d19-c92bc1c8237b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:17:12.126203 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349a798a-a426-4294-8d19-c92bc1c8237b None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:12.126479 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349a798a-a426-4294-8d19-c92bc1c8237b None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:12.126744 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349a798a-a426-4294-8d19-c92bc1c8237b None admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:12.127404 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349a798a-a426-4294-8d19-c92bc1c8237b None admin] RBAC: Adding query filter params (name=service) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 02:17:12.127699 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349a798a-a426-4294-8d19-c92bc1c8237b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:17:12.129126 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349a798a-a426-4294-8d19-c92bc1c8237b None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:17:12.137257 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 190/376] 10.222.0.18 () {56 vars in 1103 bytes} [Wed Oct 12 02:17:11 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 02:17:12.138439 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd71430f-46c3-4f14-b017-25efe922bf96 None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:12.138724 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd71430f-46c3-4f14-b017-25efe922bf96 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:12.138999 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd71430f-46c3-4f14-b017-25efe922bf96 None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:12.140199 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 191/377] 10.222.0.18 () {54 vars in 927 bytes} [Wed Oct 12 02:17:12 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 02:17:12.140924 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd71430f-46c3-4f14-b017-25efe922bf96 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:17:12.203523 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8305c62-4aa5-42df-ac33-918a127e8253 None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:17:12.237598 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56127a45-b49a-4a54-981b-9d900007eeed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:17:12.238222 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56127a45-b49a-4a54-981b-9d900007eeed None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:12.238500 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56127a45-b49a-4a54-981b-9d900007eeed None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:12.238776 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56127a45-b49a-4a54-981b-9d900007eeed None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:12.243869 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd71430f-46c3-4f14-b017-25efe922bf96 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:17:12.249554 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56127a45-b49a-4a54-981b-9d900007eeed None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:17:12.251045 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56127a45-b49a-4a54-981b-9d900007eeed None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:17:12.265521 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application [None req-56127a45-b49a-4a54-981b-9d900007eeed None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 02:17:12.265521 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 02:17:12.265521 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 02:17:12.265521 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 02:17:12.265521 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 02:17:12.265521 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 02:17:12.265521 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 02:17:12.265521 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 02:17:12.265521 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 02:17:12.265521 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 02:17:12.265521 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 02:17:12.265521 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 02:17:12.265521 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 12 02:17:12.265521 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 12 02:17:12.265521 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 12 02:17:12.265521 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 12 02:17:12.266459 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 02:17:12.266459 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 02:17:12.266459 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 02:17:12.266459 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 02:17:12.266459 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 02:17:12.266459 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 02:17:12.266459 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 02:17:12.266459 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application with Lock( Oct 12 02:17:12.266459 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 02:17:12.266459 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._enter() Oct 12 02:17:12.266459 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 02:17:12.266459 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 02:17:12.266459 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 02:17:12.266459 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.creator() Oct 12 02:17:12.266459 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 02:17:12.266459 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application created_value = creator( Oct 12 02:17:12.266459 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 12 02:17:12.267338 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 12 02:17:12.267338 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 02:17:12.267338 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Oct 12 02:17:12.267338 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 187/378] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Oct 12 02:17:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 02:17:12.267714 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2a8d2b-5670-443b-ac5c-9c5b1ace3190 None None] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:12.268014 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2a8d2b-5670-443b-ac5c-9c5b1ace3190 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:12.268252 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2a8d2b-5670-443b-ac5c-9c5b1ace3190 None None] PATH_INFO: `/` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:12.269487 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 188/379] 10.222.0.18 () {54 vars in 927 bytes} [Wed Oct 12 02:17:12 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 02:17:12.272627 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2a8d2b-5670-443b-ac5c-9c5b1ace3190 None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:17:12.282221 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4dd01d-af88-44f5-9174-c9ffac83fc19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:17:12.282854 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4dd01d-af88-44f5-9174-c9ffac83fc19 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:12.283126 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4dd01d-af88-44f5-9174-c9ffac83fc19 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:12.283397 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4dd01d-af88-44f5-9174-c9ffac83fc19 None admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:12.284063 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4dd01d-af88-44f5-9174-c9ffac83fc19 None admin] RBAC: Adding query filter params (name=service) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 02:17:12.284359 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4dd01d-af88-44f5-9174-c9ffac83fc19 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:17:12.285741 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4dd01d-af88-44f5-9174-c9ffac83fc19 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:17:12.294253 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 192/380] 10.222.0.18 () {56 vars in 1103 bytes} [Wed Oct 12 02:17:12 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 02:17:12.295389 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5abc99-9f16-4f85-b01e-0d87b13ba7bb None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:12.295672 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5abc99-9f16-4f85-b01e-0d87b13ba7bb None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:12.296119 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5abc99-9f16-4f85-b01e-0d87b13ba7bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:12.313716 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-cb5abc99-9f16-4f85-b01e-0d87b13ba7bb None None] MFA Rules not processed for user `a326a5bb7364479382f528a592371656`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:17:12.314902 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-cb5abc99-9f16-4f85-b01e-0d87b13ba7bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:17:12.322156 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:17:12.328910 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:17:12.373606 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2a8d2b-5670-443b-ac5c-9c5b1ace3190 None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:17:12.382188 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 193/381] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Oct 12 02:17:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 12 02:17:12.383011 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5abc99-9f16-4f85-b01e-0d87b13ba7bb None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:17:12.410824 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e71f05-d3e7-447e-8677-333d26a022b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:17:12.411456 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e71f05-d3e7-447e-8677-333d26a022b7 None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:12.412353 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e71f05-d3e7-447e-8677-333d26a022b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:12.412650 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e71f05-d3e7-447e-8677-333d26a022b7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:12.423006 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e71f05-d3e7-447e-8677-333d26a022b7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:17:12.424458 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e71f05-d3e7-447e-8677-333d26a022b7 None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:17:12.439905 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application [None req-64e71f05-d3e7-447e-8677-333d26a022b7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 02:17:12.439905 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 02:17:12.439905 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 02:17:12.439905 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 02:17:12.439905 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 02:17:12.439905 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 02:17:12.439905 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 02:17:12.439905 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 02:17:12.439905 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 02:17:12.439905 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 02:17:12.439905 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 02:17:12.439905 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 02:17:12.439905 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 12 02:17:12.439905 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 12 02:17:12.439905 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 12 02:17:12.439905 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 12 02:17:12.440887 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 02:17:12.440887 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 02:17:12.440887 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 02:17:12.440887 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 02:17:12.440887 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 02:17:12.440887 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 02:17:12.440887 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 02:17:12.440887 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application with Lock( Oct 12 02:17:12.440887 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 02:17:12.440887 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._enter() Oct 12 02:17:12.440887 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 02:17:12.440887 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 02:17:12.440887 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 02:17:12.440887 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.creator() Oct 12 02:17:12.440887 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 02:17:12.440887 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application created_value = creator( Oct 12 02:17:12.440887 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 12 02:17:12.441740 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 12 02:17:12.441740 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 02:17:12.441740 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Oct 12 02:17:12.441740 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 189/382] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Oct 12 02:17:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 02:17:12.442618 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b12eb7e-1ec5-48fd-9646-800d88b83df5 None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:12.442890 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b12eb7e-1ec5-48fd-9646-800d88b83df5 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:12.443408 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b12eb7e-1ec5-48fd-9646-800d88b83df5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:12.462792 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-5b12eb7e-1ec5-48fd-9646-800d88b83df5 None None] MFA Rules not processed for user `a326a5bb7364479382f528a592371656`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:17:12.463894 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-5b12eb7e-1ec5-48fd-9646-800d88b83df5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:17:12.509281 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5abc99-9f16-4f85-b01e-0d87b13ba7bb None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:17:12.534413 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 190/383] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Oct 12 02:17:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 12 02:17:12.544683 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b12eb7e-1ec5-48fd-9646-800d88b83df5 None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:17:12.555812 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c49dc26-751e-4143-9634-61f537d2fc09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:17:12.556563 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c49dc26-751e-4143-9634-61f537d2fc09 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:12.556838 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c49dc26-751e-4143-9634-61f537d2fc09 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:12.557202 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c49dc26-751e-4143-9634-61f537d2fc09 None admin] PATH_INFO: `/v3/domains` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:12.557851 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c49dc26-751e-4143-9634-61f537d2fc09 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 02:17:12.558148 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c49dc26-751e-4143-9634-61f537d2fc09 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:17:12.559496 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c49dc26-751e-4143-9634-61f537d2fc09 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:17:12.571340 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:17:12.577407 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 194/384] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Oct 12 02:17:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 02:17:12.578358 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c49dc26-751e-4143-9634-61f537d2fc09 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:17:12.590090 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:17:12.657374 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b12eb7e-1ec5-48fd-9646-800d88b83df5 None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:17:12.693458 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a71c7c6-6378-48ab-a4fc-b61b9964028a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:17:12.693811 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c49dc26-751e-4143-9634-61f537d2fc09 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:17:12.694116 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a71c7c6-6378-48ab-a4fc-b61b9964028a None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:12.694388 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a71c7c6-6378-48ab-a4fc-b61b9964028a None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:12.694654 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a71c7c6-6378-48ab-a4fc-b61b9964028a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:12.705056 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a71c7c6-6378-48ab-a4fc-b61b9964028a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:17:12.706496 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a71c7c6-6378-48ab-a4fc-b61b9964028a None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:17:12.721803 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application [None req-8a71c7c6-6378-48ab-a4fc-b61b9964028a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 02:17:12.721803 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 02:17:12.721803 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 02:17:12.721803 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 02:17:12.721803 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 02:17:12.721803 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 02:17:12.721803 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 02:17:12.721803 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 02:17:12.721803 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 02:17:12.721803 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 02:17:12.721803 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 02:17:12.721803 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 02:17:12.721803 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 12 02:17:12.721803 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 12 02:17:12.721803 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 12 02:17:12.721803 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 12 02:17:12.722681 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 02:17:12.722681 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 02:17:12.722681 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 02:17:12.722681 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 02:17:12.722681 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 02:17:12.722681 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 02:17:12.722681 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 02:17:12.722681 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application with Lock( Oct 12 02:17:12.722681 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 02:17:12.722681 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._enter() Oct 12 02:17:12.722681 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 02:17:12.722681 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 02:17:12.722681 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 02:17:12.722681 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.creator() Oct 12 02:17:12.722681 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 02:17:12.722681 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application created_value = creator( Oct 12 02:17:12.722681 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 12 02:17:12.723572 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 12 02:17:12.723572 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 02:17:12.723572 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Oct 12 02:17:12.723572 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 191/385] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Oct 12 02:17:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 02:17:12.723572 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a71c7c6-6378-48ab-a4fc-b61b9964028a None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:17:12.736446 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6173fbb5-8a0e-475a-bb7f-f6e45a934097 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:17:12.737374 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6173fbb5-8a0e-475a-bb7f-f6e45a934097 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:12.737797 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6173fbb5-8a0e-475a-bb7f-f6e45a934097 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:12.738075 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6173fbb5-8a0e-475a-bb7f-f6e45a934097 None admin] PATH_INFO: `/v3/domains` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:12.738720 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6173fbb5-8a0e-475a-bb7f-f6e45a934097 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 02:17:12.739119 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6173fbb5-8a0e-475a-bb7f-f6e45a934097 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:17:12.740575 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6173fbb5-8a0e-475a-bb7f-f6e45a934097 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:17:12.758978 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 195/386] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Oct 12 02:17:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 02:17:12.759823 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6173fbb5-8a0e-475a-bb7f-f6e45a934097 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:17:12.810867 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:17:12.827932 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:17:12.828346 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a71c7c6-6378-48ab-a4fc-b61b9964028a None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:17:12.861190 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6173fbb5-8a0e-475a-bb7f-f6e45a934097 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:17:12.861959 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336561de-e0e6-4eba-b6b1-80c2fac2b5a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:17:12.862597 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336561de-e0e6-4eba-b6b1-80c2fac2b5a4 None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:12.862878 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336561de-e0e6-4eba-b6b1-80c2fac2b5a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:12.863146 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336561de-e0e6-4eba-b6b1-80c2fac2b5a4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:12.870136 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336561de-e0e6-4eba-b6b1-80c2fac2b5a4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:17:12.871584 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336561de-e0e6-4eba-b6b1-80c2fac2b5a4 None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:17:12.884491 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application [None req-336561de-e0e6-4eba-b6b1-80c2fac2b5a4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 12 02:17:12.884491 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 02:17:12.884491 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 02:17:12.884491 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 02:17:12.884491 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 02:17:12.884491 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 02:17:12.884491 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 02:17:12.884491 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 02:17:12.884491 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 02:17:12.884491 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 02:17:12.884491 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 02:17:12.884491 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 02:17:12.884491 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 12 02:17:12.884491 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 12 02:17:12.884491 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 12 02:17:12.885360 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 12 02:17:12.885360 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 02:17:12.885360 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 02:17:12.885360 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 02:17:12.885360 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 02:17:12.885360 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 02:17:12.885360 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 02:17:12.885360 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 02:17:12.885360 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application with Lock( Oct 12 02:17:12.885360 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 02:17:12.885360 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._enter() Oct 12 02:17:12.885360 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 02:17:12.885360 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 02:17:12.885360 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 02:17:12.885360 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.creator() Oct 12 02:17:12.885360 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 02:17:12.885360 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application created_value = creator( Oct 12 02:17:12.886815 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 12 02:17:12.886815 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 12 02:17:12.886815 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 12 02:17:12.886815 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 12 02:17:12.886815 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 12 02:17:12.886815 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 12 02:17:12.886815 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 12 02:17:12.886815 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Oct 12 02:17:12.886815 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 192/387] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Oct 12 02:17:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 02:17:12.886815 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336561de-e0e6-4eba-b6b1-80c2fac2b5a4 None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:17:12.897986 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab03c532-99b5-4a8c-97d3-07a24559b3e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:17:12.898615 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab03c532-99b5-4a8c-97d3-07a24559b3e1 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:12.898896 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab03c532-99b5-4a8c-97d3-07a24559b3e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:12.899170 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab03c532-99b5-4a8c-97d3-07a24559b3e1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:12.909045 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab03c532-99b5-4a8c-97d3-07a24559b3e1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 02:17:12.914021 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-ab03c532-99b5-4a8c-97d3-07a24559b3e1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 12 02:17:12.914021 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 02:17:12.914021 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 02:17:12.914021 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 02:17:12.914021 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 02:17:12.914021 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 02:17:12.914021 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 02:17:12.914021 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 02:17:12.914021 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 02:17:12.914021 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 02:17:12.914021 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 02:17:12.914021 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 02:17:12.914021 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 12 02:17:12.914021 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 12 02:17:12.914021 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 12 02:17:12.914021 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 12 02:17:12.914977 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 12 02:17:12.914977 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 12 02:17:12.914977 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 12 02:17:12.914977 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 12 02:17:12.914977 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 02:17:12.914977 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 02:17:12.914977 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 02:17:12.914977 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 02:17:12.914977 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 02:17:12.914977 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 02:17:12.914977 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 02:17:12.914977 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Oct 12 02:17:12.914977 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 02:17:12.914977 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Oct 12 02:17:12.914977 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 02:17:12.914977 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 02:17:12.915800 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 02:17:12.915800 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Oct 12 02:17:12.915800 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 02:17:12.915800 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Oct 12 02:17:12.915800 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 12 02:17:12.915800 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 12 02:17:12.915800 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 12 02:17:12.915800 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 12 02:17:12.915800 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 12 02:17:12.915800 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 12 02:17:12.915800 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 12 02:17:12.915800 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Oct 12 02:17:12.915800 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 196/388] 10.222.0.18 () {56 vars in 1102 bytes} [Wed Oct 12 02:17:12 2022] GET /identity/v3/roles/service => generated 85 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 02:17:12.916459 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab03c532-99b5-4a8c-97d3-07a24559b3e1 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:17:12.983979 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336561de-e0e6-4eba-b6b1-80c2fac2b5a4 None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:17:13.017259 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f38bf3-3daa-4045-b0b9-06e35913094b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:17:13.017864 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f38bf3-3daa-4045-b0b9-06e35913094b None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:13.018147 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f38bf3-3daa-4045-b0b9-06e35913094b None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:13.018423 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f38bf3-3daa-4045-b0b9-06e35913094b None admin] PATH_INFO: `/v3/domains` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:13.018522 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab03c532-99b5-4a8c-97d3-07a24559b3e1 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:17:13.019061 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f38bf3-3daa-4045-b0b9-06e35913094b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 02:17:13.019362 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f38bf3-3daa-4045-b0b9-06e35913094b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:17:13.020769 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f38bf3-3daa-4045-b0b9-06e35913094b None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:17:13.032804 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 193/389] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Oct 12 02:17:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 02:17:13.033668 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f38bf3-3daa-4045-b0b9-06e35913094b None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:17:13.037215 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:17:13.045159 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:17:13.054058 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337c822b-d7f6-47e4-8fad-a41616cd262d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:17:13.054686 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337c822b-d7f6-47e4-8fad-a41616cd262d None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:13.054960 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337c822b-d7f6-47e4-8fad-a41616cd262d None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:13.055223 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337c822b-d7f6-47e4-8fad-a41616cd262d None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:13.063052 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337c822b-d7f6-47e4-8fad-a41616cd262d None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:17:13.064514 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337c822b-d7f6-47e4-8fad-a41616cd262d None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:17:13.076181 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-337c822b-d7f6-47e4-8fad-a41616cd262d None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Oct 12 02:17:13.076181 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 02:17:13.076181 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 02:17:13.076181 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 02:17:13.076181 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 02:17:13.076181 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 02:17:13.076181 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 02:17:13.076181 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 02:17:13.076181 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 02:17:13.076181 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 02:17:13.076181 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 02:17:13.076181 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 02:17:13.076181 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 12 02:17:13.076181 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 12 02:17:13.076181 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 12 02:17:13.076181 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 12 02:17:13.077239 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 02:17:13.077239 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 02:17:13.077239 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 12 02:17:13.077239 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 12 02:17:13.077239 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 12 02:17:13.077239 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 12 02:17:13.077239 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 02:17:13.077239 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 02:17:13.077239 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 02:17:13.077239 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 02:17:13.077239 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 02:17:13.077239 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Oct 12 02:17:13.077239 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 02:17:13.077239 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Oct 12 02:17:13.077239 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 02:17:13.077239 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 02:17:13.077239 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 02:17:13.077239 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Oct 12 02:17:13.078135 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 02:17:13.078135 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Oct 12 02:17:13.078135 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 12 02:17:13.078135 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 12 02:17:13.078135 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 12 02:17:13.078135 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 12 02:17:13.078135 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 12 02:17:13.078135 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 12 02:17:13.078135 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Oct 12 02:17:13.078135 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Oct 12 02:17:13.078135 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 197/390] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Oct 12 02:17:12 2022] GET /identity/v3/users/cinder => generated 84 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 02:17:13.078711 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337c822b-d7f6-47e4-8fad-a41616cd262d None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:17:13.138360 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f38bf3-3daa-4045-b0b9-06e35913094b None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:17:13.171839 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18176e84-87b8-4241-86d3-916a0e0bef59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:17:13.172478 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18176e84-87b8-4241-86d3-916a0e0bef59 None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:13.172776 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18176e84-87b8-4241-86d3-916a0e0bef59 None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:13.173047 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18176e84-87b8-4241-86d3-916a0e0bef59 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:13.180633 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337c822b-d7f6-47e4-8fad-a41616cd262d None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:17:13.184148 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18176e84-87b8-4241-86d3-916a0e0bef59 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:17:13.185633 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18176e84-87b8-4241-86d3-916a0e0bef59 None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:17:13.200366 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application [None req-18176e84-87b8-4241-86d3-916a0e0bef59 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 02:17:13.200366 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 02:17:13.200366 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 02:17:13.200366 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 02:17:13.200366 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 02:17:13.200366 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 02:17:13.200366 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 02:17:13.200366 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 02:17:13.200366 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 02:17:13.200366 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 02:17:13.200366 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 02:17:13.200366 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 02:17:13.200366 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 12 02:17:13.200366 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 12 02:17:13.200366 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 12 02:17:13.200366 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 12 02:17:13.201402 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 02:17:13.201402 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 02:17:13.201402 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 02:17:13.201402 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 02:17:13.201402 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 02:17:13.201402 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 02:17:13.201402 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 02:17:13.201402 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application with Lock( Oct 12 02:17:13.201402 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 02:17:13.201402 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._enter() Oct 12 02:17:13.201402 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 02:17:13.201402 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 02:17:13.201402 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 02:17:13.201402 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.creator() Oct 12 02:17:13.201402 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 02:17:13.201402 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application created_value = creator( Oct 12 02:17:13.201402 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 12 02:17:13.202243 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 12 02:17:13.202243 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 02:17:13.202243 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Oct 12 02:17:13.202243 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 194/391] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Oct 12 02:17:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 02:17:13.202243 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18176e84-87b8-4241-86d3-916a0e0bef59 None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:17:13.215490 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860ca2d8-ab71-41fb-8fcb-f6ecdcc9652a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:17:13.216091 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860ca2d8-ab71-41fb-8fcb-f6ecdcc9652a None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:13.216372 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860ca2d8-ab71-41fb-8fcb-f6ecdcc9652a None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:13.216684 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860ca2d8-ab71-41fb-8fcb-f6ecdcc9652a None admin] PATH_INFO: `/v3/projects` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:13.217374 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860ca2d8-ab71-41fb-8fcb-f6ecdcc9652a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 02:17:13.217678 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860ca2d8-ab71-41fb-8fcb-f6ecdcc9652a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:17:13.219120 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860ca2d8-ab71-41fb-8fcb-f6ecdcc9652a None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:17:13.236513 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 198/392] 10.222.0.18 () {56 vars in 1148 bytes} [Wed Oct 12 02:17:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 02:17:13.237243 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860ca2d8-ab71-41fb-8fcb-f6ecdcc9652a None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:17:13.259578 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:17:13.288713 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:17:13.305547 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18176e84-87b8-4241-86d3-916a0e0bef59 None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:17:13.339229 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c629000-eb88-400e-915e-712c37fa9035 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:17:13.339831 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c629000-eb88-400e-915e-712c37fa9035 None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:13.340111 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c629000-eb88-400e-915e-712c37fa9035 None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:13.340385 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c629000-eb88-400e-915e-712c37fa9035 None admin] PATH_INFO: `/v3/roles` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:13.341075 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c629000-eb88-400e-915e-712c37fa9035 None admin] RBAC: Adding query filter params (name=service) {{(pid=81361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 02:17:13.341379 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c629000-eb88-400e-915e-712c37fa9035 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:17:13.341480 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860ca2d8-ab71-41fb-8fcb-f6ecdcc9652a None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:17:13.342764 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c629000-eb88-400e-915e-712c37fa9035 None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:17:13.350622 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 195/393] 10.222.0.18 () {56 vars in 1103 bytes} [Wed Oct 12 02:17:13 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 02:17:13.351407 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c629000-eb88-400e-915e-712c37fa9035 None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:17:13.375990 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581d22c8-a436-41bb-83b3-01be468c27a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:17:13.376655 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581d22c8-a436-41bb-83b3-01be468c27a7 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:13.376932 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581d22c8-a436-41bb-83b3-01be468c27a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:13.377205 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581d22c8-a436-41bb-83b3-01be468c27a7 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:13.384949 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581d22c8-a436-41bb-83b3-01be468c27a7 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:17:13.386380 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581d22c8-a436-41bb-83b3-01be468c27a7 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:17:13.397872 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-581d22c8-a436-41bb-83b3-01be468c27a7 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Oct 12 02:17:13.397872 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 02:17:13.397872 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 02:17:13.397872 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 02:17:13.397872 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 02:17:13.397872 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 02:17:13.397872 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 02:17:13.397872 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 02:17:13.397872 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 02:17:13.397872 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 02:17:13.397872 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 02:17:13.397872 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 02:17:13.397872 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 12 02:17:13.397872 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 12 02:17:13.397872 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 12 02:17:13.397872 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 12 02:17:13.399001 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 02:17:13.399001 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 02:17:13.399001 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 12 02:17:13.399001 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 12 02:17:13.399001 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 12 02:17:13.399001 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 12 02:17:13.399001 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 02:17:13.399001 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 02:17:13.399001 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 02:17:13.399001 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 02:17:13.399001 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 02:17:13.399001 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Oct 12 02:17:13.399001 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 02:17:13.399001 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Oct 12 02:17:13.399001 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 02:17:13.399001 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 02:17:13.399001 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 02:17:13.399001 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Oct 12 02:17:13.400102 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 02:17:13.400102 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Oct 12 02:17:13.400102 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 12 02:17:13.400102 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 12 02:17:13.400102 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 12 02:17:13.400102 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 12 02:17:13.400102 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 12 02:17:13.400102 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 12 02:17:13.400102 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Oct 12 02:17:13.400102 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Oct 12 02:17:13.400102 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 199/394] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Oct 12 02:17:13 2022] GET /identity/v3/users/glance => generated 84 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 02:17:13.400102 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581d22c8-a436-41bb-83b3-01be468c27a7 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:17:13.455320 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c629000-eb88-400e-915e-712c37fa9035 None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:17:13.472247 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:17:13.489695 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d54a02-c571-425d-9b13-4bffc4fffedf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:17:13.490236 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d54a02-c571-425d-9b13-4bffc4fffedf None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:13.490561 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d54a02-c571-425d-9b13-4bffc4fffedf None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:13.490837 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d54a02-c571-425d-9b13-4bffc4fffedf None admin] PATH_INFO: `/v3/users` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:13.491823 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d54a02-c571-425d-9b13-4bffc4fffedf None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 02:17:13.492126 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d54a02-c571-425d-9b13-4bffc4fffedf None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:17:13.493601 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d54a02-c571-425d-9b13-4bffc4fffedf None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:17:13.498861 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581d22c8-a436-41bb-83b3-01be468c27a7 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:17:13.508270 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:17:13.530198 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 196/395] 10.222.0.18 () {56 vars in 1137 bytes} [Wed Oct 12 02:17:13 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 02:17:13.531052 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d54a02-c571-425d-9b13-4bffc4fffedf None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:17:13.536915 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2241c48-f500-4936-a50f-a9e1e19a26c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:17:13.537682 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2241c48-f500-4936-a50f-a9e1e19a26c5 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:13.537936 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2241c48-f500-4936-a50f-a9e1e19a26c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:13.538226 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2241c48-f500-4936-a50f-a9e1e19a26c5 None admin] PATH_INFO: `/v3/domains` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:13.538882 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2241c48-f500-4936-a50f-a9e1e19a26c5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 02:17:13.539163 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2241c48-f500-4936-a50f-a9e1e19a26c5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:17:13.540561 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2241c48-f500-4936-a50f-a9e1e19a26c5 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:17:13.552786 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 200/396] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Oct 12 02:17:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 02:17:13.553400 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2241c48-f500-4936-a50f-a9e1e19a26c5 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:17:13.633544 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d54a02-c571-425d-9b13-4bffc4fffedf None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:17:13.652997 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2241c48-f500-4936-a50f-a9e1e19a26c5 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:17:13.666918 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3571d59d-d3a0-4109-ae5d-af52fb569698 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:17:13.667567 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3571d59d-d3a0-4109-ae5d-af52fb569698 None admin] REQUEST_METHOD: `PUT` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:13.667843 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3571d59d-d3a0-4109-ae5d-af52fb569698 None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:13.668118 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3571d59d-d3a0-4109-ae5d-af52fb569698 None admin] PATH_INFO: `/v3/projects/beb6def6fcad45959e56425bb8bff4d1/users/f2fca96c111b45b795fb757f77908ff1/roles/91634b0ac542413bb04e5ce92e66459d` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:13.682119 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3571d59d-d3a0-4109-ae5d-af52fb569698 None admin] RBAC: Authorizing `identity:create_grant(project_id=beb6def6fcad45959e56425bb8bff4d1, user_id=f2fca96c111b45b795fb757f77908ff1, role_id=91634b0ac542413bb04e5ce92e66459d)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:17:13.683576 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3571d59d-d3a0-4109-ae5d-af52fb569698 None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:17:13.686992 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f87df5f-27cf-4174-9eda-4b2780d8f83f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:17:13.687605 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f87df5f-27cf-4174-9eda-4b2780d8f83f None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:13.687879 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f87df5f-27cf-4174-9eda-4b2780d8f83f None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:13.688144 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f87df5f-27cf-4174-9eda-4b2780d8f83f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:13.696534 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 197/397] 10.222.0.18 () {58 vars in 1439 bytes} [Wed Oct 12 02:17:13 2022] PUT /identity/v3/projects/beb6def6fcad45959e56425bb8bff4d1/users/f2fca96c111b45b795fb757f77908ff1/roles/91634b0ac542413bb04e5ce92e66459d => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 02:17:13.697320 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3571d59d-d3a0-4109-ae5d-af52fb569698 None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:17:13.702973 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f87df5f-27cf-4174-9eda-4b2780d8f83f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:17:13.704462 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f87df5f-27cf-4174-9eda-4b2780d8f83f None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:17:13.721572 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-2f87df5f-27cf-4174-9eda-4b2780d8f83f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 02:17:13.721572 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 02:17:13.721572 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 02:17:13.721572 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 02:17:13.721572 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 02:17:13.721572 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 02:17:13.721572 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 02:17:13.721572 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 02:17:13.721572 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 02:17:13.721572 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 02:17:13.721572 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 02:17:13.721572 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 02:17:13.721572 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 12 02:17:13.721572 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 12 02:17:13.721572 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 12 02:17:13.721572 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 12 02:17:13.722575 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 02:17:13.722575 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 02:17:13.722575 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 02:17:13.722575 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 02:17:13.722575 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 02:17:13.722575 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 02:17:13.722575 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 02:17:13.722575 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Oct 12 02:17:13.722575 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 02:17:13.722575 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Oct 12 02:17:13.722575 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 02:17:13.722575 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 02:17:13.722575 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 02:17:13.722575 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Oct 12 02:17:13.722575 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 02:17:13.722575 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Oct 12 02:17:13.722575 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 12 02:17:13.723438 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 12 02:17:13.723438 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 02:17:13.723438 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Oct 12 02:17:13.723438 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 201/398] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Oct 12 02:17:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 02:17:13.723664 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f87df5f-27cf-4174-9eda-4b2780d8f83f None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:17:13.735211 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:17:13.751147 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:17:13.826167 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3571d59d-d3a0-4109-ae5d-af52fb569698 None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:17:13.841115 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f87df5f-27cf-4174-9eda-4b2780d8f83f None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:17:13.864332 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2d454c-3052-41d5-9e84-85abe414d727 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:17:13.865127 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2d454c-3052-41d5-9e84-85abe414d727 None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:13.865404 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2d454c-3052-41d5-9e84-85abe414d727 None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:13.865673 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2d454c-3052-41d5-9e84-85abe414d727 None admin] PATH_INFO: `/v3/users` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:13.866662 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2d454c-3052-41d5-9e84-85abe414d727 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 02:17:13.866961 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2d454c-3052-41d5-9e84-85abe414d727 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:17:13.868408 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2d454c-3052-41d5-9e84-85abe414d727 None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:17:13.882254 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd58e1cd-01c2-4ef0-9df8-efbb3f43d627 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:17:13.882893 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd58e1cd-01c2-4ef0-9df8-efbb3f43d627 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:13.883172 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd58e1cd-01c2-4ef0-9df8-efbb3f43d627 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:13.883444 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd58e1cd-01c2-4ef0-9df8-efbb3f43d627 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:13.888015 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 198/399] 10.222.0.18 () {56 vars in 1137 bytes} [Wed Oct 12 02:17:13 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 02:17:13.888949 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2d454c-3052-41d5-9e84-85abe414d727 None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:17:13.895643 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd58e1cd-01c2-4ef0-9df8-efbb3f43d627 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:17:13.897646 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd58e1cd-01c2-4ef0-9df8-efbb3f43d627 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:17:13.912812 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-cd58e1cd-01c2-4ef0-9df8-efbb3f43d627 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 02:17:13.912812 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 02:17:13.912812 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 02:17:13.912812 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 02:17:13.912812 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 02:17:13.912812 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 02:17:13.912812 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 02:17:13.912812 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 02:17:13.912812 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 02:17:13.912812 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 02:17:13.912812 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 02:17:13.912812 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 02:17:13.912812 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 12 02:17:13.912812 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 12 02:17:13.912812 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 12 02:17:13.912812 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 12 02:17:13.913962 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 02:17:13.913962 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 02:17:13.913962 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 02:17:13.913962 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 02:17:13.913962 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 02:17:13.913962 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 02:17:13.913962 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 02:17:13.913962 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Oct 12 02:17:13.913962 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 02:17:13.913962 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Oct 12 02:17:13.913962 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 02:17:13.913962 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 02:17:13.913962 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 02:17:13.913962 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Oct 12 02:17:13.913962 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 02:17:13.913962 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Oct 12 02:17:13.913962 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 12 02:17:13.915184 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 12 02:17:13.915184 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 02:17:13.915184 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Oct 12 02:17:13.915184 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 202/400] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Oct 12 02:17:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 02:17:13.915184 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd58e1cd-01c2-4ef0-9df8-efbb3f43d627 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:17:13.980716 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:17:13.993391 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:17:14.000176 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2d454c-3052-41d5-9e84-85abe414d727 None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:17:14.026956 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd58e1cd-01c2-4ef0-9df8-efbb3f43d627 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:17:14.039422 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cda5d3-918d-48be-9a1c-c18f3dacb8c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:17:14.040066 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cda5d3-918d-48be-9a1c-c18f3dacb8c3 None admin] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:14.040347 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cda5d3-918d-48be-9a1c-c18f3dacb8c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:14.040656 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cda5d3-918d-48be-9a1c-c18f3dacb8c3 None admin] PATH_INFO: `/v3/users` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:14.041301 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3cda5d3-918d-48be-9a1c-c18f3dacb8c3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:17:14.042812 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3cda5d3-918d-48be-9a1c-c18f3dacb8c3 None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:17:14.063961 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8aeccd-3fd1-4415-93bd-78b0e8538d3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:17:14.064601 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8aeccd-3fd1-4415-93bd-78b0e8538d3c None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:14.064885 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8aeccd-3fd1-4415-93bd-78b0e8538d3c None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:14.065164 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8aeccd-3fd1-4415-93bd-78b0e8538d3c None admin] PATH_INFO: `/v3/domains` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:14.072864 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 199/401] 10.222.0.18 () {60 vars in 1132 bytes} [Wed Oct 12 02:17:13 2022] POST /identity/v3/users => generated 247 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 02:17:14.073064 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8aeccd-3fd1-4415-93bd-78b0e8538d3c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 02:17:14.073064 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8aeccd-3fd1-4415-93bd-78b0e8538d3c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:17:14.073251 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cda5d3-918d-48be-9a1c-c18f3dacb8c3 None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:17:14.073333 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8aeccd-3fd1-4415-93bd-78b0e8538d3c None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:17:14.092645 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 203/402] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Oct 12 02:17:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 02:17:14.093570 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8aeccd-3fd1-4415-93bd-78b0e8538d3c None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:17:14.217158 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cda5d3-918d-48be-9a1c-c18f3dacb8c3 None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:17:14.252926 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8aeccd-3fd1-4415-93bd-78b0e8538d3c None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:17:14.282477 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55aba799-3561-4841-a359-7ec7063eacee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:17:14.283375 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55aba799-3561-4841-a359-7ec7063eacee None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:14.283838 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55aba799-3561-4841-a359-7ec7063eacee None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:14.284203 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55aba799-3561-4841-a359-7ec7063eacee None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:14.296880 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:17:14.300251 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55aba799-3561-4841-a359-7ec7063eacee None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:17:14.301065 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55aba799-3561-4841-a359-7ec7063eacee None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:17:14.306102 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:17:14.313061 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f475c4eb-d921-405c-a49b-1ca886ab48ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:17:14.313674 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f475c4eb-d921-405c-a49b-1ca886ab48ef None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:14.313953 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f475c4eb-d921-405c-a49b-1ca886ab48ef None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:14.315074 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f475c4eb-d921-405c-a49b-1ca886ab48ef None admin] PATH_INFO: `/v3/domains` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:14.316263 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f475c4eb-d921-405c-a49b-1ca886ab48ef None admin] RBAC: Adding query filter params (name=Default) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 02:17:14.316263 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f475c4eb-d921-405c-a49b-1ca886ab48ef None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:17:14.317567 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f475c4eb-d921-405c-a49b-1ca886ab48ef None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:17:14.320804 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application [None req-55aba799-3561-4841-a359-7ec7063eacee None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 02:17:14.320804 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 02:17:14.320804 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 02:17:14.320804 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 02:17:14.320804 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 02:17:14.320804 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 02:17:14.320804 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 02:17:14.320804 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 02:17:14.320804 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 02:17:14.320804 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 02:17:14.320804 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 02:17:14.320804 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 02:17:14.320804 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 12 02:17:14.320804 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 12 02:17:14.320804 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 12 02:17:14.320804 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 12 02:17:14.321694 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 02:17:14.321694 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 02:17:14.321694 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 02:17:14.321694 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 02:17:14.321694 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 02:17:14.321694 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 02:17:14.321694 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 02:17:14.321694 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application with Lock( Oct 12 02:17:14.321694 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 02:17:14.321694 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._enter() Oct 12 02:17:14.321694 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 02:17:14.321694 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 02:17:14.321694 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 02:17:14.321694 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.creator() Oct 12 02:17:14.321694 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 02:17:14.321694 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application created_value = creator( Oct 12 02:17:14.321694 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 12 02:17:14.322531 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 12 02:17:14.322531 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 02:17:14.322531 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Oct 12 02:17:14.322531 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 200/403] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Oct 12 02:17:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 02:17:14.322531 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55aba799-3561-4841-a359-7ec7063eacee None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:17:14.337614 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 204/404] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Oct 12 02:17:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 02:17:14.338376 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f475c4eb-d921-405c-a49b-1ca886ab48ef None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:17:14.449799 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55aba799-3561-4841-a359-7ec7063eacee None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:17:14.464604 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f475c4eb-d921-405c-a49b-1ca886ab48ef None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:17:14.494864 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf0b44d-f40c-4038-b2c1-4a0615f232bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:17:14.495997 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf0b44d-f40c-4038-b2c1-4a0615f232bf None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:14.496520 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf0b44d-f40c-4038-b2c1-4a0615f232bf None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:14.496916 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf0b44d-f40c-4038-b2c1-4a0615f232bf None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:14.503478 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def568cf-ca71-4e88-b2e0-d5da37f71958 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:17:14.504202 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def568cf-ca71-4e88-b2e0-d5da37f71958 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:14.504616 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def568cf-ca71-4e88-b2e0-d5da37f71958 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:14.504992 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def568cf-ca71-4e88-b2e0-d5da37f71958 None admin] PATH_INFO: `/v3/domains` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:14.506209 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def568cf-ca71-4e88-b2e0-d5da37f71958 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 02:17:14.506327 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf0b44d-f40c-4038-b2c1-4a0615f232bf None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:17:14.506704 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def568cf-ca71-4e88-b2e0-d5da37f71958 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:17:14.508080 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf0b44d-f40c-4038-b2c1-4a0615f232bf None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:17:14.508387 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def568cf-ca71-4e88-b2e0-d5da37f71958 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:17:14.523843 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 205/405] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Oct 12 02:17:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 02:17:14.525004 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def568cf-ca71-4e88-b2e0-d5da37f71958 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:17:14.529230 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application [None req-dcf0b44d-f40c-4038-b2c1-4a0615f232bf None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Oct 12 02:17:14.529230 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 02:17:14.529230 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 02:17:14.529230 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 02:17:14.529230 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 02:17:14.529230 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 02:17:14.529230 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 02:17:14.529230 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 02:17:14.529230 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 02:17:14.529230 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 02:17:14.529230 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 02:17:14.529230 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 02:17:14.529230 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 12 02:17:14.529230 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 12 02:17:14.529230 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 12 02:17:14.529230 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 12 02:17:14.530335 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 02:17:14.530335 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 02:17:14.530335 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 12 02:17:14.530335 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 12 02:17:14.530335 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 12 02:17:14.530335 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 12 02:17:14.530335 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 02:17:14.530335 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 02:17:14.530335 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 02:17:14.530335 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 02:17:14.530335 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 02:17:14.530335 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application with Lock( Oct 12 02:17:14.530335 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 02:17:14.530335 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._enter() Oct 12 02:17:14.530335 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 02:17:14.530335 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 02:17:14.530335 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 02:17:14.530335 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.creator() Oct 12 02:17:14.531430 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 02:17:14.531430 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application created_value = creator( Oct 12 02:17:14.531430 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 12 02:17:14.531430 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 12 02:17:14.531430 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 12 02:17:14.531430 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 12 02:17:14.531430 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 12 02:17:14.531430 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 12 02:17:14.531430 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Oct 12 02:17:14.531430 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Oct 12 02:17:14.533489 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 201/406] 10.222.0.18 () {56 vars in 1102 bytes} [Wed Oct 12 02:17:14 2022] GET /identity/v3/users/neutron => generated 85 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 02:17:14.534350 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf0b44d-f40c-4038-b2c1-4a0615f232bf None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:17:14.591960 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:17:14.603331 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:17:14.644463 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def568cf-ca71-4e88-b2e0-d5da37f71958 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:17:14.656143 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf0b44d-f40c-4038-b2c1-4a0615f232bf None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:17:14.682429 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e03ed54-977e-469b-ad24-3134c3451510 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:17:14.683404 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e03ed54-977e-469b-ad24-3134c3451510 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:14.683820 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e03ed54-977e-469b-ad24-3134c3451510 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:14.684225 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e03ed54-977e-469b-ad24-3134c3451510 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:14.691596 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e03ed54-977e-469b-ad24-3134c3451510 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:17:14.693325 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e03ed54-977e-469b-ad24-3134c3451510 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:17:14.694530 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4106f2e7-cfba-4404-918c-c1b80699986e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:17:14.695517 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4106f2e7-cfba-4404-918c-c1b80699986e None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:14.696041 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4106f2e7-cfba-4404-918c-c1b80699986e None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:14.696548 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4106f2e7-cfba-4404-918c-c1b80699986e None admin] PATH_INFO: `/v3/projects/service` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:14.703714 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4106f2e7-cfba-4404-918c-c1b80699986e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:17:14.705037 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-2e03ed54-977e-469b-ad24-3134c3451510 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 12 02:17:14.705037 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 02:17:14.705037 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 02:17:14.705037 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 02:17:14.705037 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 02:17:14.705037 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 02:17:14.705037 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 02:17:14.705037 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 02:17:14.705037 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 02:17:14.705037 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 02:17:14.705037 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 02:17:14.705037 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 02:17:14.705037 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 12 02:17:14.705037 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 12 02:17:14.705037 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 12 02:17:14.705888 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 12 02:17:14.705888 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 02:17:14.705888 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 02:17:14.705888 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 02:17:14.705888 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 02:17:14.705888 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 02:17:14.705888 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 02:17:14.705888 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 02:17:14.705888 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Oct 12 02:17:14.705888 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 02:17:14.705888 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Oct 12 02:17:14.705888 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 02:17:14.705888 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 02:17:14.705888 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 02:17:14.705888 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Oct 12 02:17:14.705888 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 02:17:14.705888 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Oct 12 02:17:14.706760 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 12 02:17:14.706760 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 12 02:17:14.706760 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 12 02:17:14.706760 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 12 02:17:14.706760 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 12 02:17:14.706760 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 12 02:17:14.706760 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 12 02:17:14.706760 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Oct 12 02:17:14.708050 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4106f2e7-cfba-4404-918c-c1b80699986e None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:17:14.711397 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 206/407] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Oct 12 02:17:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 02:17:14.712341 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e03ed54-977e-469b-ad24-3134c3451510 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:17:14.721977 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application [None req-4106f2e7-cfba-4404-918c-c1b80699986e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 12 02:17:14.721977 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 02:17:14.721977 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 02:17:14.721977 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 02:17:14.721977 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 02:17:14.721977 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 02:17:14.721977 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 02:17:14.721977 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 02:17:14.721977 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 02:17:14.721977 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 02:17:14.721977 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 02:17:14.721977 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 02:17:14.721977 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 12 02:17:14.721977 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 12 02:17:14.721977 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 12 02:17:14.722824 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 12 02:17:14.722824 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 02:17:14.722824 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 02:17:14.722824 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 02:17:14.722824 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 02:17:14.722824 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 02:17:14.722824 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 02:17:14.722824 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 02:17:14.722824 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application with Lock( Oct 12 02:17:14.722824 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 02:17:14.722824 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._enter() Oct 12 02:17:14.722824 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 02:17:14.722824 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 02:17:14.722824 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 02:17:14.722824 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.creator() Oct 12 02:17:14.722824 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 02:17:14.722824 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application created_value = creator( Oct 12 02:17:14.723756 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 12 02:17:14.723756 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 12 02:17:14.723756 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 12 02:17:14.723756 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 12 02:17:14.723756 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 12 02:17:14.723756 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 12 02:17:14.723756 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 12 02:17:14.723756 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Oct 12 02:17:14.726035 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 202/408] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Oct 12 02:17:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 02:17:14.727003 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4106f2e7-cfba-4404-918c-c1b80699986e None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:17:14.817554 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e03ed54-977e-469b-ad24-3134c3451510 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:17:14.831169 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:17:14.838027 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4106f2e7-cfba-4404-918c-c1b80699986e None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:17:14.851813 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:17:14.854648 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75f8c43-5d22-4673-a65e-6a174f175aa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:17:14.855237 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75f8c43-5d22-4673-a65e-6a174f175aa7 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:14.855517 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75f8c43-5d22-4673-a65e-6a174f175aa7 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:14.855783 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75f8c43-5d22-4673-a65e-6a174f175aa7 None admin] PATH_INFO: `/v3/users` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:14.856547 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75f8c43-5d22-4673-a65e-6a174f175aa7 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 02:17:14.856898 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75f8c43-5d22-4673-a65e-6a174f175aa7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:17:14.858264 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75f8c43-5d22-4673-a65e-6a174f175aa7 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:17:14.876880 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e72f660-278f-4802-b7a8-3b9a67e3ec1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:17:14.877848 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e72f660-278f-4802-b7a8-3b9a67e3ec1a None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:14.878427 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e72f660-278f-4802-b7a8-3b9a67e3ec1a None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:14.878963 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e72f660-278f-4802-b7a8-3b9a67e3ec1a None admin] PATH_INFO: `/v3/projects` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:14.879953 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e72f660-278f-4802-b7a8-3b9a67e3ec1a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 02:17:14.880569 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e72f660-278f-4802-b7a8-3b9a67e3ec1a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:17:14.882273 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e72f660-278f-4802-b7a8-3b9a67e3ec1a None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:17:14.883243 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 207/409] 10.222.0.18 () {56 vars in 1139 bytes} [Wed Oct 12 02:17:14 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 02:17:14.884150 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75f8c43-5d22-4673-a65e-6a174f175aa7 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:17:14.902806 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 203/410] 10.222.0.18 () {56 vars in 1148 bytes} [Wed Oct 12 02:17:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 02:17:14.904055 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e72f660-278f-4802-b7a8-3b9a67e3ec1a None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:17:14.994522 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75f8c43-5d22-4673-a65e-6a174f175aa7 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:17:15.013994 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e72f660-278f-4802-b7a8-3b9a67e3ec1a None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:17:15.029479 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57fe4e9-eaa1-4209-b39e-1a50fe73015a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:17:15.030088 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57fe4e9-eaa1-4209-b39e-1a50fe73015a None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:15.030361 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57fe4e9-eaa1-4209-b39e-1a50fe73015a None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:15.030629 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57fe4e9-eaa1-4209-b39e-1a50fe73015a None admin] PATH_INFO: `/v3/projects` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:15.031422 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57fe4e9-eaa1-4209-b39e-1a50fe73015a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 02:17:15.031726 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57fe4e9-eaa1-4209-b39e-1a50fe73015a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:17:15.033266 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57fe4e9-eaa1-4209-b39e-1a50fe73015a None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:17:15.046587 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 208/411] 10.222.0.18 () {56 vars in 1148 bytes} [Wed Oct 12 02:17:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 02:17:15.047471 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57fe4e9-eaa1-4209-b39e-1a50fe73015a None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:17:15.055572 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536ffac9-d69d-4524-b7bf-3f404d741460 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:17:15.056553 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536ffac9-d69d-4524-b7bf-3f404d741460 None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:15.057033 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536ffac9-d69d-4524-b7bf-3f404d741460 None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:15.057538 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536ffac9-d69d-4524-b7bf-3f404d741460 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:15.072739 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536ffac9-d69d-4524-b7bf-3f404d741460 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:17:15.075377 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536ffac9-d69d-4524-b7bf-3f404d741460 None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:17:15.084880 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:17:15.100426 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application [None req-536ffac9-d69d-4524-b7bf-3f404d741460 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 02:17:15.100426 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 02:17:15.100426 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 02:17:15.100426 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 02:17:15.100426 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 02:17:15.100426 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 02:17:15.100426 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 02:17:15.100426 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 02:17:15.100426 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 02:17:15.100426 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 02:17:15.100426 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 02:17:15.100426 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 02:17:15.100426 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 12 02:17:15.100426 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 12 02:17:15.100426 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 12 02:17:15.100426 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 12 02:17:15.101416 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 02:17:15.101416 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 02:17:15.101416 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 02:17:15.101416 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 02:17:15.101416 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 02:17:15.101416 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 02:17:15.101416 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 02:17:15.101416 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application with Lock( Oct 12 02:17:15.101416 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 02:17:15.101416 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._enter() Oct 12 02:17:15.101416 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 02:17:15.101416 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 02:17:15.101416 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 02:17:15.101416 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.creator() Oct 12 02:17:15.101416 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 02:17:15.101416 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application created_value = creator( Oct 12 02:17:15.101416 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 12 02:17:15.102284 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 12 02:17:15.102284 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 02:17:15.102284 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Oct 12 02:17:15.104566 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 204/412] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Oct 12 02:17:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 02:17:15.105629 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536ffac9-d69d-4524-b7bf-3f404d741460 None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:17:15.136121 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:17:15.160246 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57fe4e9-eaa1-4209-b39e-1a50fe73015a None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:17:15.194383 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32de3d5-f624-4bc8-9f6c-04311152d8e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:17:15.194988 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32de3d5-f624-4bc8-9f6c-04311152d8e7 None admin] REQUEST_METHOD: `PUT` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:15.195265 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32de3d5-f624-4bc8-9f6c-04311152d8e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:15.195540 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32de3d5-f624-4bc8-9f6c-04311152d8e7 None admin] PATH_INFO: `/v3/projects/beb6def6fcad45959e56425bb8bff4d1/users/9ba688e0c4d44d13898539ee886f95fe/roles/91634b0ac542413bb04e5ce92e66459d` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:15.210996 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32de3d5-f624-4bc8-9f6c-04311152d8e7 None admin] RBAC: Authorizing `identity:create_grant(project_id=beb6def6fcad45959e56425bb8bff4d1, user_id=9ba688e0c4d44d13898539ee886f95fe, role_id=91634b0ac542413bb04e5ce92e66459d)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:17:15.212426 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32de3d5-f624-4bc8-9f6c-04311152d8e7 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:17:15.217888 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536ffac9-d69d-4524-b7bf-3f404d741460 None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:17:15.228378 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 209/413] 10.222.0.18 () {58 vars in 1439 bytes} [Wed Oct 12 02:17:15 2022] PUT /identity/v3/projects/beb6def6fcad45959e56425bb8bff4d1/users/9ba688e0c4d44d13898539ee886f95fe/roles/91634b0ac542413bb04e5ce92e66459d => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 02:17:15.242275 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32de3d5-f624-4bc8-9f6c-04311152d8e7 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:17:15.258425 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15578cb1-eca3-4b4d-8b48-e8ddb82b1d0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:17:15.259472 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15578cb1-eca3-4b4d-8b48-e8ddb82b1d0a None admin] REQUEST_METHOD: `PUT` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:15.259951 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15578cb1-eca3-4b4d-8b48-e8ddb82b1d0a None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:15.260448 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15578cb1-eca3-4b4d-8b48-e8ddb82b1d0a None admin] PATH_INFO: `/v3/projects/beb6def6fcad45959e56425bb8bff4d1/users/8285a132afeb47558e1b3dcedfd7b4e7/roles/91634b0ac542413bb04e5ce92e66459d` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:15.301055 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15578cb1-eca3-4b4d-8b48-e8ddb82b1d0a None admin] RBAC: Authorizing `identity:create_grant(project_id=beb6def6fcad45959e56425bb8bff4d1, user_id=8285a132afeb47558e1b3dcedfd7b4e7, role_id=91634b0ac542413bb04e5ce92e66459d)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:17:15.305062 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15578cb1-eca3-4b4d-8b48-e8ddb82b1d0a None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:17:15.332815 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 205/414] 10.222.0.18 () {58 vars in 1439 bytes} [Wed Oct 12 02:17:15 2022] PUT /identity/v3/projects/beb6def6fcad45959e56425bb8bff4d1/users/8285a132afeb47558e1b3dcedfd7b4e7/roles/91634b0ac542413bb04e5ce92e66459d => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 02:17:15.393648 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:17:15.414002 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32de3d5-f624-4bc8-9f6c-04311152d8e7 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:17:15.456165 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb92d81-37b6-4758-8a55-74f02c710484 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:17:15.456850 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb92d81-37b6-4758-8a55-74f02c710484 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:15.457181 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb92d81-37b6-4758-8a55-74f02c710484 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:15.457454 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb92d81-37b6-4758-8a55-74f02c710484 None admin] PATH_INFO: `/v3/domains` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:15.458112 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb92d81-37b6-4758-8a55-74f02c710484 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 02:17:15.458990 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb92d81-37b6-4758-8a55-74f02c710484 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:17:15.460481 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb92d81-37b6-4758-8a55-74f02c710484 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:17:15.473960 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 210/415] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Oct 12 02:17:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 02:17:15.479725 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15578cb1-eca3-4b4d-8b48-e8ddb82b1d0a None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:17:15.585392 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:17:15.619754 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15578cb1-eca3-4b4d-8b48-e8ddb82b1d0a None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:17:15.658619 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4947af-66f0-46dd-bedc-7e04b9beb2fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:17:15.659278 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4947af-66f0-46dd-bedc-7e04b9beb2fb None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:15.659559 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4947af-66f0-46dd-bedc-7e04b9beb2fb None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:15.659836 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4947af-66f0-46dd-bedc-7e04b9beb2fb None admin] PATH_INFO: `/v3/projects/service` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:15.668422 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4947af-66f0-46dd-bedc-7e04b9beb2fb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:17:15.669927 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4947af-66f0-46dd-bedc-7e04b9beb2fb None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:17:15.682559 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application [None req-4a4947af-66f0-46dd-bedc-7e04b9beb2fb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 12 02:17:15.682559 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 02:17:15.682559 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 02:17:15.682559 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 02:17:15.682559 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 02:17:15.682559 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 02:17:15.682559 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 02:17:15.682559 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 02:17:15.682559 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 02:17:15.682559 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 02:17:15.682559 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 02:17:15.682559 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 02:17:15.682559 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 12 02:17:15.682559 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 12 02:17:15.682559 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 12 02:17:15.683433 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 12 02:17:15.683433 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 02:17:15.683433 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 02:17:15.683433 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 02:17:15.683433 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 02:17:15.683433 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 02:17:15.683433 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 02:17:15.683433 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 02:17:15.683433 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application with Lock( Oct 12 02:17:15.683433 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 02:17:15.683433 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._enter() Oct 12 02:17:15.683433 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 02:17:15.683433 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 02:17:15.683433 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 02:17:15.683433 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.creator() Oct 12 02:17:15.683433 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 02:17:15.683433 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application created_value = creator( Oct 12 02:17:15.684703 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 12 02:17:15.684703 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 12 02:17:15.684703 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 12 02:17:15.684703 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 12 02:17:15.684703 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 12 02:17:15.684703 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 12 02:17:15.684703 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 12 02:17:15.684703 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Oct 12 02:17:15.684703 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 206/416] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Oct 12 02:17:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 02:17:15.690178 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb92d81-37b6-4758-8a55-74f02c710484 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:17:15.854524 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb92d81-37b6-4758-8a55-74f02c710484 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:17:15.913734 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f71f1c5-4748-4ca1-9b93-ddfb9e45de0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:17:15.914708 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f71f1c5-4748-4ca1-9b93-ddfb9e45de0b None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:15.915177 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f71f1c5-4748-4ca1-9b93-ddfb9e45de0b None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:15.915663 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f71f1c5-4748-4ca1-9b93-ddfb9e45de0b None admin] PATH_INFO: `/v3/projects` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:15.916574 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f71f1c5-4748-4ca1-9b93-ddfb9e45de0b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 02:17:15.917099 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f71f1c5-4748-4ca1-9b93-ddfb9e45de0b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:17:15.918883 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f71f1c5-4748-4ca1-9b93-ddfb9e45de0b None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:17:15.932588 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:17:15.943677 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 211/417] 10.222.0.18 () {56 vars in 1148 bytes} [Wed Oct 12 02:17:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 02:17:15.949119 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca36e4b7-7252-4bde-91de-301632d0490f None None] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:15.949403 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca36e4b7-7252-4bde-91de-301632d0490f None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:15.949678 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca36e4b7-7252-4bde-91de-301632d0490f None None] PATH_INFO: `/` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:15.950269 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f71f1c5-4748-4ca1-9b93-ddfb9e45de0b None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:17:15.951210 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 207/418] 10.222.0.18 () {54 vars in 927 bytes} [Wed Oct 12 02:17:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 02:17:15.956269 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03eb68c1-91ec-4fc1-92fb-c07ca1755604 None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:15.956571 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03eb68c1-91ec-4fc1-92fb-c07ca1755604 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:15.956840 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03eb68c1-91ec-4fc1-92fb-c07ca1755604 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:15.981131 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-03eb68c1-91ec-4fc1-92fb-c07ca1755604 None None] MFA Rules not processed for user `a326a5bb7364479382f528a592371656`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:17:15.982337 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-03eb68c1-91ec-4fc1-92fb-c07ca1755604 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:17:16.097441 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 208/419] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Oct 12 02:17:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 12 02:17:16.125857 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f71f1c5-4748-4ca1-9b93-ddfb9e45de0b None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:17:16.178996 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d58f2c4-607b-4140-a845-0c91c73c3321 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:17:16.179658 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d58f2c4-607b-4140-a845-0c91c73c3321 None admin] REQUEST_METHOD: `PUT` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:16.179935 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d58f2c4-607b-4140-a845-0c91c73c3321 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:16.180205 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d58f2c4-607b-4140-a845-0c91c73c3321 None admin] PATH_INFO: `/v3/projects/beb6def6fcad45959e56425bb8bff4d1/users/5223b5cab3114e9b9a13c582f8ef8386/roles/91634b0ac542413bb04e5ce92e66459d` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:16.202748 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d58f2c4-607b-4140-a845-0c91c73c3321 None admin] RBAC: Authorizing `identity:create_grant(project_id=beb6def6fcad45959e56425bb8bff4d1, user_id=5223b5cab3114e9b9a13c582f8ef8386, role_id=91634b0ac542413bb04e5ce92e66459d)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:17:16.204180 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d58f2c4-607b-4140-a845-0c91c73c3321 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:17:16.230634 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 212/420] 10.222.0.18 () {58 vars in 1439 bytes} [Wed Oct 12 02:17:15 2022] PUT /identity/v3/projects/beb6def6fcad45959e56425bb8bff4d1/users/5223b5cab3114e9b9a13c582f8ef8386/roles/91634b0ac542413bb04e5ce92e66459d => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 02:17:16.484610 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03eb68c1-91ec-4fc1-92fb-c07ca1755604 None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:17:16.587652 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:17:16.624402 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bfc19c-14ae-45e6-9646-58eef44b3b32 None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:16.624925 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bfc19c-14ae-45e6-9646-58eef44b3b32 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:16.624998 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bfc19c-14ae-45e6-9646-58eef44b3b32 None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:16.626583 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 213/421] 10.222.0.18 () {54 vars in 927 bytes} [Wed Oct 12 02:17:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 02:17:16.632013 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f8b794-a893-4ad8-8190-81c09fbe2978 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:16.632296 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f8b794-a893-4ad8-8190-81c09fbe2978 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:16.632618 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f8b794-a893-4ad8-8190-81c09fbe2978 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:16.636749 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03eb68c1-91ec-4fc1-92fb-c07ca1755604 None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:17:16.650782 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-19f8b794-a893-4ad8-8190-81c09fbe2978 None None] MFA Rules not processed for user `a326a5bb7364479382f528a592371656`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:17:16.651983 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-19f8b794-a893-4ad8-8190-81c09fbe2978 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:17:16.674955 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b7f1dc-ab48-4b91-b553-d3d9d938ab0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:17:16.675755 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b7f1dc-ab48-4b91-b553-d3d9d938ab0c None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:16.676039 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b7f1dc-ab48-4b91-b553-d3d9d938ab0c None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:16.676423 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b7f1dc-ab48-4b91-b553-d3d9d938ab0c None admin] PATH_INFO: `/v3/roles/service` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:16.706893 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b7f1dc-ab48-4b91-b553-d3d9d938ab0c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 02:17:16.714050 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application [None req-55b7f1dc-ab48-4b91-b553-d3d9d938ab0c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 12 02:17:16.714050 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 02:17:16.714050 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 02:17:16.714050 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 02:17:16.714050 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 02:17:16.714050 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 02:17:16.714050 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 02:17:16.714050 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 02:17:16.714050 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 02:17:16.714050 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 02:17:16.714050 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 02:17:16.714050 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 02:17:16.714050 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 12 02:17:16.714050 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 12 02:17:16.714050 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 12 02:17:16.714050 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 12 02:17:16.715119 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 12 02:17:16.715119 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 12 02:17:16.715119 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 12 02:17:16.715119 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 12 02:17:16.715119 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 02:17:16.715119 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 02:17:16.715119 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 02:17:16.715119 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 02:17:16.715119 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 02:17:16.715119 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 02:17:16.715119 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 02:17:16.715119 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application with Lock( Oct 12 02:17:16.715119 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 02:17:16.715119 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._enter() Oct 12 02:17:16.715119 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 02:17:16.715119 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 02:17:16.715907 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 02:17:16.715907 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.creator() Oct 12 02:17:16.715907 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 02:17:16.715907 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application created_value = creator( Oct 12 02:17:16.715907 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 12 02:17:16.715907 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 12 02:17:16.715907 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 12 02:17:16.715907 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 12 02:17:16.715907 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 12 02:17:16.715907 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 12 02:17:16.715907 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 12 02:17:16.715907 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Oct 12 02:17:16.717982 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:17:16.725686 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 209/422] 10.222.0.18 () {56 vars in 1102 bytes} [Wed Oct 12 02:17:16 2022] GET /identity/v3/roles/service => generated 85 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 02:17:16.727381 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b7f1dc-ab48-4b91-b553-d3d9d938ab0c None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:17:16.765379 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 214/423] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Oct 12 02:17:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 12 02:17:16.889705 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b7f1dc-ab48-4b91-b553-d3d9d938ab0c None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:17:16.932975 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:17:16.940726 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad54e23-1ad1-4f8e-9892-5ff24e6b60bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:17:16.941636 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad54e23-1ad1-4f8e-9892-5ff24e6b60bb None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:16.942233 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad54e23-1ad1-4f8e-9892-5ff24e6b60bb None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:16.943094 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad54e23-1ad1-4f8e-9892-5ff24e6b60bb None admin] PATH_INFO: `/v3/roles` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:16.943760 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad54e23-1ad1-4f8e-9892-5ff24e6b60bb None admin] RBAC: Adding query filter params (name=service) {{(pid=81361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 02:17:16.944061 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad54e23-1ad1-4f8e-9892-5ff24e6b60bb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:17:16.945443 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad54e23-1ad1-4f8e-9892-5ff24e6b60bb None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:17:16.954313 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 210/424] 10.222.0.18 () {56 vars in 1103 bytes} [Wed Oct 12 02:17:16 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 02:17:16.960092 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f8b794-a893-4ad8-8190-81c09fbe2978 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:17:17.070582 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad54e23-1ad1-4f8e-9892-5ff24e6b60bb None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:17:17.119698 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f8b794-a893-4ad8-8190-81c09fbe2978 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:17:17.160197 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cf23b2-bd13-4d5c-9541-eee38afebd70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:17:17.160938 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cf23b2-bd13-4d5c-9541-eee38afebd70 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:17.161217 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cf23b2-bd13-4d5c-9541-eee38afebd70 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:17.162718 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cf23b2-bd13-4d5c-9541-eee38afebd70 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:17.176071 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27cf23b2-bd13-4d5c-9541-eee38afebd70 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:17:17.177606 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27cf23b2-bd13-4d5c-9541-eee38afebd70 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:17:17.201340 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-27cf23b2-bd13-4d5c-9541-eee38afebd70 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 02:17:17.201340 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 02:17:17.201340 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 02:17:17.201340 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 02:17:17.201340 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 02:17:17.201340 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 02:17:17.201340 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 02:17:17.201340 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 02:17:17.201340 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 02:17:17.201340 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 02:17:17.201340 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 02:17:17.201340 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 02:17:17.201340 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 12 02:17:17.201340 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 12 02:17:17.201340 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 12 02:17:17.201340 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 12 02:17:17.202315 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 02:17:17.202315 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 02:17:17.202315 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 02:17:17.202315 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 02:17:17.202315 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 02:17:17.202315 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 02:17:17.202315 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 02:17:17.202315 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Oct 12 02:17:17.202315 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 02:17:17.202315 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Oct 12 02:17:17.202315 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 02:17:17.202315 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 02:17:17.202315 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 02:17:17.202315 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Oct 12 02:17:17.202315 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 02:17:17.202315 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Oct 12 02:17:17.202315 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 12 02:17:17.203171 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 12 02:17:17.203171 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 02:17:17.203171 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Oct 12 02:17:17.203171 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 215/425] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Oct 12 02:17:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 02:17:17.210344 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cf23b2-bd13-4d5c-9541-eee38afebd70 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:17:17.266277 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad54e23-1ad1-4f8e-9892-5ff24e6b60bb None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:17:17.280732 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:17:17.328442 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7d028b-2467-43f9-b3ce-2e7881e835c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:17:17.328946 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7d028b-2467-43f9-b3ce-2e7881e835c1 None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:17.329219 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7d028b-2467-43f9-b3ce-2e7881e835c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:17.329485 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7d028b-2467-43f9-b3ce-2e7881e835c1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:17.344241 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7d028b-2467-43f9-b3ce-2e7881e835c1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 02:17:17.350665 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application [None req-ee7d028b-2467-43f9-b3ce-2e7881e835c1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 12 02:17:17.350665 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 02:17:17.350665 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 02:17:17.350665 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 02:17:17.350665 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 02:17:17.350665 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 02:17:17.350665 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 02:17:17.350665 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 02:17:17.350665 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 02:17:17.350665 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 02:17:17.350665 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 02:17:17.350665 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 02:17:17.350665 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 12 02:17:17.350665 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 12 02:17:17.350665 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 12 02:17:17.350665 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 12 02:17:17.351758 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 12 02:17:17.351758 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 12 02:17:17.351758 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 12 02:17:17.351758 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 12 02:17:17.351758 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 02:17:17.351758 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 02:17:17.351758 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 02:17:17.351758 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 02:17:17.351758 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 02:17:17.351758 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 02:17:17.351758 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 02:17:17.351758 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application with Lock( Oct 12 02:17:17.351758 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 02:17:17.351758 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._enter() Oct 12 02:17:17.351758 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 02:17:17.351758 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 02:17:17.352782 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 02:17:17.352782 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.creator() Oct 12 02:17:17.352782 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 02:17:17.352782 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application created_value = creator( Oct 12 02:17:17.352782 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 12 02:17:17.352782 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 12 02:17:17.352782 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 12 02:17:17.352782 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 12 02:17:17.352782 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 12 02:17:17.352782 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 12 02:17:17.352782 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 12 02:17:17.352782 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Oct 12 02:17:17.355019 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 211/426] 10.222.0.18 () {56 vars in 1102 bytes} [Wed Oct 12 02:17:17 2022] GET /identity/v3/roles/service => generated 85 bytes in 285 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 02:17:17.360792 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7d028b-2467-43f9-b3ce-2e7881e835c1 None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:17:17.404524 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cf23b2-bd13-4d5c-9541-eee38afebd70 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:17:17.446643 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:17:17.459375 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d215fb1e-07ce-4ad3-bce0-2a237c63976f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:17:17.460327 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d215fb1e-07ce-4ad3-bce0-2a237c63976f None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:17.460945 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d215fb1e-07ce-4ad3-bce0-2a237c63976f None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:17.461498 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d215fb1e-07ce-4ad3-bce0-2a237c63976f None admin] PATH_INFO: `/v3/domains` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:17.462359 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d215fb1e-07ce-4ad3-bce0-2a237c63976f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 02:17:17.462863 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d215fb1e-07ce-4ad3-bce0-2a237c63976f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:17:17.465837 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d215fb1e-07ce-4ad3-bce0-2a237c63976f None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:17:17.479842 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 216/427] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Oct 12 02:17:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 02:17:17.484926 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d215fb1e-07ce-4ad3-bce0-2a237c63976f None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:17:17.563061 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7d028b-2467-43f9-b3ce-2e7881e835c1 None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:17:17.628797 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4273e1b1-3018-4700-8cb7-ee2536ad8f32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:17:17.629352 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4273e1b1-3018-4700-8cb7-ee2536ad8f32 None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:17.629628 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4273e1b1-3018-4700-8cb7-ee2536ad8f32 None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:17.629897 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4273e1b1-3018-4700-8cb7-ee2536ad8f32 None admin] PATH_INFO: `/v3/roles` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:17.630851 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4273e1b1-3018-4700-8cb7-ee2536ad8f32 None admin] RBAC: Adding query filter params (name=service) {{(pid=81361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 02:17:17.631042 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4273e1b1-3018-4700-8cb7-ee2536ad8f32 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:17:17.632349 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4273e1b1-3018-4700-8cb7-ee2536ad8f32 None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:17:17.644828 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:17:17.649948 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 212/428] 10.222.0.18 () {56 vars in 1103 bytes} [Wed Oct 12 02:17:17 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 02:17:17.654185 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4273e1b1-3018-4700-8cb7-ee2536ad8f32 None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:17:17.659140 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d215fb1e-07ce-4ad3-bce0-2a237c63976f None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:17:17.726359 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02892a6-2dc7-47f0-8d79-db246ad0ca21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:17:17.726993 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02892a6-2dc7-47f0-8d79-db246ad0ca21 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:17.727264 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02892a6-2dc7-47f0-8d79-db246ad0ca21 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:17.727530 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02892a6-2dc7-47f0-8d79-db246ad0ca21 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:17.740806 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02892a6-2dc7-47f0-8d79-db246ad0ca21 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:17:17.742349 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02892a6-2dc7-47f0-8d79-db246ad0ca21 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:17:17.764050 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-c02892a6-2dc7-47f0-8d79-db246ad0ca21 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 12 02:17:17.764050 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 02:17:17.764050 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 02:17:17.764050 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 02:17:17.764050 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 02:17:17.764050 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 02:17:17.764050 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 02:17:17.764050 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 02:17:17.764050 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 02:17:17.764050 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 02:17:17.764050 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 02:17:17.764050 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 02:17:17.764050 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 12 02:17:17.764050 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 12 02:17:17.764050 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 12 02:17:17.764050 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 12 02:17:17.765048 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 02:17:17.765048 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 02:17:17.765048 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 12 02:17:17.765048 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 12 02:17:17.765048 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 12 02:17:17.765048 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 12 02:17:17.765048 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 02:17:17.765048 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 02:17:17.765048 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 02:17:17.765048 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 02:17:17.765048 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 02:17:17.765048 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Oct 12 02:17:17.765048 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 02:17:17.765048 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Oct 12 02:17:17.765048 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 02:17:17.765048 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 02:17:17.765048 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 02:17:17.765048 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Oct 12 02:17:17.765968 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 02:17:17.765968 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Oct 12 02:17:17.765968 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 12 02:17:17.765968 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 12 02:17:17.765968 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 12 02:17:17.765968 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 12 02:17:17.765968 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 12 02:17:17.765968 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 12 02:17:17.765968 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 12 02:17:17.765968 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Oct 12 02:17:17.766521 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 217/429] 10.222.0.18 () {56 vars in 1093 bytes} [Wed Oct 12 02:17:17 2022] GET /identity/v3/users/nova => generated 82 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 02:17:17.773670 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02892a6-2dc7-47f0-8d79-db246ad0ca21 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:17:17.840293 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4273e1b1-3018-4700-8cb7-ee2536ad8f32 None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:17:17.855275 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:17:17.915137 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50fb5b2-6a56-4170-a32f-10ad6a31cc6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:17:17.915847 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50fb5b2-6a56-4170-a32f-10ad6a31cc6b None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:17.916127 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50fb5b2-6a56-4170-a32f-10ad6a31cc6b None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:17.916402 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50fb5b2-6a56-4170-a32f-10ad6a31cc6b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:17.929775 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50fb5b2-6a56-4170-a32f-10ad6a31cc6b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:17:17.931300 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50fb5b2-6a56-4170-a32f-10ad6a31cc6b None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:17:17.948144 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application [None req-d50fb5b2-6a56-4170-a32f-10ad6a31cc6b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 02:17:17.948144 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 02:17:17.948144 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 02:17:17.948144 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 02:17:17.948144 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 02:17:17.948144 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 02:17:17.948144 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 02:17:17.948144 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 02:17:17.948144 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 02:17:17.948144 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 02:17:17.948144 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 02:17:17.948144 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 02:17:17.948144 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 12 02:17:17.948144 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 12 02:17:17.948144 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 12 02:17:17.948144 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 12 02:17:17.949170 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 02:17:17.949170 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 02:17:17.949170 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 02:17:17.949170 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 02:17:17.949170 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 02:17:17.949170 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 02:17:17.949170 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 02:17:17.949170 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application with Lock( Oct 12 02:17:17.949170 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 02:17:17.949170 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._enter() Oct 12 02:17:17.949170 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 02:17:17.949170 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 02:17:17.949170 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 02:17:17.949170 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.creator() Oct 12 02:17:17.949170 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 02:17:17.949170 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application created_value = creator( Oct 12 02:17:17.949170 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 12 02:17:17.950019 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 12 02:17:17.950019 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 02:17:17.950019 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Oct 12 02:17:17.950019 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 213/430] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Oct 12 02:17:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 296 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 02:17:17.955188 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50fb5b2-6a56-4170-a32f-10ad6a31cc6b None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:17:17.977604 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02892a6-2dc7-47f0-8d79-db246ad0ca21 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:17:18.050273 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb49622-6c0a-4299-a98a-2004619908e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:17:18.050885 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb49622-6c0a-4299-a98a-2004619908e6 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:18.051166 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb49622-6c0a-4299-a98a-2004619908e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:18.051440 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb49622-6c0a-4299-a98a-2004619908e6 None admin] PATH_INFO: `/v3/users` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:18.052765 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb49622-6c0a-4299-a98a-2004619908e6 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 02:17:18.053428 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb49622-6c0a-4299-a98a-2004619908e6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:17:18.054507 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb49622-6c0a-4299-a98a-2004619908e6 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:17:18.077587 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 218/431] 10.222.0.18 () {56 vars in 1133 bytes} [Wed Oct 12 02:17:17 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 02:17:18.078902 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562509aa-6a41-43f3-a8a8-e5a128927fe1 None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:18.079188 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562509aa-6a41-43f3-a8a8-e5a128927fe1 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:18.079458 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562509aa-6a41-43f3-a8a8-e5a128927fe1 None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:18.085340 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 219/432] 10.222.0.18 () {54 vars in 927 bytes} [Wed Oct 12 02:17:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 02:17:18.086168 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562509aa-6a41-43f3-a8a8-e5a128927fe1 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:17:18.098366 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:17:18.117749 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50fb5b2-6a56-4170-a32f-10ad6a31cc6b None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:17:18.155682 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adccf879-f433-45ec-aa30-b3f6670bc21d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:17:18.156892 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adccf879-f433-45ec-aa30-b3f6670bc21d None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:18.157183 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adccf879-f433-45ec-aa30-b3f6670bc21d None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:18.157456 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adccf879-f433-45ec-aa30-b3f6670bc21d None admin] PATH_INFO: `/v3/domains` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:18.158383 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adccf879-f433-45ec-aa30-b3f6670bc21d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 02:17:18.158690 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adccf879-f433-45ec-aa30-b3f6670bc21d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:17:18.161237 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adccf879-f433-45ec-aa30-b3f6670bc21d None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:17:18.176584 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 214/433] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Oct 12 02:17:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 02:17:18.176584 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c77e8c6-0709-4db7-9191-ac8ed569a779 None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:18.176584 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c77e8c6-0709-4db7-9191-ac8ed569a779 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:18.176584 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c77e8c6-0709-4db7-9191-ac8ed569a779 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:18.193962 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-7c77e8c6-0709-4db7-9191-ac8ed569a779 None None] MFA Rules not processed for user `a326a5bb7364479382f528a592371656`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:17:18.195142 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-7c77e8c6-0709-4db7-9191-ac8ed569a779 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:17:18.198283 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562509aa-6a41-43f3-a8a8-e5a128927fe1 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:17:18.210032 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:17:18.235420 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f543020d-23ad-406c-a537-b7f96d99dfbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:17:18.236028 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f543020d-23ad-406c-a537-b7f96d99dfbf None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:18.236620 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f543020d-23ad-406c-a537-b7f96d99dfbf None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:18.236894 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f543020d-23ad-406c-a537-b7f96d99dfbf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:18.266652 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 215/434] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Oct 12 02:17:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 12 02:17:18.275513 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c44e16-115f-4bd6-a23e-a7b773043b0a None None] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:18.275513 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c44e16-115f-4bd6-a23e-a7b773043b0a None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:18.275513 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c44e16-115f-4bd6-a23e-a7b773043b0a None None] PATH_INFO: `/` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:18.275513 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 216/435] 10.222.0.18 () {54 vars in 927 bytes} [Wed Oct 12 02:17:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 02:17:18.275995 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c44e16-115f-4bd6-a23e-a7b773043b0a None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:17:18.312623 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f543020d-23ad-406c-a537-b7f96d99dfbf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:17:18.314093 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f543020d-23ad-406c-a537-b7f96d99dfbf None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:17:18.326115 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:17:18.415430 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c44e16-115f-4bd6-a23e-a7b773043b0a None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:17:18.419054 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 220/436] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Oct 12 02:17:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 12 02:17:18.420388 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cbf08c-febd-4507-b630-1ad41a300c05 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:18.420810 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cbf08c-febd-4507-b630-1ad41a300c05 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:18.421179 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cbf08c-febd-4507-b630-1ad41a300c05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:18.440029 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-d3cbf08c-febd-4507-b630-1ad41a300c05 None None] MFA Rules not processed for user `a326a5bb7364479382f528a592371656`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:17:18.441296 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-d3cbf08c-febd-4507-b630-1ad41a300c05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:17:18.459683 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271b2061-d63d-467c-b9d8-e97b89ff1ead None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:17:18.460315 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271b2061-d63d-467c-b9d8-e97b89ff1ead None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:18.460620 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271b2061-d63d-467c-b9d8-e97b89ff1ead None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:18.460888 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271b2061-d63d-467c-b9d8-e97b89ff1ead None admin] PATH_INFO: `/v3/users/swift` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:18.468846 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271b2061-d63d-467c-b9d8-e97b89ff1ead None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:17:18.470396 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271b2061-d63d-467c-b9d8-e97b89ff1ead None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:17:18.482932 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application [None req-271b2061-d63d-467c-b9d8-e97b89ff1ead None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 12 02:17:18.482932 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 02:17:18.482932 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 02:17:18.482932 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 02:17:18.482932 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 02:17:18.482932 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 02:17:18.482932 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 02:17:18.482932 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 02:17:18.482932 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 02:17:18.482932 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 02:17:18.482932 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 02:17:18.482932 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 02:17:18.482932 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 12 02:17:18.482932 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 12 02:17:18.482932 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 12 02:17:18.482932 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 12 02:17:18.483837 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 02:17:18.483837 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 02:17:18.483837 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 12 02:17:18.483837 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 12 02:17:18.483837 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 12 02:17:18.483837 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 12 02:17:18.483837 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 02:17:18.483837 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 02:17:18.483837 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 02:17:18.483837 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 02:17:18.483837 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 02:17:18.483837 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application with Lock( Oct 12 02:17:18.483837 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 02:17:18.483837 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._enter() Oct 12 02:17:18.483837 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 02:17:18.483837 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 02:17:18.483837 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 02:17:18.483837 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.creator() Oct 12 02:17:18.484743 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 02:17:18.484743 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application created_value = creator( Oct 12 02:17:18.484743 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 12 02:17:18.484743 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 12 02:17:18.484743 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 12 02:17:18.484743 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 12 02:17:18.484743 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 12 02:17:18.484743 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 12 02:17:18.484743 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Oct 12 02:17:18.484743 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Oct 12 02:17:18.484743 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 217/437] 10.222.0.18 () {56 vars in 1096 bytes} [Wed Oct 12 02:17:18 2022] GET /identity/v3/users/swift => generated 83 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 02:17:18.485307 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271b2061-d63d-467c-b9d8-e97b89ff1ead None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:17:18.503535 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:17:18.526325 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 221/438] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Oct 12 02:17:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 12 02:17:18.527231 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cbf08c-febd-4507-b630-1ad41a300c05 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:17:18.573077 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:17:18.645421 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271b2061-d63d-467c-b9d8-e97b89ff1ead None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:17:18.646475 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cbf08c-febd-4507-b630-1ad41a300c05 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:17:18.685498 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5ad645-2588-44ab-99d0-f5143bf7aa1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:17:18.686097 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5ad645-2588-44ab-99d0-f5143bf7aa1f None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:18.686382 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5ad645-2588-44ab-99d0-f5143bf7aa1f None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:18.686651 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5ad645-2588-44ab-99d0-f5143bf7aa1f None admin] PATH_INFO: `/v3/users` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:18.687389 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5ad645-2588-44ab-99d0-f5143bf7aa1f None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 02:17:18.687797 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5ad645-2588-44ab-99d0-f5143bf7aa1f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:17:18.689474 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5ad645-2588-44ab-99d0-f5143bf7aa1f None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:17:18.691000 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c61154-93cc-4b46-a52b-7a9ef4dfd3a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:17:18.692007 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c61154-93cc-4b46-a52b-7a9ef4dfd3a3 None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:18.693399 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c61154-93cc-4b46-a52b-7a9ef4dfd3a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:18.693828 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c61154-93cc-4b46-a52b-7a9ef4dfd3a3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:18.709342 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c61154-93cc-4b46-a52b-7a9ef4dfd3a3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:17:18.711149 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c61154-93cc-4b46-a52b-7a9ef4dfd3a3 None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:17:18.711553 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 222/439] 10.222.0.18 () {56 vars in 1135 bytes} [Wed Oct 12 02:17:18 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 02:17:18.717014 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5ad645-2588-44ab-99d0-f5143bf7aa1f None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:17:18.730236 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application [None req-65c61154-93cc-4b46-a52b-7a9ef4dfd3a3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 02:17:18.730236 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 02:17:18.730236 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 02:17:18.730236 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 02:17:18.730236 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 02:17:18.730236 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 02:17:18.730236 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 02:17:18.730236 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 02:17:18.730236 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 02:17:18.730236 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 02:17:18.730236 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 02:17:18.730236 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 02:17:18.730236 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 12 02:17:18.730236 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 12 02:17:18.730236 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 12 02:17:18.730236 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 12 02:17:18.731394 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 02:17:18.731394 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 02:17:18.731394 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 02:17:18.731394 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 02:17:18.731394 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 02:17:18.731394 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 02:17:18.731394 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 02:17:18.731394 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application with Lock( Oct 12 02:17:18.731394 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 02:17:18.731394 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._enter() Oct 12 02:17:18.731394 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 02:17:18.731394 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 02:17:18.731394 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 02:17:18.731394 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.creator() Oct 12 02:17:18.731394 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 02:17:18.731394 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application created_value = creator( Oct 12 02:17:18.731394 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 12 02:17:18.732484 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 12 02:17:18.732484 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 02:17:18.732484 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Oct 12 02:17:18.738289 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 218/440] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Oct 12 02:17:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 02:17:18.738289 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c61154-93cc-4b46-a52b-7a9ef4dfd3a3 None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:17:18.830301 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:17:18.835647 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:17:18.840261 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5ad645-2588-44ab-99d0-f5143bf7aa1f None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:17:18.873625 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c61154-93cc-4b46-a52b-7a9ef4dfd3a3 None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:17:18.877906 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6537797-b1b5-4897-81b4-546efca5a3cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:17:18.878533 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6537797-b1b5-4897-81b4-546efca5a3cb None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:18.878812 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6537797-b1b5-4897-81b4-546efca5a3cb None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:18.879082 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6537797-b1b5-4897-81b4-546efca5a3cb None admin] PATH_INFO: `/v3/roles/service` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:18.890167 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6537797-b1b5-4897-81b4-546efca5a3cb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 02:17:18.895250 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-b6537797-b1b5-4897-81b4-546efca5a3cb None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 12 02:17:18.895250 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 02:17:18.895250 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 02:17:18.895250 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 02:17:18.895250 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 02:17:18.895250 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 02:17:18.895250 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 02:17:18.895250 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 02:17:18.895250 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 02:17:18.895250 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 02:17:18.895250 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 02:17:18.895250 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 02:17:18.895250 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 12 02:17:18.895250 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 12 02:17:18.895250 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 12 02:17:18.895250 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 12 02:17:18.896938 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 12 02:17:18.896938 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 12 02:17:18.896938 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 12 02:17:18.896938 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 12 02:17:18.896938 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 02:17:18.896938 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 02:17:18.896938 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 02:17:18.896938 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 02:17:18.896938 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 02:17:18.896938 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 02:17:18.896938 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 02:17:18.896938 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Oct 12 02:17:18.896938 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 02:17:18.896938 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Oct 12 02:17:18.896938 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 02:17:18.896938 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 02:17:18.897992 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 02:17:18.897992 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Oct 12 02:17:18.897992 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 02:17:18.897992 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Oct 12 02:17:18.897992 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 12 02:17:18.897992 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 12 02:17:18.897992 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 12 02:17:18.897992 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 12 02:17:18.897992 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 12 02:17:18.897992 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 12 02:17:18.897992 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 12 02:17:18.897992 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Oct 12 02:17:18.897992 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 223/441] 10.222.0.18 () {56 vars in 1102 bytes} [Wed Oct 12 02:17:18 2022] GET /identity/v3/roles/service => generated 85 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 02:17:18.897992 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6537797-b1b5-4897-81b4-546efca5a3cb None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:17:18.912785 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123ad514-2c60-4fa5-a2b4-ca538fab8a84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:17:18.913408 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123ad514-2c60-4fa5-a2b4-ca538fab8a84 None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:18.913686 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123ad514-2c60-4fa5-a2b4-ca538fab8a84 None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:18.913959 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123ad514-2c60-4fa5-a2b4-ca538fab8a84 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:18.923761 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123ad514-2c60-4fa5-a2b4-ca538fab8a84 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:17:18.925269 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123ad514-2c60-4fa5-a2b4-ca538fab8a84 None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:17:18.940115 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application [None req-123ad514-2c60-4fa5-a2b4-ca538fab8a84 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 02:17:18.940115 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 02:17:18.940115 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 02:17:18.940115 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 02:17:18.940115 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 02:17:18.940115 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 02:17:18.940115 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 02:17:18.940115 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 02:17:18.940115 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 02:17:18.940115 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 02:17:18.940115 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 02:17:18.940115 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 02:17:18.940115 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 12 02:17:18.940115 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 12 02:17:18.940115 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 12 02:17:18.940115 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 12 02:17:18.941120 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 02:17:18.941120 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 02:17:18.941120 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 02:17:18.941120 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 02:17:18.941120 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 02:17:18.941120 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 02:17:18.941120 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 02:17:18.941120 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application with Lock( Oct 12 02:17:18.941120 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 02:17:18.941120 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._enter() Oct 12 02:17:18.941120 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 02:17:18.941120 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 02:17:18.941120 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 02:17:18.941120 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.creator() Oct 12 02:17:18.941120 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 02:17:18.941120 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application created_value = creator( Oct 12 02:17:18.941120 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 12 02:17:18.941994 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 12 02:17:18.941994 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 02:17:18.941994 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Oct 12 02:17:18.941994 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 219/442] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Oct 12 02:17:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 02:17:18.941994 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123ad514-2c60-4fa5-a2b4-ca538fab8a84 None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:17:19.003362 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6537797-b1b5-4897-81b4-546efca5a3cb None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:17:19.035670 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca77363d-df33-45f3-b85f-812b302b9a98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:17:19.036845 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca77363d-df33-45f3-b85f-812b302b9a98 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:19.037133 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca77363d-df33-45f3-b85f-812b302b9a98 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:19.037487 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca77363d-df33-45f3-b85f-812b302b9a98 None admin] PATH_INFO: `/v3/domains` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:19.038128 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca77363d-df33-45f3-b85f-812b302b9a98 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 02:17:19.038427 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca77363d-df33-45f3-b85f-812b302b9a98 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:17:19.039789 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca77363d-df33-45f3-b85f-812b302b9a98 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:17:19.040286 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123ad514-2c60-4fa5-a2b4-ca538fab8a84 None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:17:19.050975 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 224/443] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Oct 12 02:17:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 02:17:19.052807 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffae0450-4094-477d-96bf-fe47b1d509a4 None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:19.052807 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffae0450-4094-477d-96bf-fe47b1d509a4 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:19.053379 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffae0450-4094-477d-96bf-fe47b1d509a4 None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:19.054560 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 225/444] 10.222.0.18 () {54 vars in 927 bytes} [Wed Oct 12 02:17:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 02:17:19.055226 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:17:19.055347 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffae0450-4094-477d-96bf-fe47b1d509a4 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:17:19.074330 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:17:19.078417 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0982f2e9-76cb-455e-bcce-43dd43427a95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:17:19.079043 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0982f2e9-76cb-455e-bcce-43dd43427a95 None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:19.079324 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0982f2e9-76cb-455e-bcce-43dd43427a95 None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:19.079600 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0982f2e9-76cb-455e-bcce-43dd43427a95 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:19.089816 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0982f2e9-76cb-455e-bcce-43dd43427a95 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 02:17:19.095025 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application [None req-0982f2e9-76cb-455e-bcce-43dd43427a95 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 12 02:17:19.095025 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 02:17:19.095025 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 02:17:19.095025 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 02:17:19.095025 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 02:17:19.095025 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 02:17:19.095025 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 02:17:19.095025 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 02:17:19.095025 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 02:17:19.095025 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 02:17:19.095025 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 02:17:19.095025 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 02:17:19.095025 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 12 02:17:19.095025 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 12 02:17:19.095025 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 12 02:17:19.095025 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 12 02:17:19.096126 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 12 02:17:19.096126 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 12 02:17:19.096126 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 12 02:17:19.096126 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 12 02:17:19.096126 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 02:17:19.096126 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 02:17:19.096126 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 02:17:19.096126 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 02:17:19.096126 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 02:17:19.096126 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 02:17:19.096126 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 02:17:19.096126 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application with Lock( Oct 12 02:17:19.096126 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 02:17:19.096126 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._enter() Oct 12 02:17:19.096126 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 02:17:19.096126 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 02:17:19.096989 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 02:17:19.096989 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.creator() Oct 12 02:17:19.096989 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 02:17:19.096989 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application created_value = creator( Oct 12 02:17:19.096989 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 12 02:17:19.096989 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 12 02:17:19.096989 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 12 02:17:19.096989 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 12 02:17:19.096989 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 12 02:17:19.096989 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 12 02:17:19.096989 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 12 02:17:19.096989 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Oct 12 02:17:19.096989 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 220/445] 10.222.0.18 () {56 vars in 1102 bytes} [Wed Oct 12 02:17:18 2022] GET /identity/v3/roles/service => generated 85 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 02:17:19.097665 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0982f2e9-76cb-455e-bcce-43dd43427a95 None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:17:19.159009 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffae0450-4094-477d-96bf-fe47b1d509a4 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:17:19.192104 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712a21b7-016e-420f-aa9d-a37ed1cf9ba0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:17:19.192841 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712a21b7-016e-420f-aa9d-a37ed1cf9ba0 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:19.193158 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712a21b7-016e-420f-aa9d-a37ed1cf9ba0 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:19.193429 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712a21b7-016e-420f-aa9d-a37ed1cf9ba0 None admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:19.194089 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712a21b7-016e-420f-aa9d-a37ed1cf9ba0 None admin] RBAC: Adding query filter params (name=service) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 02:17:19.194388 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712a21b7-016e-420f-aa9d-a37ed1cf9ba0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:17:19.195736 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712a21b7-016e-420f-aa9d-a37ed1cf9ba0 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:17:19.196551 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0982f2e9-76cb-455e-bcce-43dd43427a95 None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:17:19.203555 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 226/446] 10.222.0.18 () {56 vars in 1103 bytes} [Wed Oct 12 02:17:19 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 02:17:19.204325 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712a21b7-016e-420f-aa9d-a37ed1cf9ba0 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:17:19.230486 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b3657b-cdfd-42c5-b028-d204d9e550d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:17:19.231114 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b3657b-cdfd-42c5-b028-d204d9e550d0 None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:19.231389 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b3657b-cdfd-42c5-b028-d204d9e550d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:19.231657 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b3657b-cdfd-42c5-b028-d204d9e550d0 None admin] PATH_INFO: `/v3/domains` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:19.232290 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b3657b-cdfd-42c5-b028-d204d9e550d0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 02:17:19.232623 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b3657b-cdfd-42c5-b028-d204d9e550d0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:17:19.233994 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b3657b-cdfd-42c5-b028-d204d9e550d0 None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:17:19.246538 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 221/447] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Oct 12 02:17:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 02:17:19.247700 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae5a902-c6ee-417c-8be0-185e684398d2 None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:19.247982 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae5a902-c6ee-417c-8be0-185e684398d2 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:19.248252 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae5a902-c6ee-417c-8be0-185e684398d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:19.265392 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-9ae5a902-c6ee-417c-8be0-185e684398d2 None None] MFA Rules not processed for user `a326a5bb7364479382f528a592371656`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:17:19.266586 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-9ae5a902-c6ee-417c-8be0-185e684398d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:17:19.289690 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:17:19.293672 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:17:19.310924 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712a21b7-016e-420f-aa9d-a37ed1cf9ba0 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:17:19.333790 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 222/448] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Oct 12 02:17:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 12 02:17:19.334609 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae5a902-c6ee-417c-8be0-185e684398d2 None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:17:19.344803 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcaa7bb2-b875-4087-9cc7-dc71dd113dad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:17:19.345433 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcaa7bb2-b875-4087-9cc7-dc71dd113dad None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:19.345709 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcaa7bb2-b875-4087-9cc7-dc71dd113dad None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:19.345977 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcaa7bb2-b875-4087-9cc7-dc71dd113dad None admin] PATH_INFO: `/v3/projects/service` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:19.353623 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcaa7bb2-b875-4087-9cc7-dc71dd113dad None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:17:19.355050 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcaa7bb2-b875-4087-9cc7-dc71dd113dad None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:17:19.367324 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-fcaa7bb2-b875-4087-9cc7-dc71dd113dad None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 12 02:17:19.367324 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 02:17:19.367324 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 02:17:19.367324 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 02:17:19.367324 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 02:17:19.367324 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 02:17:19.367324 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 02:17:19.367324 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 02:17:19.367324 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 02:17:19.367324 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 02:17:19.367324 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 02:17:19.367324 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 02:17:19.367324 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 12 02:17:19.367324 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 12 02:17:19.367324 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 12 02:17:19.368165 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 12 02:17:19.368165 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 02:17:19.368165 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 02:17:19.368165 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 02:17:19.368165 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 02:17:19.368165 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 02:17:19.368165 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 02:17:19.368165 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 02:17:19.368165 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Oct 12 02:17:19.368165 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 02:17:19.368165 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Oct 12 02:17:19.368165 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 02:17:19.368165 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 02:17:19.368165 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 02:17:19.368165 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Oct 12 02:17:19.368165 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 02:17:19.368165 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Oct 12 02:17:19.369763 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 12 02:17:19.369763 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 12 02:17:19.369763 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 12 02:17:19.369763 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 12 02:17:19.369763 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 12 02:17:19.369763 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 12 02:17:19.369763 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 12 02:17:19.369763 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Oct 12 02:17:19.369763 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 227/449] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Oct 12 02:17:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 02:17:19.369763 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcaa7bb2-b875-4087-9cc7-dc71dd113dad None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:17:19.458569 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae5a902-c6ee-417c-8be0-185e684398d2 None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:17:19.484480 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcaa7bb2-b875-4087-9cc7-dc71dd113dad None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:17:19.495291 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef489b7-6430-49c3-86c2-b74a5537eb13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:17:19.496142 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef489b7-6430-49c3-86c2-b74a5537eb13 None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:19.496637 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef489b7-6430-49c3-86c2-b74a5537eb13 None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:19.496984 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef489b7-6430-49c3-86c2-b74a5537eb13 None admin] PATH_INFO: `/v3/roles` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:19.497717 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef489b7-6430-49c3-86c2-b74a5537eb13 None admin] RBAC: Adding query filter params (name=service) {{(pid=81361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 02:17:19.498022 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef489b7-6430-49c3-86c2-b74a5537eb13 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:17:19.499392 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef489b7-6430-49c3-86c2-b74a5537eb13 None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:17:19.507886 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 223/450] 10.222.0.18 () {56 vars in 1103 bytes} [Wed Oct 12 02:17:19 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 02:17:19.508813 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef489b7-6430-49c3-86c2-b74a5537eb13 None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:17:19.531772 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07087cd-8ca8-4401-9d59-2a6f8739920d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:17:19.532402 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07087cd-8ca8-4401-9d59-2a6f8739920d None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:19.532714 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07087cd-8ca8-4401-9d59-2a6f8739920d None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:19.532984 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07087cd-8ca8-4401-9d59-2a6f8739920d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:19.543290 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:17:19.543681 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:17:19.547232 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07087cd-8ca8-4401-9d59-2a6f8739920d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:17:19.548681 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07087cd-8ca8-4401-9d59-2a6f8739920d None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:17:19.565461 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-b07087cd-8ca8-4401-9d59-2a6f8739920d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 02:17:19.565461 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 02:17:19.565461 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 02:17:19.565461 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 02:17:19.565461 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 02:17:19.565461 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 02:17:19.565461 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 02:17:19.565461 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 02:17:19.565461 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 02:17:19.565461 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 02:17:19.565461 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 02:17:19.565461 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 02:17:19.565461 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 12 02:17:19.565461 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 12 02:17:19.565461 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 12 02:17:19.565461 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 12 02:17:19.566393 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 02:17:19.566393 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 02:17:19.566393 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 02:17:19.566393 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 02:17:19.566393 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 02:17:19.566393 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 02:17:19.566393 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 02:17:19.566393 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Oct 12 02:17:19.566393 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 02:17:19.566393 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Oct 12 02:17:19.566393 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 02:17:19.566393 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 02:17:19.566393 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 02:17:19.566393 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Oct 12 02:17:19.566393 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 02:17:19.566393 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Oct 12 02:17:19.566393 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 12 02:17:19.567264 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 12 02:17:19.567264 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 02:17:19.567264 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Oct 12 02:17:19.567264 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 228/451] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Oct 12 02:17:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 02:17:19.568233 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07087cd-8ca8-4401-9d59-2a6f8739920d None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:17:19.623979 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef489b7-6430-49c3-86c2-b74a5537eb13 None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:17:19.656704 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4e7829-6c4f-4a41-9658-163fce9d6921 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:17:19.657322 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4e7829-6c4f-4a41-9658-163fce9d6921 None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:19.657595 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4e7829-6c4f-4a41-9658-163fce9d6921 None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:19.657859 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4e7829-6c4f-4a41-9658-163fce9d6921 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:19.665051 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4e7829-6c4f-4a41-9658-163fce9d6921 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:17:19.666504 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4e7829-6c4f-4a41-9658-163fce9d6921 None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:17:19.667192 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07087cd-8ca8-4401-9d59-2a6f8739920d None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:17:19.679471 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application [None req-9e4e7829-6c4f-4a41-9658-163fce9d6921 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 12 02:17:19.679471 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 02:17:19.679471 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 02:17:19.679471 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 02:17:19.679471 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 02:17:19.679471 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 02:17:19.679471 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 02:17:19.679471 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 02:17:19.679471 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 02:17:19.679471 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 02:17:19.679471 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 02:17:19.679471 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 02:17:19.679471 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 12 02:17:19.679471 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 12 02:17:19.679471 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 12 02:17:19.680528 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 12 02:17:19.680528 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 02:17:19.680528 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 02:17:19.680528 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 02:17:19.680528 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 02:17:19.680528 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 02:17:19.680528 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 02:17:19.680528 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 02:17:19.680528 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application with Lock( Oct 12 02:17:19.680528 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 02:17:19.680528 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._enter() Oct 12 02:17:19.680528 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 02:17:19.680528 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 02:17:19.680528 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 02:17:19.680528 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.creator() Oct 12 02:17:19.680528 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 02:17:19.680528 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application created_value = creator( Oct 12 02:17:19.681602 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 12 02:17:19.681602 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 12 02:17:19.681602 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 12 02:17:19.681602 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 12 02:17:19.681602 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 12 02:17:19.681602 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 12 02:17:19.681602 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 12 02:17:19.681602 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Oct 12 02:17:19.681602 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 224/452] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Oct 12 02:17:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 02:17:19.682178 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4e7829-6c4f-4a41-9658-163fce9d6921 None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:17:19.702584 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27c7d2a-7d80-4a2c-a722-14309327b3ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:17:19.703177 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27c7d2a-7d80-4a2c-a722-14309327b3ab None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:19.703453 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27c7d2a-7d80-4a2c-a722-14309327b3ab None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:19.703722 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27c7d2a-7d80-4a2c-a722-14309327b3ab None admin] PATH_INFO: `/v3/projects` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:19.704403 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27c7d2a-7d80-4a2c-a722-14309327b3ab None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 02:17:19.704735 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27c7d2a-7d80-4a2c-a722-14309327b3ab None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:17:19.706161 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27c7d2a-7d80-4a2c-a722-14309327b3ab None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:17:19.718747 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 229/453] 10.222.0.18 () {56 vars in 1148 bytes} [Wed Oct 12 02:17:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 02:17:19.719474 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27c7d2a-7d80-4a2c-a722-14309327b3ab None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:17:19.765288 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:17:19.772873 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:17:19.781658 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4e7829-6c4f-4a41-9658-163fce9d6921 None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:17:19.815003 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3f81fe-f17b-4954-b24e-1a68be7cbcf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:17:19.815626 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3f81fe-f17b-4954-b24e-1a68be7cbcf5 None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:19.815904 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3f81fe-f17b-4954-b24e-1a68be7cbcf5 None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:19.816175 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3f81fe-f17b-4954-b24e-1a68be7cbcf5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:19.820540 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27c7d2a-7d80-4a2c-a722-14309327b3ab None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:17:19.827027 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3f81fe-f17b-4954-b24e-1a68be7cbcf5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:17:19.828486 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3f81fe-f17b-4954-b24e-1a68be7cbcf5 None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:17:19.843117 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application [None req-3e3f81fe-f17b-4954-b24e-1a68be7cbcf5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 02:17:19.843117 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 02:17:19.843117 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 02:17:19.843117 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 02:17:19.843117 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 02:17:19.843117 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 02:17:19.843117 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 02:17:19.843117 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 02:17:19.843117 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 02:17:19.843117 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 02:17:19.843117 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 02:17:19.843117 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 02:17:19.843117 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 12 02:17:19.843117 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 12 02:17:19.843117 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 12 02:17:19.843117 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 12 02:17:19.844032 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 02:17:19.844032 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 02:17:19.844032 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 02:17:19.844032 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 02:17:19.844032 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 02:17:19.844032 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 02:17:19.844032 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 02:17:19.844032 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application with Lock( Oct 12 02:17:19.844032 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 02:17:19.844032 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._enter() Oct 12 02:17:19.844032 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 02:17:19.844032 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 02:17:19.844032 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 02:17:19.844032 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.creator() Oct 12 02:17:19.844032 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 02:17:19.844032 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application created_value = creator( Oct 12 02:17:19.844032 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 12 02:17:19.844946 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 12 02:17:19.844946 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 02:17:19.844946 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Oct 12 02:17:19.849000 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 225/454] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Oct 12 02:17:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 02:17:19.849832 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3f81fe-f17b-4954-b24e-1a68be7cbcf5 None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:17:19.854171 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1569a332-00dd-49bd-a876-b1c17b4b3705 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:17:19.854768 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1569a332-00dd-49bd-a876-b1c17b4b3705 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:19.855040 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1569a332-00dd-49bd-a876-b1c17b4b3705 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:19.855305 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1569a332-00dd-49bd-a876-b1c17b4b3705 None admin] PATH_INFO: `/v3/domains` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:19.855941 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1569a332-00dd-49bd-a876-b1c17b4b3705 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 02:17:19.856242 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1569a332-00dd-49bd-a876-b1c17b4b3705 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:17:19.857638 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1569a332-00dd-49bd-a876-b1c17b4b3705 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:17:19.869440 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 230/455] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Oct 12 02:17:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 02:17:19.870041 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1569a332-00dd-49bd-a876-b1c17b4b3705 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:17:19.950389 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3f81fe-f17b-4954-b24e-1a68be7cbcf5 None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:17:19.974426 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1569a332-00dd-49bd-a876-b1c17b4b3705 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:17:19.982422 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f72319-210d-4d6b-9f96-28d62d80aefd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:17:19.983042 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f72319-210d-4d6b-9f96-28d62d80aefd None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:19.983314 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f72319-210d-4d6b-9f96-28d62d80aefd None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:19.983580 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f72319-210d-4d6b-9f96-28d62d80aefd None admin] PATH_INFO: `/v3/roles/service` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:19.986622 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:17:19.991207 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:17:19.996390 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f72319-210d-4d6b-9f96-28d62d80aefd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 02:17:20.001329 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application [None req-16f72319-210d-4d6b-9f96-28d62d80aefd None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 12 02:17:20.001329 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 02:17:20.001329 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 02:17:20.001329 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 02:17:20.001329 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 02:17:20.001329 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 02:17:20.001329 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 02:17:20.001329 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 02:17:20.001329 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 02:17:20.001329 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 02:17:20.001329 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 02:17:20.001329 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 02:17:20.001329 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 12 02:17:20.001329 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 12 02:17:20.001329 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 12 02:17:20.001329 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 12 02:17:20.002213 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 12 02:17:20.002213 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 12 02:17:20.002213 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 12 02:17:20.002213 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 12 02:17:20.002213 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 02:17:20.002213 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 02:17:20.002213 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 02:17:20.002213 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 02:17:20.002213 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 02:17:20.002213 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 02:17:20.002213 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 02:17:20.002213 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application with Lock( Oct 12 02:17:20.002213 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 02:17:20.002213 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._enter() Oct 12 02:17:20.002213 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 02:17:20.002213 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 02:17:20.003062 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 02:17:20.003062 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.creator() Oct 12 02:17:20.003062 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 02:17:20.003062 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application created_value = creator( Oct 12 02:17:20.003062 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 12 02:17:20.003062 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 12 02:17:20.003062 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 12 02:17:20.003062 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 12 02:17:20.003062 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 12 02:17:20.003062 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 12 02:17:20.003062 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 12 02:17:20.003062 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Oct 12 02:17:20.003062 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 226/456] 10.222.0.18 () {56 vars in 1102 bytes} [Wed Oct 12 02:17:19 2022] GET /identity/v3/roles/service => generated 85 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 02:17:20.003753 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f72319-210d-4d6b-9f96-28d62d80aefd None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:17:20.011155 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94d7b9a-1b43-4991-95eb-4c4a90001106 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:17:20.012013 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94d7b9a-1b43-4991-95eb-4c4a90001106 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:20.012295 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94d7b9a-1b43-4991-95eb-4c4a90001106 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:20.012594 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94d7b9a-1b43-4991-95eb-4c4a90001106 None admin] PATH_INFO: `/v3/projects` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:20.013285 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94d7b9a-1b43-4991-95eb-4c4a90001106 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 02:17:20.013586 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94d7b9a-1b43-4991-95eb-4c4a90001106 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:17:20.015006 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94d7b9a-1b43-4991-95eb-4c4a90001106 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:17:20.027955 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 231/457] 10.222.0.18 () {56 vars in 1148 bytes} [Wed Oct 12 02:17:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 02:17:20.028800 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94d7b9a-1b43-4991-95eb-4c4a90001106 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:17:20.114130 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f72319-210d-4d6b-9f96-28d62d80aefd None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:17:20.139718 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94d7b9a-1b43-4991-95eb-4c4a90001106 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:17:20.152216 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345d5128-b22e-4a8f-8d2f-a6eb9cf3c8d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:17:20.152855 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345d5128-b22e-4a8f-8d2f-a6eb9cf3c8d1 None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:20.153137 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345d5128-b22e-4a8f-8d2f-a6eb9cf3c8d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:20.153414 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345d5128-b22e-4a8f-8d2f-a6eb9cf3c8d1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:20.154140 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345d5128-b22e-4a8f-8d2f-a6eb9cf3c8d1 None admin] RBAC: Adding query filter params (role.id=91634b0ac542413bb04e5ce92e66459d, scope.project.id=beb6def6fcad45959e56425bb8bff4d1, user.id=f2fca96c111b45b795fb757f77908ff1) {{(pid=81361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 02:17:20.154454 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345d5128-b22e-4a8f-8d2f-a6eb9cf3c8d1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:17:20.155911 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345d5128-b22e-4a8f-8d2f-a6eb9cf3c8d1 None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:17:20.162275 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 227/458] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Oct 12 02:17:20 2022] GET /identity/v3/role_assignments?user.id=f2fca96c111b45b795fb757f77908ff1&scope.project.id=beb6def6fcad45959e56425bb8bff4d1&role.id=91634b0ac542413bb04e5ce92e66459d => generated 608 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 02:17:20.163029 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345d5128-b22e-4a8f-8d2f-a6eb9cf3c8d1 None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:17:20.179948 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31fd6aa-c318-4604-8765-cb86aa9e8e85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:17:20.180634 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31fd6aa-c318-4604-8765-cb86aa9e8e85 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:20.180913 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31fd6aa-c318-4604-8765-cb86aa9e8e85 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:20.181182 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31fd6aa-c318-4604-8765-cb86aa9e8e85 None admin] PATH_INFO: `/v3/domains` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:20.181866 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31fd6aa-c318-4604-8765-cb86aa9e8e85 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 02:17:20.182224 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31fd6aa-c318-4604-8765-cb86aa9e8e85 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:17:20.183664 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31fd6aa-c318-4604-8765-cb86aa9e8e85 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:17:20.197673 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 232/459] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Oct 12 02:17:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 02:17:20.198892 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31fd6aa-c318-4604-8765-cb86aa9e8e85 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:17:20.235049 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:17:20.265233 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:17:20.320057 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345d5128-b22e-4a8f-8d2f-a6eb9cf3c8d1 None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:17:20.332147 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31fd6aa-c318-4604-8765-cb86aa9e8e85 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:17:20.359085 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630775d3-189a-4616-93d2-fbecb865d90f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:17:20.360206 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630775d3-189a-4616-93d2-fbecb865d90f None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:20.361027 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630775d3-189a-4616-93d2-fbecb865d90f None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:20.361372 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630775d3-189a-4616-93d2-fbecb865d90f None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:20.371598 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630775d3-189a-4616-93d2-fbecb865d90f None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:17:20.373250 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630775d3-189a-4616-93d2-fbecb865d90f None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:17:20.377465 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ac0972-9cbf-44c2-8d4c-812b5ce8de68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:17:20.378079 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ac0972-9cbf-44c2-8d4c-812b5ce8de68 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:20.379262 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ac0972-9cbf-44c2-8d4c-812b5ce8de68 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:20.379262 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ac0972-9cbf-44c2-8d4c-812b5ce8de68 None admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:20.379262 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ac0972-9cbf-44c2-8d4c-812b5ce8de68 None admin] RBAC: Adding query filter params (name=service) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 02:17:20.379585 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ac0972-9cbf-44c2-8d4c-812b5ce8de68 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:17:20.381039 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ac0972-9cbf-44c2-8d4c-812b5ce8de68 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:17:20.386957 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application [None req-630775d3-189a-4616-93d2-fbecb865d90f None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Oct 12 02:17:20.386957 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 02:17:20.386957 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 02:17:20.386957 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 02:17:20.386957 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 02:17:20.386957 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 02:17:20.386957 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 02:17:20.386957 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 02:17:20.386957 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 02:17:20.386957 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 02:17:20.386957 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 02:17:20.386957 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 02:17:20.386957 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 12 02:17:20.386957 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 12 02:17:20.386957 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 12 02:17:20.386957 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 12 02:17:20.387885 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 02:17:20.387885 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 02:17:20.387885 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 12 02:17:20.387885 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 12 02:17:20.387885 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 12 02:17:20.387885 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 12 02:17:20.387885 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 02:17:20.387885 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 02:17:20.387885 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 02:17:20.387885 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 02:17:20.387885 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 02:17:20.387885 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application with Lock( Oct 12 02:17:20.387885 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 02:17:20.387885 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._enter() Oct 12 02:17:20.387885 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 02:17:20.387885 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 02:17:20.387885 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 02:17:20.387885 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.creator() Oct 12 02:17:20.393432 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 02:17:20.393432 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application created_value = creator( Oct 12 02:17:20.393432 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 12 02:17:20.393432 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 12 02:17:20.393432 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 12 02:17:20.393432 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 12 02:17:20.393432 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 12 02:17:20.393432 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 12 02:17:20.393432 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Oct 12 02:17:20.393432 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Oct 12 02:17:20.393432 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 228/460] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Oct 12 02:17:20 2022] GET /identity/v3/users/cinder => generated 84 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 02:17:20.393432 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630775d3-189a-4616-93d2-fbecb865d90f None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:17:20.394052 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 233/461] 10.222.0.18 () {56 vars in 1103 bytes} [Wed Oct 12 02:17:20 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 02:17:20.394052 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ac0972-9cbf-44c2-8d4c-812b5ce8de68 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:17:20.500563 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:17:20.509838 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ac0972-9cbf-44c2-8d4c-812b5ce8de68 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:17:20.517827 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630775d3-189a-4616-93d2-fbecb865d90f None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:17:20.545770 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:17:20.559800 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a93205-85a1-4e0a-a0fb-9c429fd263de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:17:20.560131 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c1d318-b43d-4564-aa7b-5c99d12a143f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:17:20.560824 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c1d318-b43d-4564-aa7b-5c99d12a143f None admin] REQUEST_METHOD: `PUT` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:20.561047 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a93205-85a1-4e0a-a0fb-9c429fd263de None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:20.561156 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c1d318-b43d-4564-aa7b-5c99d12a143f None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:20.561372 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c1d318-b43d-4564-aa7b-5c99d12a143f None admin] PATH_INFO: `/v3/projects/beb6def6fcad45959e56425bb8bff4d1/users/af9bd50c42cc437dbdd5a431d8adbb26/roles/91634b0ac542413bb04e5ce92e66459d` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:20.561698 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a93205-85a1-4e0a-a0fb-9c429fd263de None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:20.562297 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a93205-85a1-4e0a-a0fb-9c429fd263de None admin] PATH_INFO: `/v3/users/glance` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:20.576537 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a93205-85a1-4e0a-a0fb-9c429fd263de None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:17:20.577820 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c1d318-b43d-4564-aa7b-5c99d12a143f None admin] RBAC: Authorizing `identity:create_grant(project_id=beb6def6fcad45959e56425bb8bff4d1, user_id=af9bd50c42cc437dbdd5a431d8adbb26, role_id=91634b0ac542413bb04e5ce92e66459d)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:17:20.578522 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a93205-85a1-4e0a-a0fb-9c429fd263de None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:17:20.579285 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c1d318-b43d-4564-aa7b-5c99d12a143f None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:17:20.592051 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-d6a93205-85a1-4e0a-a0fb-9c429fd263de None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Oct 12 02:17:20.592051 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 02:17:20.592051 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 02:17:20.592051 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 02:17:20.592051 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 02:17:20.592051 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 02:17:20.592051 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 02:17:20.592051 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 02:17:20.592051 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 02:17:20.592051 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 02:17:20.592051 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 02:17:20.592051 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 02:17:20.592051 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 12 02:17:20.592051 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 12 02:17:20.592051 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 12 02:17:20.592051 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 12 02:17:20.593242 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 02:17:20.593242 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 02:17:20.593242 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 12 02:17:20.593242 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 12 02:17:20.593242 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 12 02:17:20.593242 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 12 02:17:20.593242 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 02:17:20.593242 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 02:17:20.593242 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 02:17:20.593242 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 02:17:20.593242 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 02:17:20.593242 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Oct 12 02:17:20.593242 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 02:17:20.593242 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Oct 12 02:17:20.593242 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 02:17:20.593242 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 02:17:20.593242 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 02:17:20.593242 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Oct 12 02:17:20.594138 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 02:17:20.594138 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Oct 12 02:17:20.594138 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 12 02:17:20.594138 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 12 02:17:20.594138 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 12 02:17:20.594138 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 12 02:17:20.594138 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 12 02:17:20.594138 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 12 02:17:20.594138 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Oct 12 02:17:20.594138 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Oct 12 02:17:20.594724 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 229/462] 10.222.0.18 () {58 vars in 1439 bytes} [Wed Oct 12 02:17:20 2022] PUT /identity/v3/projects/beb6def6fcad45959e56425bb8bff4d1/users/af9bd50c42cc437dbdd5a431d8adbb26/roles/91634b0ac542413bb04e5ce92e66459d => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 02:17:20.594724 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c1d318-b43d-4564-aa7b-5c99d12a143f None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:17:20.596050 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 234/463] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Oct 12 02:17:20 2022] GET /identity/v3/users/glance => generated 84 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 02:17:20.597611 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a93205-85a1-4e0a-a0fb-9c429fd263de None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:17:20.740196 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a93205-85a1-4e0a-a0fb-9c429fd263de None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:17:20.759522 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c1d318-b43d-4564-aa7b-5c99d12a143f None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:17:20.790863 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c171a4-dbec-41dd-b4a4-aebdc81411d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:17:20.792218 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c171a4-dbec-41dd-b4a4-aebdc81411d1 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:20.792871 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c171a4-dbec-41dd-b4a4-aebdc81411d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:20.793147 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c171a4-dbec-41dd-b4a4-aebdc81411d1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:20.801141 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98fde70-e94d-4429-95ae-6ce16f12e53a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:17:20.803489 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98fde70-e94d-4429-95ae-6ce16f12e53a None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:20.803979 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98fde70-e94d-4429-95ae-6ce16f12e53a None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:20.804852 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98fde70-e94d-4429-95ae-6ce16f12e53a None admin] PATH_INFO: `/v3/users` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:20.805916 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98fde70-e94d-4429-95ae-6ce16f12e53a None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 02:17:20.805916 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98fde70-e94d-4429-95ae-6ce16f12e53a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:17:20.807379 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98fde70-e94d-4429-95ae-6ce16f12e53a None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:17:20.808975 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c171a4-dbec-41dd-b4a4-aebdc81411d1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:17:20.810291 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c171a4-dbec-41dd-b4a4-aebdc81411d1 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:17:20.827753 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-79c171a4-dbec-41dd-b4a4-aebdc81411d1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 02:17:20.827753 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 02:17:20.827753 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 02:17:20.827753 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 02:17:20.827753 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 02:17:20.827753 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 02:17:20.827753 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 02:17:20.827753 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 02:17:20.827753 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 02:17:20.827753 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 02:17:20.827753 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 02:17:20.827753 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 02:17:20.827753 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 12 02:17:20.827753 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 12 02:17:20.827753 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 12 02:17:20.827753 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 12 02:17:20.828748 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 02:17:20.828748 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 02:17:20.828748 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 02:17:20.828748 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 02:17:20.828748 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 02:17:20.828748 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 02:17:20.828748 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 02:17:20.828748 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Oct 12 02:17:20.828748 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 02:17:20.828748 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Oct 12 02:17:20.828748 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 02:17:20.828748 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 02:17:20.828748 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 02:17:20.828748 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Oct 12 02:17:20.828748 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 02:17:20.828748 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Oct 12 02:17:20.828748 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 12 02:17:20.836269 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 12 02:17:20.836269 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 02:17:20.836269 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Oct 12 02:17:20.836269 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 235/464] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Oct 12 02:17:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 02:17:20.836269 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c171a4-dbec-41dd-b4a4-aebdc81411d1 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:17:20.836594 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 230/465] 10.222.0.18 () {56 vars in 1137 bytes} [Wed Oct 12 02:17:20 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 02:17:20.836594 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98fde70-e94d-4429-95ae-6ce16f12e53a None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:17:20.845420 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:17:20.882783 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:17:20.965128 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98fde70-e94d-4429-95ae-6ce16f12e53a None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:17:20.965614 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c171a4-dbec-41dd-b4a4-aebdc81411d1 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:17:21.002487 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d47725-be5a-44d3-ac64-7c71eafc2b3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:17:21.003202 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d47725-be5a-44d3-ac64-7c71eafc2b3c None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:21.003482 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d47725-be5a-44d3-ac64-7c71eafc2b3c None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:21.003747 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d47725-be5a-44d3-ac64-7c71eafc2b3c None admin] PATH_INFO: `/v3/domains` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:21.004385 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d47725-be5a-44d3-ac64-7c71eafc2b3c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 02:17:21.004710 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d47725-be5a-44d3-ac64-7c71eafc2b3c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:17:21.007037 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d47725-be5a-44d3-ac64-7c71eafc2b3c None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:17:21.012568 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49ad190-af97-4bd3-b2e2-241cf89d6a25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:17:21.013480 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49ad190-af97-4bd3-b2e2-241cf89d6a25 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:21.014615 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49ad190-af97-4bd3-b2e2-241cf89d6a25 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:21.015119 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49ad190-af97-4bd3-b2e2-241cf89d6a25 None admin] PATH_INFO: `/v3/users` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:21.016628 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49ad190-af97-4bd3-b2e2-241cf89d6a25 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 02:17:21.017427 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49ad190-af97-4bd3-b2e2-241cf89d6a25 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:17:21.019057 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49ad190-af97-4bd3-b2e2-241cf89d6a25 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:17:21.023859 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 231/466] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Oct 12 02:17:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 02:17:21.024798 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d47725-be5a-44d3-ac64-7c71eafc2b3c None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:17:21.040103 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 236/467] 10.222.0.18 () {56 vars in 1137 bytes} [Wed Oct 12 02:17:20 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 02:17:21.041698 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49ad190-af97-4bd3-b2e2-241cf89d6a25 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:17:21.123014 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:17:21.125464 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:17:21.134871 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d47725-be5a-44d3-ac64-7c71eafc2b3c None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:17:21.171452 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a4a2e3-c85c-408c-99f8-879809240169 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:17:21.172274 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a4a2e3-c85c-408c-99f8-879809240169 None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:21.172383 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a4a2e3-c85c-408c-99f8-879809240169 None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:21.172702 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a4a2e3-c85c-408c-99f8-879809240169 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:21.175772 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49ad190-af97-4bd3-b2e2-241cf89d6a25 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:17:21.216768 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2dd917e-0869-4bdb-a9c7-f1d82ae8731f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:17:21.217747 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dd917e-0869-4bdb-a9c7-f1d82ae8731f None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:21.218535 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dd917e-0869-4bdb-a9c7-f1d82ae8731f None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:21.219039 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dd917e-0869-4bdb-a9c7-f1d82ae8731f None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:21.228193 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2dd917e-0869-4bdb-a9c7-f1d82ae8731f None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:17:21.230300 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2dd917e-0869-4bdb-a9c7-f1d82ae8731f None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:17:21.243626 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-d2dd917e-0869-4bdb-a9c7-f1d82ae8731f None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Oct 12 02:17:21.243626 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 02:17:21.243626 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 02:17:21.243626 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 02:17:21.243626 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 02:17:21.243626 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 02:17:21.243626 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 02:17:21.243626 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 02:17:21.243626 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 02:17:21.243626 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 02:17:21.243626 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 02:17:21.243626 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 02:17:21.243626 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 12 02:17:21.243626 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 12 02:17:21.243626 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 12 02:17:21.243626 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 12 02:17:21.244540 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 02:17:21.244540 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 02:17:21.244540 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 12 02:17:21.244540 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 12 02:17:21.244540 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 12 02:17:21.244540 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 12 02:17:21.244540 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 02:17:21.244540 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 02:17:21.244540 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 02:17:21.244540 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 02:17:21.244540 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 02:17:21.244540 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Oct 12 02:17:21.244540 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 02:17:21.244540 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Oct 12 02:17:21.244540 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 02:17:21.244540 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 02:17:21.244540 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 02:17:21.244540 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Oct 12 02:17:21.245445 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 02:17:21.245445 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Oct 12 02:17:21.245445 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 12 02:17:21.245445 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 12 02:17:21.245445 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 12 02:17:21.245445 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 12 02:17:21.245445 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 12 02:17:21.245445 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 12 02:17:21.245445 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Oct 12 02:17:21.245445 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Oct 12 02:17:21.245942 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 237/468] 10.222.0.18 () {56 vars in 1102 bytes} [Wed Oct 12 02:17:21 2022] GET /identity/v3/users/neutron => generated 85 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 02:17:21.247284 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2dd917e-0869-4bdb-a9c7-f1d82ae8731f None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:17:21.250457 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a4a2e3-c85c-408c-99f8-879809240169 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:17:21.252532 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a4a2e3-c85c-408c-99f8-879809240169 None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:17:21.371933 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:17:21.373186 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2dd917e-0869-4bdb-a9c7-f1d82ae8731f None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:17:21.383036 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 232/469] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Oct 12 02:17:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 12 02:17:21.383829 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a4a2e3-c85c-408c-99f8-879809240169 None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:17:21.405257 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:17:21.421407 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f583f1-ae62-42cf-a170-1d1b4ac5773c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:17:21.422368 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f583f1-ae62-42cf-a170-1d1b4ac5773c None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:21.422863 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f583f1-ae62-42cf-a170-1d1b4ac5773c None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:21.423330 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f583f1-ae62-42cf-a170-1d1b4ac5773c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:21.505330 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a4a2e3-c85c-408c-99f8-879809240169 None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:17:21.509546 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f583f1-ae62-42cf-a170-1d1b4ac5773c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:17:21.511227 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f583f1-ae62-42cf-a170-1d1b4ac5773c None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:17:21.557355 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdaa7ba6-592d-489e-8f36-a55403ed3154 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:17:21.558199 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdaa7ba6-592d-489e-8f36-a55403ed3154 None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:21.558476 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdaa7ba6-592d-489e-8f36-a55403ed3154 None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:21.558746 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdaa7ba6-592d-489e-8f36-a55403ed3154 None admin] PATH_INFO: `/v3/users` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:21.559483 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdaa7ba6-592d-489e-8f36-a55403ed3154 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 02:17:21.559784 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdaa7ba6-592d-489e-8f36-a55403ed3154 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:17:21.562212 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdaa7ba6-592d-489e-8f36-a55403ed3154 None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:17:21.588749 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 233/470] 10.222.0.18 () {56 vars in 1139 bytes} [Wed Oct 12 02:17:21 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 02:17:21.589783 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdaa7ba6-592d-489e-8f36-a55403ed3154 None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:17:21.645041 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 238/471] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Oct 12 02:17:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 12 02:17:21.646462 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f583f1-ae62-42cf-a170-1d1b4ac5773c None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:17:21.652659 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:17:21.673907 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:17:21.722121 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdaa7ba6-592d-489e-8f36-a55403ed3154 None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:17:21.754711 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f583f1-ae62-42cf-a170-1d1b4ac5773c None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:17:21.774385 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cd05c1-5e4d-468e-8d6d-954e819d6ee8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:17:21.775662 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cd05c1-5e4d-468e-8d6d-954e819d6ee8 None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:21.776634 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cd05c1-5e4d-468e-8d6d-954e819d6ee8 None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:21.777085 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cd05c1-5e4d-468e-8d6d-954e819d6ee8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:21.791507 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce35481-17ad-4de4-b978-323e403d5cb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:17:21.792127 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce35481-17ad-4de4-b978-323e403d5cb7 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:21.792486 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce35481-17ad-4de4-b978-323e403d5cb7 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:21.792847 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce35481-17ad-4de4-b978-323e403d5cb7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:21.793055 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89cd05c1-5e4d-468e-8d6d-954e819d6ee8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:17:21.794691 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89cd05c1-5e4d-468e-8d6d-954e819d6ee8 None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:17:21.814905 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application [None req-89cd05c1-5e4d-468e-8d6d-954e819d6ee8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 02:17:21.814905 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 02:17:21.814905 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 02:17:21.814905 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 02:17:21.814905 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 02:17:21.814905 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 02:17:21.814905 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 02:17:21.814905 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 02:17:21.814905 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 02:17:21.814905 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 02:17:21.814905 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 02:17:21.814905 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 02:17:21.814905 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 12 02:17:21.814905 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 12 02:17:21.814905 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 12 02:17:21.814905 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 12 02:17:21.815822 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 02:17:21.815822 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 02:17:21.815822 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 02:17:21.815822 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 02:17:21.815822 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 02:17:21.815822 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 02:17:21.815822 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 02:17:21.815822 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application with Lock( Oct 12 02:17:21.815822 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 02:17:21.815822 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._enter() Oct 12 02:17:21.815822 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 02:17:21.815822 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 02:17:21.815822 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 02:17:21.815822 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.creator() Oct 12 02:17:21.815822 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 02:17:21.815822 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application created_value = creator( Oct 12 02:17:21.815822 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 12 02:17:21.816708 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 12 02:17:21.816708 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 02:17:21.816708 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Oct 12 02:17:21.822820 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 234/472] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Oct 12 02:17:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 02:17:21.822820 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cd05c1-5e4d-468e-8d6d-954e819d6ee8 None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:17:21.883973 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce35481-17ad-4de4-b978-323e403d5cb7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:17:21.886216 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce35481-17ad-4de4-b978-323e403d5cb7 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:17:21.922303 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:17:21.934168 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:17:21.939214 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cd05c1-5e4d-468e-8d6d-954e819d6ee8 None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:17:21.981506 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac4e1ed-bbd4-4d18-a0a3-f45420b11776 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:17:21.982528 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac4e1ed-bbd4-4d18-a0a3-f45420b11776 None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:21.983004 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac4e1ed-bbd4-4d18-a0a3-f45420b11776 None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:21.983471 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac4e1ed-bbd4-4d18-a0a3-f45420b11776 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:21.996656 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac4e1ed-bbd4-4d18-a0a3-f45420b11776 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:17:21.998414 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac4e1ed-bbd4-4d18-a0a3-f45420b11776 None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:17:22.013735 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 239/473] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Oct 12 02:17:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 12 02:17:22.014586 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce35481-17ad-4de4-b978-323e403d5cb7 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:17:22.015118 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application [None req-eac4e1ed-bbd4-4d18-a0a3-f45420b11776 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 02:17:22.015118 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 02:17:22.015118 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 02:17:22.015118 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 02:17:22.015118 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 02:17:22.015118 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 02:17:22.015118 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 02:17:22.015118 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 02:17:22.015118 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 02:17:22.015118 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 02:17:22.015118 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 02:17:22.015118 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 02:17:22.015118 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 12 02:17:22.015118 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 12 02:17:22.015118 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 12 02:17:22.015118 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 12 02:17:22.015978 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 02:17:22.015978 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 02:17:22.015978 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 02:17:22.015978 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 02:17:22.015978 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 02:17:22.015978 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 02:17:22.015978 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 02:17:22.015978 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application with Lock( Oct 12 02:17:22.015978 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 02:17:22.015978 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._enter() Oct 12 02:17:22.015978 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 02:17:22.015978 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 02:17:22.015978 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 02:17:22.015978 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.creator() Oct 12 02:17:22.015978 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 02:17:22.015978 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application created_value = creator( Oct 12 02:17:22.015978 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 12 02:17:22.016841 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 12 02:17:22.016841 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 02:17:22.016841 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Oct 12 02:17:22.019079 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 235/474] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Oct 12 02:17:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 02:17:22.020157 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac4e1ed-bbd4-4d18-a0a3-f45420b11776 None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:17:22.122347 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce35481-17ad-4de4-b978-323e403d5cb7 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:17:22.129080 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac4e1ed-bbd4-4d18-a0a3-f45420b11776 None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:17:22.147958 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:17:22.159524 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcabee59-22b5-411c-8698-d4c40c4ad56f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:17:22.160032 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcabee59-22b5-411c-8698-d4c40c4ad56f None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:22.160310 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcabee59-22b5-411c-8698-d4c40c4ad56f None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:22.160607 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcabee59-22b5-411c-8698-d4c40c4ad56f None admin] PATH_INFO: `/v3/domains` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:22.161376 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcabee59-22b5-411c-8698-d4c40c4ad56f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 02:17:22.161804 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcabee59-22b5-411c-8698-d4c40c4ad56f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:17:22.163094 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcabee59-22b5-411c-8698-d4c40c4ad56f None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:17:22.170143 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ad4a20-f56e-464c-a549-28f7e1f0722a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:17:22.171062 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ad4a20-f56e-464c-a549-28f7e1f0722a None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:22.171539 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ad4a20-f56e-464c-a549-28f7e1f0722a None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:22.172100 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ad4a20-f56e-464c-a549-28f7e1f0722a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:22.180739 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 240/475] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Oct 12 02:17:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 02:17:22.180739 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcabee59-22b5-411c-8698-d4c40c4ad56f None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:17:22.189990 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ad4a20-f56e-464c-a549-28f7e1f0722a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:17:22.191675 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ad4a20-f56e-464c-a549-28f7e1f0722a None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:17:22.208443 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application [None req-f1ad4a20-f56e-464c-a549-28f7e1f0722a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 02:17:22.208443 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 02:17:22.208443 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 02:17:22.208443 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 02:17:22.208443 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 02:17:22.208443 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 02:17:22.208443 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 02:17:22.208443 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 02:17:22.208443 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 02:17:22.208443 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 02:17:22.208443 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 02:17:22.208443 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 02:17:22.208443 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 12 02:17:22.208443 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 12 02:17:22.208443 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 12 02:17:22.208443 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 12 02:17:22.209484 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 02:17:22.209484 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 02:17:22.209484 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 02:17:22.209484 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 02:17:22.209484 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 02:17:22.209484 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 02:17:22.209484 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 02:17:22.209484 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application with Lock( Oct 12 02:17:22.209484 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 02:17:22.209484 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._enter() Oct 12 02:17:22.209484 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 02:17:22.209484 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 02:17:22.209484 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 02:17:22.209484 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.creator() Oct 12 02:17:22.209484 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 02:17:22.209484 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application created_value = creator( Oct 12 02:17:22.209484 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 12 02:17:22.210315 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 12 02:17:22.210315 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 02:17:22.210315 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Oct 12 02:17:22.212448 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 236/476] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Oct 12 02:17:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 02:17:22.213785 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ad4a20-f56e-464c-a549-28f7e1f0722a None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:17:22.217681 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:17:22.287731 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcabee59-22b5-411c-8698-d4c40c4ad56f None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:17:22.323994 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af09aae-9f1f-4b05-8892-4a7e2ad4c201 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:17:22.325105 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af09aae-9f1f-4b05-8892-4a7e2ad4c201 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:22.325658 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af09aae-9f1f-4b05-8892-4a7e2ad4c201 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:22.326129 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af09aae-9f1f-4b05-8892-4a7e2ad4c201 None admin] PATH_INFO: `/v3/domains` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:22.327076 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af09aae-9f1f-4b05-8892-4a7e2ad4c201 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 02:17:22.327579 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af09aae-9f1f-4b05-8892-4a7e2ad4c201 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:17:22.327683 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ad4a20-f56e-464c-a549-28f7e1f0722a None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:17:22.329351 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af09aae-9f1f-4b05-8892-4a7e2ad4c201 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:17:22.345852 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 241/477] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Oct 12 02:17:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 02:17:22.347282 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af09aae-9f1f-4b05-8892-4a7e2ad4c201 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:17:22.372141 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4ff784-b3a2-4c3b-991a-1fac7497fe82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:17:22.372812 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4ff784-b3a2-4c3b-991a-1fac7497fe82 None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:22.373089 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4ff784-b3a2-4c3b-991a-1fac7497fe82 None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:22.373362 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4ff784-b3a2-4c3b-991a-1fac7497fe82 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:22.381596 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4ff784-b3a2-4c3b-991a-1fac7497fe82 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:17:22.383158 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4ff784-b3a2-4c3b-991a-1fac7497fe82 None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:17:22.395707 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application [None req-5f4ff784-b3a2-4c3b-991a-1fac7497fe82 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 12 02:17:22.395707 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 02:17:22.395707 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 02:17:22.395707 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 02:17:22.395707 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 02:17:22.395707 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 02:17:22.395707 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 02:17:22.395707 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 02:17:22.395707 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 02:17:22.395707 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 02:17:22.395707 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 02:17:22.395707 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 02:17:22.395707 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 12 02:17:22.395707 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 12 02:17:22.395707 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 12 02:17:22.396679 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 12 02:17:22.396679 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 02:17:22.396679 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 02:17:22.396679 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 02:17:22.396679 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 02:17:22.396679 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 02:17:22.396679 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 02:17:22.396679 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 02:17:22.396679 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application with Lock( Oct 12 02:17:22.396679 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 02:17:22.396679 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._enter() Oct 12 02:17:22.396679 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 02:17:22.396679 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 02:17:22.396679 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 02:17:22.396679 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.creator() Oct 12 02:17:22.396679 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 02:17:22.396679 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application created_value = creator( Oct 12 02:17:22.397506 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 12 02:17:22.397506 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 12 02:17:22.397506 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 12 02:17:22.397506 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 12 02:17:22.397506 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 12 02:17:22.397506 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 12 02:17:22.397506 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 12 02:17:22.397506 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Oct 12 02:17:22.397506 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 237/478] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Oct 12 02:17:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 02:17:22.402473 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4ff784-b3a2-4c3b-991a-1fac7497fe82 None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:17:22.404700 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:17:22.464362 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af09aae-9f1f-4b05-8892-4a7e2ad4c201 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:17:22.470969 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:17:22.502205 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6350ee26-90f5-437a-924b-e0fbc6ab4cd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:17:22.502810 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6350ee26-90f5-437a-924b-e0fbc6ab4cd7 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:22.503087 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6350ee26-90f5-437a-924b-e0fbc6ab4cd7 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:22.503367 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6350ee26-90f5-437a-924b-e0fbc6ab4cd7 None admin] PATH_INFO: `/v3/domains` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:22.503997 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6350ee26-90f5-437a-924b-e0fbc6ab4cd7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 02:17:22.504298 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6350ee26-90f5-437a-924b-e0fbc6ab4cd7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:17:22.506521 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6350ee26-90f5-437a-924b-e0fbc6ab4cd7 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:17:22.518882 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4ff784-b3a2-4c3b-991a-1fac7497fe82 None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:17:22.522098 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 242/479] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Oct 12 02:17:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 02:17:22.523012 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6350ee26-90f5-437a-924b-e0fbc6ab4cd7 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:17:22.560483 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e9b826-ad96-4532-9216-c76afcc01a51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:17:22.561118 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e9b826-ad96-4532-9216-c76afcc01a51 None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:22.561397 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e9b826-ad96-4532-9216-c76afcc01a51 None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:22.561677 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e9b826-ad96-4532-9216-c76afcc01a51 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:22.568894 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e9b826-ad96-4532-9216-c76afcc01a51 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:17:22.570340 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e9b826-ad96-4532-9216-c76afcc01a51 None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:17:22.581844 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application [None req-f0e9b826-ad96-4532-9216-c76afcc01a51 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 12 02:17:22.581844 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 02:17:22.581844 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 02:17:22.581844 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 02:17:22.581844 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 02:17:22.581844 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 02:17:22.581844 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 02:17:22.581844 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 02:17:22.581844 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 02:17:22.581844 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 02:17:22.581844 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 02:17:22.581844 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 02:17:22.581844 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 12 02:17:22.581844 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 12 02:17:22.581844 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 12 02:17:22.582905 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 12 02:17:22.582905 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 02:17:22.582905 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 02:17:22.582905 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 02:17:22.582905 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 02:17:22.582905 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 02:17:22.582905 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 02:17:22.582905 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 02:17:22.582905 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application with Lock( Oct 12 02:17:22.582905 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 02:17:22.582905 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._enter() Oct 12 02:17:22.582905 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 02:17:22.582905 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 02:17:22.582905 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 02:17:22.582905 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.creator() Oct 12 02:17:22.582905 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 02:17:22.582905 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application created_value = creator( Oct 12 02:17:22.584623 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 12 02:17:22.584623 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 12 02:17:22.584623 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 12 02:17:22.584623 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 12 02:17:22.584623 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 12 02:17:22.584623 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 12 02:17:22.584623 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 12 02:17:22.584623 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Oct 12 02:17:22.584623 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 238/480] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Oct 12 02:17:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 02:17:22.584623 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a750cef-3940-428b-8ab5-fae84d7b6dd6 None None] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:22.585145 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a750cef-3940-428b-8ab5-fae84d7b6dd6 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:22.585145 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a750cef-3940-428b-8ab5-fae84d7b6dd6 None None] PATH_INFO: `/` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:22.586401 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 239/481] 10.222.0.18 () {54 vars in 927 bytes} [Wed Oct 12 02:17:22 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 02:17:22.589689 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a750cef-3940-428b-8ab5-fae84d7b6dd6 None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:17:22.644796 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6350ee26-90f5-437a-924b-e0fbc6ab4cd7 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:17:22.647978 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:17:22.685406 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000e85bf-43a5-4f57-b229-be3e292c0cf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:17:22.686016 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000e85bf-43a5-4f57-b229-be3e292c0cf9 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:22.686296 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000e85bf-43a5-4f57-b229-be3e292c0cf9 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:22.686567 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000e85bf-43a5-4f57-b229-be3e292c0cf9 None admin] PATH_INFO: `/v3/projects` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:22.687288 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000e85bf-43a5-4f57-b229-be3e292c0cf9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 02:17:22.687590 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000e85bf-43a5-4f57-b229-be3e292c0cf9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:17:22.689063 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000e85bf-43a5-4f57-b229-be3e292c0cf9 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:17:22.700027 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a750cef-3940-428b-8ab5-fae84d7b6dd6 None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:17:22.703794 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 243/482] 10.222.0.18 () {56 vars in 1148 bytes} [Wed Oct 12 02:17:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 02:17:22.704822 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000e85bf-43a5-4f57-b229-be3e292c0cf9 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:17:22.729581 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:17:22.746245 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b3f8b7-18dd-4ff7-98a3-3697ac53180b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:17:22.746975 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b3f8b7-18dd-4ff7-98a3-3697ac53180b None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:22.747261 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b3f8b7-18dd-4ff7-98a3-3697ac53180b None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:22.747533 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b3f8b7-18dd-4ff7-98a3-3697ac53180b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:22.758089 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b3f8b7-18dd-4ff7-98a3-3697ac53180b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:17:22.759615 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b3f8b7-18dd-4ff7-98a3-3697ac53180b None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:17:22.773766 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application [None req-45b3f8b7-18dd-4ff7-98a3-3697ac53180b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 12 02:17:22.773766 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 02:17:22.773766 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 02:17:22.773766 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 02:17:22.773766 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 02:17:22.773766 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 02:17:22.773766 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 02:17:22.773766 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 02:17:22.773766 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 02:17:22.773766 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 02:17:22.773766 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 02:17:22.773766 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 02:17:22.773766 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 12 02:17:22.773766 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 12 02:17:22.773766 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 12 02:17:22.775224 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 12 02:17:22.775224 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 02:17:22.775224 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 02:17:22.775224 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 02:17:22.775224 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 02:17:22.775224 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 02:17:22.775224 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 02:17:22.775224 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 02:17:22.775224 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application with Lock( Oct 12 02:17:22.775224 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 02:17:22.775224 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._enter() Oct 12 02:17:22.775224 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 02:17:22.775224 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 02:17:22.775224 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 02:17:22.775224 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.creator() Oct 12 02:17:22.775224 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 02:17:22.775224 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application created_value = creator( Oct 12 02:17:22.776075 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 12 02:17:22.776075 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 12 02:17:22.776075 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 12 02:17:22.776075 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 12 02:17:22.776075 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 12 02:17:22.776075 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 12 02:17:22.776075 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 12 02:17:22.776075 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Oct 12 02:17:22.776075 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 240/483] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Oct 12 02:17:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 02:17:22.776075 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c4650a-14ed-4cd5-bb9e-4e2303506225 None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:22.776636 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c4650a-14ed-4cd5-bb9e-4e2303506225 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:22.776636 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c4650a-14ed-4cd5-bb9e-4e2303506225 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:22.795078 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-19c4650a-14ed-4cd5-bb9e-4e2303506225 None None] MFA Rules not processed for user `a326a5bb7364479382f528a592371656`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:17:22.796278 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-19c4650a-14ed-4cd5-bb9e-4e2303506225 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:17:22.825749 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000e85bf-43a5-4f57-b229-be3e292c0cf9 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:17:22.862070 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71204866-6ba0-4fd7-8015-586fca72238b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:17:22.862686 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71204866-6ba0-4fd7-8015-586fca72238b None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:22.862966 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71204866-6ba0-4fd7-8015-586fca72238b None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:22.863239 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71204866-6ba0-4fd7-8015-586fca72238b None admin] PATH_INFO: `/v3/projects` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:22.863937 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71204866-6ba0-4fd7-8015-586fca72238b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 02:17:22.864796 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71204866-6ba0-4fd7-8015-586fca72238b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:17:22.865517 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 241/484] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Oct 12 02:17:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 12 02:17:22.866604 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71204866-6ba0-4fd7-8015-586fca72238b None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:17:22.866699 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c4650a-14ed-4cd5-bb9e-4e2303506225 None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:17:22.878403 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 244/485] 10.222.0.18 () {56 vars in 1148 bytes} [Wed Oct 12 02:17:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 02:17:22.879189 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71204866-6ba0-4fd7-8015-586fca72238b None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:17:22.909914 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:17:22.968814 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c4650a-14ed-4cd5-bb9e-4e2303506225 None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:17:22.982226 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:17:22.994726 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71204866-6ba0-4fd7-8015-586fca72238b None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:17:23.002589 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3980ab12-fb83-4e9c-804d-f0eb2f805111 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:17:23.003183 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3980ab12-fb83-4e9c-804d-f0eb2f805111 None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:23.003459 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3980ab12-fb83-4e9c-804d-f0eb2f805111 None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:23.003728 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3980ab12-fb83-4e9c-804d-f0eb2f805111 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:23.004443 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3980ab12-fb83-4e9c-804d-f0eb2f805111 None admin] RBAC: Adding query filter params (role.id=91634b0ac542413bb04e5ce92e66459d, scope.project.id=beb6def6fcad45959e56425bb8bff4d1, user.id=9ba688e0c4d44d13898539ee886f95fe) {{(pid=81361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 02:17:23.004964 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3980ab12-fb83-4e9c-804d-f0eb2f805111 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:17:23.006405 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3980ab12-fb83-4e9c-804d-f0eb2f805111 None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:17:23.012121 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 242/486] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Oct 12 02:17:22 2022] GET /identity/v3/role_assignments?user.id=9ba688e0c4d44d13898539ee886f95fe&scope.project.id=beb6def6fcad45959e56425bb8bff4d1&role.id=91634b0ac542413bb04e5ce92e66459d => generated 608 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 02:17:23.013317 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c324ef01-e82c-434b-87cc-d73a99349437 None None] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:23.013599 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c324ef01-e82c-434b-87cc-d73a99349437 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:23.013874 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c324ef01-e82c-434b-87cc-d73a99349437 None None] PATH_INFO: `/` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:23.019183 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 243/487] 10.222.0.18 () {54 vars in 927 bytes} [Wed Oct 12 02:17:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 02:17:23.019183 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c324ef01-e82c-434b-87cc-d73a99349437 None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:17:23.040949 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac867129-791a-454e-9489-102053ba2e6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:17:23.041960 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac867129-791a-454e-9489-102053ba2e6e None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:23.042552 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac867129-791a-454e-9489-102053ba2e6e None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:23.043020 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac867129-791a-454e-9489-102053ba2e6e None admin] PATH_INFO: `/v3/projects` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:23.043962 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac867129-791a-454e-9489-102053ba2e6e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 02:17:23.044513 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac867129-791a-454e-9489-102053ba2e6e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:17:23.046315 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac867129-791a-454e-9489-102053ba2e6e None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:17:23.060844 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 245/488] 10.222.0.18 () {56 vars in 1148 bytes} [Wed Oct 12 02:17:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 02:17:23.062525 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9aad69-d9d7-4d9e-9044-08d9ae2889fc None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:23.063025 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9aad69-d9d7-4d9e-9044-08d9ae2889fc None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:23.063507 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9aad69-d9d7-4d9e-9044-08d9ae2889fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:23.083179 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-9f9aad69-d9d7-4d9e-9044-08d9ae2889fc None None] MFA Rules not processed for user `a326a5bb7364479382f528a592371656`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:17:23.084812 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-9f9aad69-d9d7-4d9e-9044-08d9ae2889fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:17:23.139384 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c324ef01-e82c-434b-87cc-d73a99349437 None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:17:23.160537 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 246/489] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Oct 12 02:17:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 12 02:17:23.162161 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9aad69-d9d7-4d9e-9044-08d9ae2889fc None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:17:23.185809 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:17:23.192722 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fea0f7b-ecf4-428d-bfcc-9bc867d5c28a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:17:23.193736 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fea0f7b-ecf4-428d-bfcc-9bc867d5c28a None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:23.194152 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fea0f7b-ecf4-428d-bfcc-9bc867d5c28a None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:23.194639 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fea0f7b-ecf4-428d-bfcc-9bc867d5c28a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:23.195528 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fea0f7b-ecf4-428d-bfcc-9bc867d5c28a None admin] RBAC: Adding query filter params (role.id=91634b0ac542413bb04e5ce92e66459d, scope.project.id=beb6def6fcad45959e56425bb8bff4d1, user.id=8285a132afeb47558e1b3dcedfd7b4e7) {{(pid=81361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 02:17:23.196115 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fea0f7b-ecf4-428d-bfcc-9bc867d5c28a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:17:23.197928 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fea0f7b-ecf4-428d-bfcc-9bc867d5c28a None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:17:23.205796 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 244/490] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Oct 12 02:17:23 2022] GET /identity/v3/role_assignments?user.id=8285a132afeb47558e1b3dcedfd7b4e7&scope.project.id=beb6def6fcad45959e56425bb8bff4d1&role.id=91634b0ac542413bb04e5ce92e66459d => generated 608 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 02:17:23.206921 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fea0f7b-ecf4-428d-bfcc-9bc867d5c28a None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:17:23.263047 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:17:23.329905 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9aad69-d9d7-4d9e-9044-08d9ae2889fc None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:17:23.335396 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fea0f7b-ecf4-428d-bfcc-9bc867d5c28a None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:17:23.375874 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00630cc-7124-4ef9-8b9a-1cf5da4bbe11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:17:23.376848 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00630cc-7124-4ef9-8b9a-1cf5da4bbe11 None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:23.377263 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00630cc-7124-4ef9-8b9a-1cf5da4bbe11 None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:23.377661 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00630cc-7124-4ef9-8b9a-1cf5da4bbe11 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:23.378626 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fa7133-dbe1-4f29-ab91-a834e4975055 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:17:23.379352 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fa7133-dbe1-4f29-ab91-a834e4975055 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:23.380421 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fa7133-dbe1-4f29-ab91-a834e4975055 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:23.381189 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fa7133-dbe1-4f29-ab91-a834e4975055 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:23.382532 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fa7133-dbe1-4f29-ab91-a834e4975055 None admin] RBAC: Adding query filter params (role.id=91634b0ac542413bb04e5ce92e66459d, scope.project.id=beb6def6fcad45959e56425bb8bff4d1, user.id=5223b5cab3114e9b9a13c582f8ef8386) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 02:17:23.382949 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fa7133-dbe1-4f29-ab91-a834e4975055 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:17:23.384652 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fa7133-dbe1-4f29-ab91-a834e4975055 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:17:23.396577 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 247/491] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Oct 12 02:17:23 2022] GET /identity/v3/role_assignments?user.id=5223b5cab3114e9b9a13c582f8ef8386&scope.project.id=beb6def6fcad45959e56425bb8bff4d1&role.id=91634b0ac542413bb04e5ce92e66459d => generated 608 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 02:17:23.397477 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00630cc-7124-4ef9-8b9a-1cf5da4bbe11 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 02:17:23.403167 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application [None req-f00630cc-7124-4ef9-8b9a-1cf5da4bbe11 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 12 02:17:23.403167 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 02:17:23.403167 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 02:17:23.403167 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 02:17:23.403167 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 02:17:23.403167 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 02:17:23.403167 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 02:17:23.403167 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 02:17:23.403167 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 02:17:23.403167 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 02:17:23.403167 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 02:17:23.403167 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 02:17:23.403167 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 12 02:17:23.403167 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 12 02:17:23.403167 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 12 02:17:23.403167 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 12 02:17:23.404358 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 12 02:17:23.404358 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 12 02:17:23.404358 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 12 02:17:23.404358 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 12 02:17:23.404358 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 02:17:23.404358 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 02:17:23.404358 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 02:17:23.404358 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 02:17:23.404358 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 02:17:23.404358 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 02:17:23.404358 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 02:17:23.404358 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application with Lock( Oct 12 02:17:23.404358 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 02:17:23.404358 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._enter() Oct 12 02:17:23.404358 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 02:17:23.404358 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 02:17:23.405324 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 02:17:23.405324 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.creator() Oct 12 02:17:23.405324 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 02:17:23.405324 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application created_value = creator( Oct 12 02:17:23.405324 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 12 02:17:23.405324 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 12 02:17:23.405324 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 12 02:17:23.405324 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 12 02:17:23.405324 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 12 02:17:23.405324 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 12 02:17:23.405324 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 12 02:17:23.405324 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Oct 12 02:17:23.407618 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 245/492] 10.222.0.18 () {56 vars in 1096 bytes} [Wed Oct 12 02:17:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 02:17:23.413968 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fa7133-dbe1-4f29-ab91-a834e4975055 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:17:23.450753 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00630cc-7124-4ef9-8b9a-1cf5da4bbe11 None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:17:23.517803 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:17:23.550243 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fa7133-dbe1-4f29-ab91-a834e4975055 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:17:23.584991 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00630cc-7124-4ef9-8b9a-1cf5da4bbe11 None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:17:23.587128 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:17:23.592316 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c5cbf9-5e77-4e5b-a713-e51a8b3e8a8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:17:23.593105 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c5cbf9-5e77-4e5b-a713-e51a8b3e8a8b None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:23.593458 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c5cbf9-5e77-4e5b-a713-e51a8b3e8a8b None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:23.593799 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c5cbf9-5e77-4e5b-a713-e51a8b3e8a8b None admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:23.594554 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c5cbf9-5e77-4e5b-a713-e51a8b3e8a8b None admin] RBAC: Adding query filter params (name=admin) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 02:17:23.594930 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c5cbf9-5e77-4e5b-a713-e51a8b3e8a8b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:17:23.596381 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c5cbf9-5e77-4e5b-a713-e51a8b3e8a8b None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:17:23.607768 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 248/493] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Oct 12 02:17:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 02:17:23.614988 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c5cbf9-5e77-4e5b-a713-e51a8b3e8a8b None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:17:23.631208 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a93ce40-3544-467f-8a82-d6c082796dc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:17:23.632278 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a93ce40-3544-467f-8a82-d6c082796dc0 None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:23.632756 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a93ce40-3544-467f-8a82-d6c082796dc0 None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:23.633320 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a93ce40-3544-467f-8a82-d6c082796dc0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:23.647443 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a93ce40-3544-467f-8a82-d6c082796dc0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 02:17:23.654396 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application [None req-6a93ce40-3544-467f-8a82-d6c082796dc0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 12 02:17:23.654396 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 02:17:23.654396 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 02:17:23.654396 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 02:17:23.654396 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 02:17:23.654396 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 02:17:23.654396 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 02:17:23.654396 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 02:17:23.654396 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 02:17:23.654396 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 02:17:23.654396 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 02:17:23.654396 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 02:17:23.654396 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 12 02:17:23.654396 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 12 02:17:23.654396 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 12 02:17:23.654396 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 12 02:17:23.656097 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 12 02:17:23.656097 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 12 02:17:23.656097 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 12 02:17:23.656097 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 12 02:17:23.656097 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 02:17:23.656097 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 02:17:23.656097 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 02:17:23.656097 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 02:17:23.656097 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 02:17:23.656097 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 02:17:23.656097 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 02:17:23.656097 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application with Lock( Oct 12 02:17:23.656097 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 02:17:23.656097 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._enter() Oct 12 02:17:23.656097 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 02:17:23.656097 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 02:17:23.657566 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 02:17:23.657566 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.creator() Oct 12 02:17:23.657566 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 02:17:23.657566 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application created_value = creator( Oct 12 02:17:23.657566 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 12 02:17:23.657566 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 12 02:17:23.657566 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 12 02:17:23.657566 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 12 02:17:23.657566 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 12 02:17:23.657566 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 12 02:17:23.657566 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 12 02:17:23.657566 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Oct 12 02:17:23.657566 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 246/494] 10.222.0.18 () {56 vars in 1102 bytes} [Wed Oct 12 02:17:23 2022] GET /identity/v3/roles/service => generated 85 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 02:17:23.661896 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a93ce40-3544-467f-8a82-d6c082796dc0 None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:17:23.751558 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c5cbf9-5e77-4e5b-a713-e51a8b3e8a8b None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:17:23.793274 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c1825a-b098-4ff0-b6ec-683aa526b019 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:17:23.793963 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c1825a-b098-4ff0-b6ec-683aa526b019 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:23.794394 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c1825a-b098-4ff0-b6ec-683aa526b019 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:23.794765 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c1825a-b098-4ff0-b6ec-683aa526b019 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:23.804967 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:17:23.807662 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c1825a-b098-4ff0-b6ec-683aa526b019 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:17:23.809353 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c1825a-b098-4ff0-b6ec-683aa526b019 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:17:23.813270 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a93ce40-3544-467f-8a82-d6c082796dc0 None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:17:23.824953 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-11c1825a-b098-4ff0-b6ec-683aa526b019 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 02:17:23.824953 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 02:17:23.824953 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 02:17:23.824953 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 02:17:23.824953 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 02:17:23.824953 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 02:17:23.824953 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 02:17:23.824953 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 02:17:23.824953 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 02:17:23.824953 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 02:17:23.824953 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 02:17:23.824953 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 02:17:23.824953 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 12 02:17:23.824953 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 12 02:17:23.824953 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 12 02:17:23.824953 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 12 02:17:23.826524 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 02:17:23.826524 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 02:17:23.826524 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 02:17:23.826524 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 02:17:23.826524 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 02:17:23.826524 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 02:17:23.826524 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 02:17:23.826524 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Oct 12 02:17:23.826524 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 02:17:23.826524 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Oct 12 02:17:23.826524 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 02:17:23.826524 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 02:17:23.826524 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 02:17:23.826524 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Oct 12 02:17:23.826524 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 02:17:23.826524 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Oct 12 02:17:23.826524 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 12 02:17:23.827577 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 12 02:17:23.827577 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 02:17:23.827577 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Oct 12 02:17:23.833299 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 249/495] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Oct 12 02:17:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 12 02:17:23.834873 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c1825a-b098-4ff0-b6ec-683aa526b019 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:17:23.885203 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574deb03-33dc-4e5c-8530-a02b2e9a33b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:17:23.885937 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574deb03-33dc-4e5c-8530-a02b2e9a33b6 None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:23.886217 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574deb03-33dc-4e5c-8530-a02b2e9a33b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:23.886487 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574deb03-33dc-4e5c-8530-a02b2e9a33b6 None admin] PATH_INFO: `/v3/roles` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:23.887156 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574deb03-33dc-4e5c-8530-a02b2e9a33b6 None admin] RBAC: Adding query filter params (name=service) {{(pid=81361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 02:17:23.887457 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574deb03-33dc-4e5c-8530-a02b2e9a33b6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:17:23.888973 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574deb03-33dc-4e5c-8530-a02b2e9a33b6 None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:17:23.908096 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 247/496] 10.222.0.18 () {56 vars in 1103 bytes} [Wed Oct 12 02:17:23 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 02:17:23.913952 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574deb03-33dc-4e5c-8530-a02b2e9a33b6 None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:17:23.943431 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c1825a-b098-4ff0-b6ec-683aa526b019 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:17:23.982454 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:17:23.987891 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c39fc3-1702-43d3-a76a-153112d258d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:17:23.988528 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c39fc3-1702-43d3-a76a-153112d258d6 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:23.988808 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c39fc3-1702-43d3-a76a-153112d258d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:23.989608 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c39fc3-1702-43d3-a76a-153112d258d6 None admin] PATH_INFO: `/v3/domains` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:23.990272 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c39fc3-1702-43d3-a76a-153112d258d6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 02:17:23.990574 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c39fc3-1702-43d3-a76a-153112d258d6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:17:23.992215 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c39fc3-1702-43d3-a76a-153112d258d6 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:17:24.022560 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 250/497] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Oct 12 02:17:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 02:17:24.028074 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c39fc3-1702-43d3-a76a-153112d258d6 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:17:24.087170 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574deb03-33dc-4e5c-8530-a02b2e9a33b6 None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:17:24.127649 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2ed1b0-5051-4f12-a1f9-a3b7ddc3547f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:17:24.128389 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2ed1b0-5051-4f12-a1f9-a3b7ddc3547f None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:24.128699 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2ed1b0-5051-4f12-a1f9-a3b7ddc3547f None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:24.129011 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2ed1b0-5051-4f12-a1f9-a3b7ddc3547f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:24.142756 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2ed1b0-5051-4f12-a1f9-a3b7ddc3547f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:17:24.144684 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2ed1b0-5051-4f12-a1f9-a3b7ddc3547f None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:17:24.161382 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application [None req-4e2ed1b0-5051-4f12-a1f9-a3b7ddc3547f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 02:17:24.161382 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 02:17:24.161382 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 02:17:24.161382 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 02:17:24.161382 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 02:17:24.161382 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 02:17:24.161382 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 02:17:24.161382 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 02:17:24.161382 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 02:17:24.161382 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 02:17:24.161382 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 02:17:24.161382 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 02:17:24.161382 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 12 02:17:24.161382 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 12 02:17:24.161382 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 12 02:17:24.161382 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 12 02:17:24.162405 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 02:17:24.162405 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 02:17:24.162405 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 02:17:24.162405 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 02:17:24.162405 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 02:17:24.162405 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 02:17:24.162405 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 02:17:24.162405 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application with Lock( Oct 12 02:17:24.162405 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 02:17:24.162405 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._enter() Oct 12 02:17:24.162405 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 02:17:24.162405 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 02:17:24.162405 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 02:17:24.162405 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.creator() Oct 12 02:17:24.162405 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 02:17:24.162405 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application created_value = creator( Oct 12 02:17:24.162405 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 12 02:17:24.163745 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 12 02:17:24.163745 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 02:17:24.163745 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Oct 12 02:17:24.163745 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 248/498] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Oct 12 02:17:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 12 02:17:24.169257 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2ed1b0-5051-4f12-a1f9-a3b7ddc3547f None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:17:24.172200 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:17:24.266106 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c39fc3-1702-43d3-a76a-153112d258d6 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:17:24.326655 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:17:24.341866 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75978dfc-78eb-477d-96e9-01d11dea45d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:17:24.342425 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75978dfc-78eb-477d-96e9-01d11dea45d8 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:24.342704 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75978dfc-78eb-477d-96e9-01d11dea45d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:24.342974 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75978dfc-78eb-477d-96e9-01d11dea45d8 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:24.356180 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75978dfc-78eb-477d-96e9-01d11dea45d8 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:17:24.357667 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75978dfc-78eb-477d-96e9-01d11dea45d8 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:17:24.376129 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2ed1b0-5051-4f12-a1f9-a3b7ddc3547f None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:17:24.382915 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-75978dfc-78eb-477d-96e9-01d11dea45d8 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 12 02:17:24.382915 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 02:17:24.382915 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 02:17:24.382915 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 02:17:24.382915 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 02:17:24.382915 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 02:17:24.382915 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 02:17:24.382915 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 02:17:24.382915 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 02:17:24.382915 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 02:17:24.382915 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 02:17:24.382915 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 02:17:24.382915 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 12 02:17:24.382915 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 12 02:17:24.382915 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 12 02:17:24.382915 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 12 02:17:24.385212 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 02:17:24.385212 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 02:17:24.385212 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 12 02:17:24.385212 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 12 02:17:24.385212 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 12 02:17:24.385212 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 12 02:17:24.385212 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 02:17:24.385212 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 02:17:24.385212 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 02:17:24.385212 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 02:17:24.385212 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 02:17:24.385212 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Oct 12 02:17:24.385212 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 02:17:24.385212 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Oct 12 02:17:24.385212 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 02:17:24.385212 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 02:17:24.385212 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 02:17:24.385212 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Oct 12 02:17:24.386987 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 02:17:24.386987 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Oct 12 02:17:24.386987 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 12 02:17:24.386987 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 12 02:17:24.386987 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 12 02:17:24.386987 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 12 02:17:24.386987 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 12 02:17:24.386987 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 12 02:17:24.386987 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 12 02:17:24.386987 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Oct 12 02:17:24.386987 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 251/499] 10.222.0.18 () {56 vars in 1093 bytes} [Wed Oct 12 02:17:24 2022] GET /identity/v3/users/nova => generated 82 bytes in 357 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 02:17:24.392411 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75978dfc-78eb-477d-96e9-01d11dea45d8 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:17:24.433672 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7884c83b-083f-40f8-b905-11bea9ba5f68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:17:24.434379 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7884c83b-083f-40f8-b905-11bea9ba5f68 None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:24.434659 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7884c83b-083f-40f8-b905-11bea9ba5f68 None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:24.434927 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7884c83b-083f-40f8-b905-11bea9ba5f68 None admin] PATH_INFO: `/v3/domains` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:24.435578 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7884c83b-083f-40f8-b905-11bea9ba5f68 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 02:17:24.435873 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7884c83b-083f-40f8-b905-11bea9ba5f68 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:17:24.437421 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7884c83b-083f-40f8-b905-11bea9ba5f68 None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:17:24.464752 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 249/500] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Oct 12 02:17:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 02:17:24.470161 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7884c83b-083f-40f8-b905-11bea9ba5f68 None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:17:24.511763 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75978dfc-78eb-477d-96e9-01d11dea45d8 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:17:24.531989 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:17:24.577157 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd4e970-36ea-4997-8a5b-5c5608cec56e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:17:24.577749 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd4e970-36ea-4997-8a5b-5c5608cec56e None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:24.578028 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd4e970-36ea-4997-8a5b-5c5608cec56e None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:24.578303 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd4e970-36ea-4997-8a5b-5c5608cec56e None admin] PATH_INFO: `/v3/users` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:24.579065 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd4e970-36ea-4997-8a5b-5c5608cec56e None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 02:17:24.579370 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd4e970-36ea-4997-8a5b-5c5608cec56e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:17:24.580867 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd4e970-36ea-4997-8a5b-5c5608cec56e None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:17:24.620440 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 252/501] 10.222.0.18 () {56 vars in 1133 bytes} [Wed Oct 12 02:17:24 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 02:17:24.626435 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd4e970-36ea-4997-8a5b-5c5608cec56e None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:17:24.688738 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7884c83b-083f-40f8-b905-11bea9ba5f68 None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:17:24.735168 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f1ebf1-0698-47f6-be38-4fe8e6c6231a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:17:24.736267 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f1ebf1-0698-47f6-be38-4fe8e6c6231a None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:24.736580 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f1ebf1-0698-47f6-be38-4fe8e6c6231a None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:24.736860 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f1ebf1-0698-47f6-be38-4fe8e6c6231a None admin] PATH_INFO: `/v3/users/swift` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:24.740510 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:17:24.746936 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f1ebf1-0698-47f6-be38-4fe8e6c6231a None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:17:24.748946 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f1ebf1-0698-47f6-be38-4fe8e6c6231a None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:17:24.762875 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application [None req-b8f1ebf1-0698-47f6-be38-4fe8e6c6231a None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 12 02:17:24.762875 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 02:17:24.762875 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 02:17:24.762875 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 02:17:24.762875 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 02:17:24.762875 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 02:17:24.762875 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 02:17:24.762875 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 02:17:24.762875 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 02:17:24.762875 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 02:17:24.762875 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 02:17:24.762875 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 02:17:24.762875 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 12 02:17:24.762875 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 12 02:17:24.762875 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 12 02:17:24.762875 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 12 02:17:24.763933 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 02:17:24.763933 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 02:17:24.763933 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 12 02:17:24.763933 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 12 02:17:24.763933 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 12 02:17:24.763933 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 12 02:17:24.763933 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 02:17:24.763933 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 02:17:24.763933 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 02:17:24.763933 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 02:17:24.763933 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 02:17:24.763933 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application with Lock( Oct 12 02:17:24.763933 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 02:17:24.763933 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._enter() Oct 12 02:17:24.763933 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 02:17:24.763933 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 02:17:24.763933 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 02:17:24.763933 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.creator() Oct 12 02:17:24.765183 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 02:17:24.765183 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application created_value = creator( Oct 12 02:17:24.765183 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 12 02:17:24.765183 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 12 02:17:24.765183 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 12 02:17:24.765183 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 12 02:17:24.765183 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 12 02:17:24.765183 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 12 02:17:24.765183 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Oct 12 02:17:24.765183 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Oct 12 02:17:24.765183 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 250/502] 10.222.0.18 () {56 vars in 1096 bytes} [Wed Oct 12 02:17:24 2022] GET /identity/v3/users/swift => generated 83 bytes in 294 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 12 02:17:24.771880 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f1ebf1-0698-47f6-be38-4fe8e6c6231a None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:17:24.801735 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd4e970-36ea-4997-8a5b-5c5608cec56e None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:17:24.836943 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce0836e-1f92-478f-841b-f9513e073fcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:17:24.838372 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce0836e-1f92-478f-841b-f9513e073fcc None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:24.838865 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce0836e-1f92-478f-841b-f9513e073fcc None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:24.839385 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce0836e-1f92-478f-841b-f9513e073fcc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:24.850411 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce0836e-1f92-478f-841b-f9513e073fcc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:17:24.852099 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce0836e-1f92-478f-841b-f9513e073fcc None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:17:24.867512 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-0ce0836e-1f92-478f-841b-f9513e073fcc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 02:17:24.867512 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 02:17:24.867512 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 02:17:24.867512 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 02:17:24.867512 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 02:17:24.867512 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 02:17:24.867512 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 02:17:24.867512 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 02:17:24.867512 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 02:17:24.867512 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 02:17:24.867512 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 02:17:24.867512 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 02:17:24.867512 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 12 02:17:24.867512 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 12 02:17:24.867512 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 12 02:17:24.867512 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 12 02:17:24.868514 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 02:17:24.868514 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 02:17:24.868514 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 02:17:24.868514 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 02:17:24.868514 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 02:17:24.868514 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 02:17:24.868514 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 02:17:24.868514 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Oct 12 02:17:24.868514 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 02:17:24.868514 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Oct 12 02:17:24.868514 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 02:17:24.868514 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 02:17:24.868514 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 02:17:24.868514 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Oct 12 02:17:24.868514 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 02:17:24.868514 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Oct 12 02:17:24.868514 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 12 02:17:24.869471 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 12 02:17:24.869471 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 02:17:24.869471 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Oct 12 02:17:24.871641 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 253/503] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Oct 12 02:17:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 02:17:24.877338 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce0836e-1f92-478f-841b-f9513e073fcc None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:17:24.928086 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:17:24.983858 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce0836e-1f92-478f-841b-f9513e073fcc None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:17:25.019524 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60ddfcd-5eb6-4799-badc-f0a77ba4907a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:17:25.021127 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60ddfcd-5eb6-4799-badc-f0a77ba4907a None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:25.021811 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60ddfcd-5eb6-4799-badc-f0a77ba4907a None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:25.022278 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60ddfcd-5eb6-4799-badc-f0a77ba4907a None admin] PATH_INFO: `/v3/domains` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:25.023133 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60ddfcd-5eb6-4799-badc-f0a77ba4907a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 02:17:25.023626 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60ddfcd-5eb6-4799-badc-f0a77ba4907a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:17:25.025223 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60ddfcd-5eb6-4799-badc-f0a77ba4907a None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:17:25.037748 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 254/504] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Oct 12 02:17:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 02:17:25.038624 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f1ebf1-0698-47f6-be38-4fe8e6c6231a None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:17:25.044921 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60ddfcd-5eb6-4799-badc-f0a77ba4907a None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:17:25.100750 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6604999-719c-4771-9aac-bbbb0c00728e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:17:25.101363 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6604999-719c-4771-9aac-bbbb0c00728e None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:25.101644 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6604999-719c-4771-9aac-bbbb0c00728e None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:25.101918 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6604999-719c-4771-9aac-bbbb0c00728e None admin] PATH_INFO: `/v3/users` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:25.102642 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6604999-719c-4771-9aac-bbbb0c00728e None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 02:17:25.102947 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6604999-719c-4771-9aac-bbbb0c00728e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:17:25.104379 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6604999-719c-4771-9aac-bbbb0c00728e None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:17:25.138908 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 251/505] 10.222.0.18 () {56 vars in 1135 bytes} [Wed Oct 12 02:17:24 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 367 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 02:17:25.142137 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6604999-719c-4771-9aac-bbbb0c00728e None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:17:25.196842 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:17:25.215220 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60ddfcd-5eb6-4799-badc-f0a77ba4907a None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:17:25.234946 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:17:25.256375 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7170b3f7-76b5-45ae-a8ef-032c728e6b55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:17:25.257299 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7170b3f7-76b5-45ae-a8ef-032c728e6b55 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:25.257772 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7170b3f7-76b5-45ae-a8ef-032c728e6b55 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:25.258216 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7170b3f7-76b5-45ae-a8ef-032c728e6b55 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:25.266334 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7170b3f7-76b5-45ae-a8ef-032c728e6b55 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:17:25.267986 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7170b3f7-76b5-45ae-a8ef-032c728e6b55 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:17:25.280618 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-7170b3f7-76b5-45ae-a8ef-032c728e6b55 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 12 02:17:25.280618 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 02:17:25.280618 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 02:17:25.280618 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 02:17:25.280618 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 02:17:25.280618 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 02:17:25.280618 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 02:17:25.280618 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 02:17:25.280618 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 02:17:25.280618 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 02:17:25.280618 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 02:17:25.280618 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 02:17:25.280618 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 12 02:17:25.280618 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 12 02:17:25.280618 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 12 02:17:25.281535 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 12 02:17:25.281535 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 02:17:25.281535 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 02:17:25.281535 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 02:17:25.281535 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 02:17:25.281535 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 02:17:25.281535 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 02:17:25.281535 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 02:17:25.281535 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Oct 12 02:17:25.281535 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 02:17:25.281535 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Oct 12 02:17:25.281535 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 02:17:25.281535 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 02:17:25.281535 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 02:17:25.281535 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Oct 12 02:17:25.281535 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 02:17:25.281535 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Oct 12 02:17:25.282421 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 12 02:17:25.282421 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 12 02:17:25.282421 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 12 02:17:25.282421 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 12 02:17:25.282421 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 12 02:17:25.282421 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 12 02:17:25.282421 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 12 02:17:25.282421 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Oct 12 02:17:25.285750 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 255/506] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Oct 12 02:17:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 02:17:25.293887 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7170b3f7-76b5-45ae-a8ef-032c728e6b55 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:17:25.347731 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6604999-719c-4771-9aac-bbbb0c00728e None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:17:25.413644 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41acced4-0f48-4b06-b27b-3eb56fba69f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:17:25.414177 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41acced4-0f48-4b06-b27b-3eb56fba69f3 None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:25.414454 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41acced4-0f48-4b06-b27b-3eb56fba69f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:25.414724 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41acced4-0f48-4b06-b27b-3eb56fba69f3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:25.448839 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7170b3f7-76b5-45ae-a8ef-032c728e6b55 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:17:25.494587 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d1866e-9366-459f-ad53-f2cf8dffa50a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:17:25.495555 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d1866e-9366-459f-ad53-f2cf8dffa50a None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:25.496146 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d1866e-9366-459f-ad53-f2cf8dffa50a None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:25.496681 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d1866e-9366-459f-ad53-f2cf8dffa50a None admin] PATH_INFO: `/v3/projects` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:25.497639 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d1866e-9366-459f-ad53-f2cf8dffa50a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 02:17:25.498893 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d1866e-9366-459f-ad53-f2cf8dffa50a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:17:25.501214 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d1866e-9366-459f-ad53-f2cf8dffa50a None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:17:25.529205 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 256/507] 10.222.0.18 () {56 vars in 1148 bytes} [Wed Oct 12 02:17:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 02:17:25.535210 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d1866e-9366-459f-ad53-f2cf8dffa50a None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:17:25.538807 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:17:25.547172 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41acced4-0f48-4b06-b27b-3eb56fba69f3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:17:25.548853 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41acced4-0f48-4b06-b27b-3eb56fba69f3 None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:17:25.683946 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d1866e-9366-459f-ad53-f2cf8dffa50a None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:17:25.690295 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:17:25.726832 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4baad71e-fe9a-4f8a-8f10-3666e15ba8db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:17:25.727750 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4baad71e-fe9a-4f8a-8f10-3666e15ba8db None admin] REQUEST_METHOD: `PUT` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:25.728173 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4baad71e-fe9a-4f8a-8f10-3666e15ba8db None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:25.728649 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4baad71e-fe9a-4f8a-8f10-3666e15ba8db None admin] PATH_INFO: `/v3/projects/beb6def6fcad45959e56425bb8bff4d1/users/f2fca96c111b45b795fb757f77908ff1/roles/39b1e8108dff402383def3c559f48189` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:25.730722 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4baad71e-fe9a-4f8a-8f10-3666e15ba8db None admin] RBAC: Authorizing `identity:create_grant(project_id=beb6def6fcad45959e56425bb8bff4d1, user_id=f2fca96c111b45b795fb757f77908ff1, role_id=39b1e8108dff402383def3c559f48189)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:17:25.732293 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4baad71e-fe9a-4f8a-8f10-3666e15ba8db None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:17:25.762154 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 257/508] 10.222.0.18 () {58 vars in 1439 bytes} [Wed Oct 12 02:17:25 2022] PUT /identity/v3/projects/beb6def6fcad45959e56425bb8bff4d1/users/f2fca96c111b45b795fb757f77908ff1/roles/39b1e8108dff402383def3c559f48189 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 02:17:25.772420 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0068e8fd-d389-4fc9-8fe3-e307ee55ef26 None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:25.772778 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0068e8fd-d389-4fc9-8fe3-e307ee55ef26 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:25.773020 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0068e8fd-d389-4fc9-8fe3-e307ee55ef26 None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:25.777064 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 258/509] 10.222.0.18 () {54 vars in 927 bytes} [Wed Oct 12 02:17:25 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 12 02:17:25.783836 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0327478-93a6-4e97-be5b-d077da3189b5 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:25.784161 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0327478-93a6-4e97-be5b-d077da3189b5 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:25.784387 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0327478-93a6-4e97-be5b-d077da3189b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:25.794991 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 252/510] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Oct 12 02:17:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 653 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 12 02:17:25.807980 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41acced4-0f48-4b06-b27b-3eb56fba69f3 None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:17:25.816057 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-a0327478-93a6-4e97-be5b-d077da3189b5 None None] MFA Rules not processed for user `a326a5bb7364479382f528a592371656`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:17:25.818042 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-a0327478-93a6-4e97-be5b-d077da3189b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:17:25.901197 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:17:25.925744 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 259/511] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Oct 12 02:17:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 12 02:17:25.992586 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41acced4-0f48-4b06-b27b-3eb56fba69f3 None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:17:26.020496 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ab126a-23e2-463b-ab70-d150d9264da5 None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:26.020812 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ab126a-23e2-463b-ab70-d150d9264da5 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:26.021049 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ab126a-23e2-463b-ab70-d150d9264da5 None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:26.023745 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 260/512] 10.222.0.18 () {54 vars in 927 bytes} [Wed Oct 12 02:17:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 12 02:17:26.027813 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec1bb84-0c54-4ae6-8d24-ad8286a43159 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:26.028091 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec1bb84-0c54-4ae6-8d24-ad8286a43159 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:26.028363 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec1bb84-0c54-4ae6-8d24-ad8286a43159 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:26.029430 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc9677c-ee41-45b3-8b89-5cdf07fedb7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:17:26.030060 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc9677c-ee41-45b3-8b89-5cdf07fedb7e None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:26.030334 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc9677c-ee41-45b3-8b89-5cdf07fedb7e None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:26.030602 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc9677c-ee41-45b3-8b89-5cdf07fedb7e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:26.041719 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc9677c-ee41-45b3-8b89-5cdf07fedb7e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:17:26.043210 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc9677c-ee41-45b3-8b89-5cdf07fedb7e None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:17:26.050168 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-2ec1bb84-0c54-4ae6-8d24-ad8286a43159 None None] MFA Rules not processed for user `a326a5bb7364479382f528a592371656`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:17:26.052161 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-2ec1bb84-0c54-4ae6-8d24-ad8286a43159 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:17:26.060664 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application [None req-3fc9677c-ee41-45b3-8b89-5cdf07fedb7e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 02:17:26.060664 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 02:17:26.060664 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 02:17:26.060664 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 02:17:26.060664 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 02:17:26.060664 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 02:17:26.060664 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 02:17:26.060664 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 02:17:26.060664 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 02:17:26.060664 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 02:17:26.060664 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 02:17:26.060664 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 02:17:26.060664 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 12 02:17:26.060664 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 12 02:17:26.060664 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 12 02:17:26.060664 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 12 02:17:26.061649 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 02:17:26.061649 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 02:17:26.061649 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 02:17:26.061649 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 02:17:26.061649 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 02:17:26.061649 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 02:17:26.061649 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 02:17:26.061649 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application with Lock( Oct 12 02:17:26.061649 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 02:17:26.061649 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._enter() Oct 12 02:17:26.061649 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 02:17:26.061649 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 02:17:26.061649 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 02:17:26.061649 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.creator() Oct 12 02:17:26.061649 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 02:17:26.061649 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application created_value = creator( Oct 12 02:17:26.061649 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 12 02:17:26.062539 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 12 02:17:26.062539 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 02:17:26.062539 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Oct 12 02:17:26.062539 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 253/513] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Oct 12 02:17:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 02:17:26.063117 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006d4470-6ebe-4962-9349-27b5416f4d70 None None] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:26.063214 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006d4470-6ebe-4962-9349-27b5416f4d70 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:26.063437 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006d4470-6ebe-4962-9349-27b5416f4d70 None None] PATH_INFO: `/` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:26.069012 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 254/514] 10.222.0.18 () {54 vars in 927 bytes} [Wed Oct 12 02:17:26 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 02:17:26.071215 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006d4470-6ebe-4962-9349-27b5416f4d70 None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:17:26.080862 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:17:26.149785 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 261/515] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Oct 12 02:17:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 12 02:17:26.156054 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07084f73-d609-439f-a4eb-bc42b7c626fa None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:26.156565 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07084f73-d609-439f-a4eb-bc42b7c626fa None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:26.157014 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07084f73-d609-439f-a4eb-bc42b7c626fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:26.185685 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-07084f73-d609-439f-a4eb-bc42b7c626fa None None] MFA Rules not processed for user `a326a5bb7364479382f528a592371656`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:17:26.188113 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-07084f73-d609-439f-a4eb-bc42b7c626fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:17:26.207074 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006d4470-6ebe-4962-9349-27b5416f4d70 None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:17:26.249442 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394db878-3c10-47b2-b022-287770ef0264 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:17:26.250012 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394db878-3c10-47b2-b022-287770ef0264 None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:26.250298 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394db878-3c10-47b2-b022-287770ef0264 None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:26.250567 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394db878-3c10-47b2-b022-287770ef0264 None admin] PATH_INFO: `/v3/domains` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:26.251525 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394db878-3c10-47b2-b022-287770ef0264 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 02:17:26.251635 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394db878-3c10-47b2-b022-287770ef0264 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:17:26.253171 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394db878-3c10-47b2-b022-287770ef0264 None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:17:26.265641 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 255/516] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Oct 12 02:17:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 02:17:26.266684 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394db878-3c10-47b2-b022-287770ef0264 None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:17:26.278589 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 262/517] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Oct 12 02:17:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 12 02:17:26.279886 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07084f73-d609-439f-a4eb-bc42b7c626fa None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:17:26.336403 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:17:26.339798 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:17:26.388010 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07084f73-d609-439f-a4eb-bc42b7c626fa None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:17:26.404299 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394db878-3c10-47b2-b022-287770ef0264 None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:17:26.427395 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b161b6-2434-45ca-955c-321f9aa9f4f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:17:26.428028 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b161b6-2434-45ca-955c-321f9aa9f4f0 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:26.428298 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b161b6-2434-45ca-955c-321f9aa9f4f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:26.428590 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b161b6-2434-45ca-955c-321f9aa9f4f0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:26.438844 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b161b6-2434-45ca-955c-321f9aa9f4f0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:17:26.440290 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b161b6-2434-45ca-955c-321f9aa9f4f0 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:17:26.461635 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-b7b161b6-2434-45ca-955c-321f9aa9f4f0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 12 02:17:26.461635 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 02:17:26.461635 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 02:17:26.461635 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 02:17:26.461635 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 02:17:26.461635 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 02:17:26.461635 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 02:17:26.461635 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 02:17:26.461635 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 02:17:26.461635 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 02:17:26.461635 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 02:17:26.461635 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 02:17:26.461635 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 12 02:17:26.461635 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 12 02:17:26.461635 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 12 02:17:26.462591 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 12 02:17:26.462591 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 02:17:26.462591 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 02:17:26.462591 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 02:17:26.462591 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 02:17:26.462591 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 02:17:26.462591 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 02:17:26.462591 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 02:17:26.462591 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Oct 12 02:17:26.462591 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 02:17:26.462591 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Oct 12 02:17:26.462591 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 02:17:26.462591 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 02:17:26.462591 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 02:17:26.462591 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Oct 12 02:17:26.462591 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 02:17:26.462591 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Oct 12 02:17:26.463499 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 12 02:17:26.463499 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 12 02:17:26.463499 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 12 02:17:26.463499 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 12 02:17:26.463499 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 12 02:17:26.463499 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 12 02:17:26.463499 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 12 02:17:26.463499 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Oct 12 02:17:26.464394 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 263/518] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Oct 12 02:17:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 02:17:26.470226 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b161b6-2434-45ca-955c-321f9aa9f4f0 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:17:26.476848 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cdd14b-1025-47c8-8345-b7ab37bec7a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:17:26.477495 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cdd14b-1025-47c8-8345-b7ab37bec7a6 None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:26.477771 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cdd14b-1025-47c8-8345-b7ab37bec7a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:26.478090 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cdd14b-1025-47c8-8345-b7ab37bec7a6 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:26.478675 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1cdd14b-1025-47c8-8345-b7ab37bec7a6 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:17:26.480142 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1cdd14b-1025-47c8-8345-b7ab37bec7a6 None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:17:26.495462 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application [None req-a1cdd14b-1025-47c8-8345-b7ab37bec7a6 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 12 02:17:26.495462 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 02:17:26.495462 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 12 02:17:26.495462 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 12 02:17:26.495462 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 12 02:17:26.495462 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 12 02:17:26.495462 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 12 02:17:26.495462 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 12 02:17:26.495462 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 12 02:17:26.495462 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Oct 12 02:17:26.495462 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 12 02:17:26.495462 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Oct 12 02:17:26.495462 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 02:17:26.495462 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 02:17:26.495462 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 02:17:26.495462 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 02:17:26.495462 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 02:17:26.496554 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 02:17:26.496554 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 02:17:26.496554 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 02:17:26.496554 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 02:17:26.496554 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 02:17:26.496554 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 02:17:26.496554 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 12 02:17:26.496554 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 12 02:17:26.496554 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 12 02:17:26.496554 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 12 02:17:26.496554 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 02:17:26.496554 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 02:17:26.496554 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 02:17:26.496554 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 02:17:26.496554 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 02:17:26.496554 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 02:17:26.497425 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 02:17:26.497425 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application with Lock( Oct 12 02:17:26.497425 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 02:17:26.497425 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._enter() Oct 12 02:17:26.497425 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 02:17:26.497425 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 02:17:26.497425 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 02:17:26.497425 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.creator() Oct 12 02:17:26.497425 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 02:17:26.497425 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application created_value = creator( Oct 12 02:17:26.497425 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 12 02:17:26.497425 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 12 02:17:26.497425 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 12 02:17:26.497425 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Oct 12 02:17:26.497425 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 256/519] 10.222.0.18 () {56 vars in 1129 bytes} [Wed Oct 12 02:17:26 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 02:17:26.498249 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cdd14b-1025-47c8-8345-b7ab37bec7a6 None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:17:26.592525 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b161b6-2434-45ca-955c-321f9aa9f4f0 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:17:26.609895 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:17:26.612660 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cdd14b-1025-47c8-8345-b7ab37bec7a6 None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:17:26.638147 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2652fc93-b1d6-4946-8713-da88fff78c60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:17:26.639352 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2652fc93-b1d6-4946-8713-da88fff78c60 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:26.640230 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2652fc93-b1d6-4946-8713-da88fff78c60 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:26.640965 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2652fc93-b1d6-4946-8713-da88fff78c60 None admin] PATH_INFO: `/v3/projects` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:26.642255 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:17:26.642559 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2652fc93-b1d6-4946-8713-da88fff78c60 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 02:17:26.643682 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2652fc93-b1d6-4946-8713-da88fff78c60 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:17:26.646351 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2652fc93-b1d6-4946-8713-da88fff78c60 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:17:26.649030 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab2baa5-c088-4ea1-ae0e-891c31f769fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:17:26.649658 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab2baa5-c088-4ea1-ae0e-891c31f769fa None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:26.649947 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab2baa5-c088-4ea1-ae0e-891c31f769fa None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:26.650384 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab2baa5-c088-4ea1-ae0e-891c31f769fa None admin] PATH_INFO: `/v3/services/network` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:26.650771 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab2baa5-c088-4ea1-ae0e-891c31f769fa None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:17:26.652126 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab2baa5-c088-4ea1-ae0e-891c31f769fa None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:17:26.661399 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 264/520] 10.222.0.18 () {56 vars in 1148 bytes} [Wed Oct 12 02:17:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 02:17:26.661981 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application [None req-fab2baa5-c088-4ea1-ae0e-891c31f769fa None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Oct 12 02:17:26.661981 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 02:17:26.661981 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 12 02:17:26.661981 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 12 02:17:26.661981 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 12 02:17:26.661981 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 12 02:17:26.661981 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 12 02:17:26.661981 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 12 02:17:26.661981 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 12 02:17:26.661981 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Oct 12 02:17:26.661981 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 12 02:17:26.661981 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Oct 12 02:17:26.661981 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 02:17:26.661981 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 02:17:26.661981 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 02:17:26.661981 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 02:17:26.661981 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 02:17:26.662944 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 02:17:26.662944 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 02:17:26.662944 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 02:17:26.662944 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 02:17:26.662944 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 02:17:26.662944 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 02:17:26.662944 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 12 02:17:26.662944 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 12 02:17:26.662944 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 12 02:17:26.662944 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 12 02:17:26.662944 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 02:17:26.662944 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 02:17:26.662944 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 02:17:26.662944 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 02:17:26.662944 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 02:17:26.662944 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 02:17:26.668313 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 02:17:26.668313 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application with Lock( Oct 12 02:17:26.668313 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 02:17:26.668313 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._enter() Oct 12 02:17:26.668313 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 02:17:26.668313 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 02:17:26.668313 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 02:17:26.668313 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.creator() Oct 12 02:17:26.668313 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 02:17:26.668313 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application created_value = creator( Oct 12 02:17:26.668313 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 12 02:17:26.668313 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 12 02:17:26.668313 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 12 02:17:26.668313 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Oct 12 02:17:26.668313 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 257/521] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Oct 12 02:17:26 2022] GET /identity/v3/services/network => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 02:17:26.669156 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab2baa5-c088-4ea1-ae0e-891c31f769fa None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:17:26.669226 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2652fc93-b1d6-4946-8713-da88fff78c60 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:17:26.771907 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab2baa5-c088-4ea1-ae0e-891c31f769fa None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:17:26.775389 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2652fc93-b1d6-4946-8713-da88fff78c60 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:17:26.807468 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af317dd2-8101-4948-b275-e5f608d71d44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:17:26.808012 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af317dd2-8101-4948-b275-e5f608d71d44 None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:26.808287 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af317dd2-8101-4948-b275-e5f608d71d44 None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:26.808588 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af317dd2-8101-4948-b275-e5f608d71d44 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:26.810752 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f08c990-666c-47e2-8b16-f52d29dfe421 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:17:26.811675 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f08c990-666c-47e2-8b16-f52d29dfe421 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:26.811956 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f08c990-666c-47e2-8b16-f52d29dfe421 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:26.812236 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f08c990-666c-47e2-8b16-f52d29dfe421 None admin] PATH_INFO: `/v3/services` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:26.812883 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f08c990-666c-47e2-8b16-f52d29dfe421 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 02:17:26.813188 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f08c990-666c-47e2-8b16-f52d29dfe421 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:17:26.814544 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f08c990-666c-47e2-8b16-f52d29dfe421 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:17:26.819761 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 265/522] 10.222.0.18 () {56 vars in 1124 bytes} [Wed Oct 12 02:17:26 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 02:17:26.820185 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af317dd2-8101-4948-b275-e5f608d71d44 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:17:26.820568 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f08c990-666c-47e2-8b16-f52d29dfe421 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:17:26.822287 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af317dd2-8101-4948-b275-e5f608d71d44 None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:17:26.838832 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application [None req-af317dd2-8101-4948-b275-e5f608d71d44 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 02:17:26.838832 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 02:17:26.838832 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 02:17:26.838832 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 02:17:26.838832 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 02:17:26.838832 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 02:17:26.838832 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 02:17:26.838832 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 02:17:26.838832 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 02:17:26.838832 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 02:17:26.838832 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 02:17:26.838832 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 02:17:26.838832 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 12 02:17:26.838832 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 12 02:17:26.838832 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 12 02:17:26.838832 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 12 02:17:26.839833 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 02:17:26.839833 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 02:17:26.839833 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 02:17:26.839833 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 02:17:26.839833 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 02:17:26.839833 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 02:17:26.839833 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 02:17:26.839833 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application with Lock( Oct 12 02:17:26.839833 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 02:17:26.839833 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._enter() Oct 12 02:17:26.839833 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 02:17:26.839833 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 02:17:26.839833 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 02:17:26.839833 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.creator() Oct 12 02:17:26.839833 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 02:17:26.839833 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application created_value = creator( Oct 12 02:17:26.839833 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 12 02:17:26.840763 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 12 02:17:26.840763 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 02:17:26.840763 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Oct 12 02:17:26.840763 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 258/523] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Oct 12 02:17:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 02:17:26.840763 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af317dd2-8101-4948-b275-e5f608d71d44 None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:17:26.862957 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:17:26.897500 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:17:26.937111 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f08c990-666c-47e2-8b16-f52d29dfe421 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:17:26.953952 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af317dd2-8101-4948-b275-e5f608d71d44 None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:17:26.973044 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7feff91f-9961-46d8-b5e6-26207b0bf678 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:17:26.974108 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7feff91f-9961-46d8-b5e6-26207b0bf678 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:26.974386 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7feff91f-9961-46d8-b5e6-26207b0bf678 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:26.974812 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7feff91f-9961-46d8-b5e6-26207b0bf678 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:26.975529 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7feff91f-9961-46d8-b5e6-26207b0bf678 None admin] RBAC: Adding query filter params (role.id=91634b0ac542413bb04e5ce92e66459d, scope.project.id=beb6def6fcad45959e56425bb8bff4d1, user.id=af9bd50c42cc437dbdd5a431d8adbb26) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 02:17:26.975834 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7feff91f-9961-46d8-b5e6-26207b0bf678 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:17:26.977274 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7feff91f-9961-46d8-b5e6-26207b0bf678 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:17:26.983221 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 266/524] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Oct 12 02:17:26 2022] GET /identity/v3/role_assignments?user.id=af9bd50c42cc437dbdd5a431d8adbb26&scope.project.id=beb6def6fcad45959e56425bb8bff4d1&role.id=91634b0ac542413bb04e5ce92e66459d => generated 608 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 02:17:26.983986 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7feff91f-9961-46d8-b5e6-26207b0bf678 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:17:26.999419 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cddb380-838d-46b4-a3ea-cf66bf893898 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:17:27.000715 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cddb380-838d-46b4-a3ea-cf66bf893898 None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:27.001230 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cddb380-838d-46b4-a3ea-cf66bf893898 None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:27.002209 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cddb380-838d-46b4-a3ea-cf66bf893898 None admin] PATH_INFO: `/v3/services` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:27.003426 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cddb380-838d-46b4-a3ea-cf66bf893898 None admin] RBAC: Adding query filter params (name=network) {{(pid=81361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 02:17:27.003949 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cddb380-838d-46b4-a3ea-cf66bf893898 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:17:27.006758 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cddb380-838d-46b4-a3ea-cf66bf893898 None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:17:27.018460 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 259/525] 10.222.0.18 () {56 vars in 1112 bytes} [Wed Oct 12 02:17:26 2022] GET /identity/v3/services?name=network => generated 124 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 02:17:27.018460 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cddb380-838d-46b4-a3ea-cf66bf893898 None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:17:27.102181 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:17:27.105948 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7feff91f-9961-46d8-b5e6-26207b0bf678 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:17:27.146797 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfac9f9-bc97-4edc-84f1-ef89dbf0ee75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:17:27.147525 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfac9f9-bc97-4edc-84f1-ef89dbf0ee75 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:27.147866 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfac9f9-bc97-4edc-84f1-ef89dbf0ee75 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:27.148206 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfac9f9-bc97-4edc-84f1-ef89dbf0ee75 None admin] PATH_INFO: `/v3/services` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:27.148968 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbfac9f9-bc97-4edc-84f1-ef89dbf0ee75 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 02:17:27.149337 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbfac9f9-bc97-4edc-84f1-ef89dbf0ee75 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:17:27.150894 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbfac9f9-bc97-4edc-84f1-ef89dbf0ee75 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:17:27.162391 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 267/526] 10.222.0.18 () {56 vars in 1124 bytes} [Wed Oct 12 02:17:26 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 02:17:27.162391 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfac9f9-bc97-4edc-84f1-ef89dbf0ee75 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:17:27.171690 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cddb380-838d-46b4-a3ea-cf66bf893898 None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:17:27.191444 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:17:27.222278 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a6321b-2eda-4044-841f-1155be78e643 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:17:27.222506 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a6321b-2eda-4044-841f-1155be78e643 None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:27.222871 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a6321b-2eda-4044-841f-1155be78e643 None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:27.223834 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a6321b-2eda-4044-841f-1155be78e643 None admin] PATH_INFO: `/v3/domains` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:27.226780 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a6321b-2eda-4044-841f-1155be78e643 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 02:17:27.226780 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a6321b-2eda-4044-841f-1155be78e643 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:17:27.227626 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a6321b-2eda-4044-841f-1155be78e643 None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:17:27.244595 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 260/527] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Oct 12 02:17:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 02:17:27.253821 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a6321b-2eda-4044-841f-1155be78e643 None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:17:27.325559 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfac9f9-bc97-4edc-84f1-ef89dbf0ee75 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:17:27.389099 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330952d2-de25-49de-8010-ab42406744a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:17:27.389717 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330952d2-de25-49de-8010-ab42406744a2 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:27.389993 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330952d2-de25-49de-8010-ab42406744a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:27.390377 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330952d2-de25-49de-8010-ab42406744a2 None admin] PATH_INFO: `/v3/services` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:27.391015 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330952d2-de25-49de-8010-ab42406744a2 None admin] RBAC: Adding query filter params (type=network) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 02:17:27.391437 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330952d2-de25-49de-8010-ab42406744a2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:17:27.392852 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330952d2-de25-49de-8010-ab42406744a2 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:17:27.403187 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 268/528] 10.222.0.18 () {56 vars in 1112 bytes} [Wed Oct 12 02:17:27 2022] GET /identity/v3/services?type=network => generated 124 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 02:17:27.454697 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a6321b-2eda-4044-841f-1155be78e643 None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:17:27.505478 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001a35a9-f4ca-4f81-90be-8f6b89e00066 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:17:27.506118 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001a35a9-f4ca-4f81-90be-8f6b89e00066 None admin] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:27.506402 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001a35a9-f4ca-4f81-90be-8f6b89e00066 None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:27.506675 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001a35a9-f4ca-4f81-90be-8f6b89e00066 None admin] PATH_INFO: `/v3/users` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:27.507336 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001a35a9-f4ca-4f81-90be-8f6b89e00066 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:17:27.508817 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001a35a9-f4ca-4f81-90be-8f6b89e00066 None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:17:27.554768 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 261/529] 10.222.0.18 () {60 vars in 1132 bytes} [Wed Oct 12 02:17:27 2022] POST /identity/v3/users => generated 254 bytes in 301 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 02:17:28.257512 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421f4b50-3632-4422-918d-4496bd8c0545 None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:28.258063 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421f4b50-3632-4422-918d-4496bd8c0545 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:28.258063 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421f4b50-3632-4422-918d-4496bd8c0545 None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:28.259629 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 269/530] 10.222.0.18 () {54 vars in 927 bytes} [Wed Oct 12 02:17:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 02:17:28.274436 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228b0907-9974-4f52-8c70-bf08df52bad8 None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:28.274900 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228b0907-9974-4f52-8c70-bf08df52bad8 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:28.274975 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228b0907-9974-4f52-8c70-bf08df52bad8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:28.297419 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-228b0907-9974-4f52-8c70-bf08df52bad8 None None] MFA Rules not processed for user `a326a5bb7364479382f528a592371656`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:17:28.298626 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-228b0907-9974-4f52-8c70-bf08df52bad8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:17:28.323994 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:17:28.386102 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 262/531] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Oct 12 02:17:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 12 02:17:28.812537 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421f4b50-3632-4422-918d-4496bd8c0545 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:17:28.844540 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:17:28.945538 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421f4b50-3632-4422-918d-4496bd8c0545 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:17:29.001200 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef599b1-678d-4f1a-9a4a-5013b28a49a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:17:29.001853 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef599b1-678d-4f1a-9a4a-5013b28a49a4 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:29.002130 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef599b1-678d-4f1a-9a4a-5013b28a49a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:29.002400 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef599b1-678d-4f1a-9a4a-5013b28a49a4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:29.019175 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef599b1-678d-4f1a-9a4a-5013b28a49a4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 02:17:29.025027 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-0ef599b1-678d-4f1a-9a4a-5013b28a49a4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 12 02:17:29.025027 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 02:17:29.025027 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 02:17:29.025027 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 02:17:29.025027 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 02:17:29.025027 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 02:17:29.025027 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 02:17:29.025027 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 02:17:29.025027 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 02:17:29.025027 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 02:17:29.025027 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 02:17:29.025027 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 02:17:29.025027 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 12 02:17:29.025027 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 12 02:17:29.025027 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 12 02:17:29.025027 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 12 02:17:29.025951 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 12 02:17:29.025951 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 12 02:17:29.025951 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 12 02:17:29.025951 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 12 02:17:29.025951 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 02:17:29.025951 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 02:17:29.025951 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 02:17:29.025951 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 02:17:29.025951 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 02:17:29.025951 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 02:17:29.025951 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 02:17:29.025951 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Oct 12 02:17:29.025951 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 02:17:29.025951 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Oct 12 02:17:29.025951 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 02:17:29.025951 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 02:17:29.026842 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 02:17:29.026842 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Oct 12 02:17:29.026842 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 02:17:29.026842 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Oct 12 02:17:29.026842 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 12 02:17:29.026842 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 12 02:17:29.026842 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 12 02:17:29.026842 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 12 02:17:29.026842 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 12 02:17:29.026842 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 12 02:17:29.026842 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 12 02:17:29.026842 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Oct 12 02:17:29.026842 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 270/532] 10.222.0.18 () {56 vars in 1096 bytes} [Wed Oct 12 02:17:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 02:17:29.032671 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228b0907-9974-4f52-8c70-bf08df52bad8 None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:17:29.184754 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228b0907-9974-4f52-8c70-bf08df52bad8 None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:17:29.226061 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c853d81-c9ab-412d-9e5a-fd1dd575f82e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:17:29.226673 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c853d81-c9ab-412d-9e5a-fd1dd575f82e None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:29.226948 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c853d81-c9ab-412d-9e5a-fd1dd575f82e None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:29.227216 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c853d81-c9ab-412d-9e5a-fd1dd575f82e None admin] PATH_INFO: `/v3/roles` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:29.227871 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c853d81-c9ab-412d-9e5a-fd1dd575f82e None admin] RBAC: Adding query filter params (name=admin) {{(pid=81361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 02:17:29.228167 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c853d81-c9ab-412d-9e5a-fd1dd575f82e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:17:29.229557 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c853d81-c9ab-412d-9e5a-fd1dd575f82e None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:17:29.244592 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 263/533] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Oct 12 02:17:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 02:17:29.250133 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef599b1-678d-4f1a-9a4a-5013b28a49a4 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:17:29.361333 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:17:29.377725 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef599b1-678d-4f1a-9a4a-5013b28a49a4 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:17:29.427551 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95454d99-1969-4983-b8da-4d9e98df1077 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:17:29.428188 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95454d99-1969-4983-b8da-4d9e98df1077 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:29.428490 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95454d99-1969-4983-b8da-4d9e98df1077 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:29.428753 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95454d99-1969-4983-b8da-4d9e98df1077 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:29.440375 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95454d99-1969-4983-b8da-4d9e98df1077 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:17:29.443182 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95454d99-1969-4983-b8da-4d9e98df1077 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:17:29.468070 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-95454d99-1969-4983-b8da-4d9e98df1077 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 02:17:29.468070 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 02:17:29.468070 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 02:17:29.468070 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 02:17:29.468070 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 02:17:29.468070 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 02:17:29.468070 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 02:17:29.468070 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 02:17:29.468070 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 02:17:29.468070 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 02:17:29.468070 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 02:17:29.468070 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 02:17:29.468070 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 12 02:17:29.468070 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 12 02:17:29.468070 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 12 02:17:29.468070 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 12 02:17:29.469117 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 02:17:29.469117 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 02:17:29.469117 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 02:17:29.469117 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 02:17:29.469117 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 02:17:29.469117 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 02:17:29.469117 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 02:17:29.469117 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Oct 12 02:17:29.469117 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 02:17:29.469117 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Oct 12 02:17:29.469117 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 02:17:29.469117 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 02:17:29.469117 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 02:17:29.469117 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Oct 12 02:17:29.469117 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 02:17:29.469117 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Oct 12 02:17:29.469117 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 12 02:17:29.470014 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 12 02:17:29.470014 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 02:17:29.470014 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Oct 12 02:17:29.471828 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 271/534] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Oct 12 02:17:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 02:17:29.481673 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c853d81-c9ab-412d-9e5a-fd1dd575f82e None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:17:29.552860 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:17:29.647625 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ff68a6-c0ba-408c-9b81-9e41e01e94ba None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:29.648435 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ff68a6-c0ba-408c-9b81-9e41e01e94ba None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:29.648966 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ff68a6-c0ba-408c-9b81-9e41e01e94ba None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:29.651558 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 272/535] 10.222.0.18 () {54 vars in 927 bytes} [Wed Oct 12 02:17:29 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 02:17:29.656333 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500bf481-eaf0-45eb-91d5-e3b600de85d9 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:29.656880 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500bf481-eaf0-45eb-91d5-e3b600de85d9 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:29.657333 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500bf481-eaf0-45eb-91d5-e3b600de85d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:29.708610 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-500bf481-eaf0-45eb-91d5-e3b600de85d9 None None] MFA Rules not processed for user `a326a5bb7364479382f528a592371656`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:17:29.711135 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c853d81-c9ab-412d-9e5a-fd1dd575f82e None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:17:29.713179 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-500bf481-eaf0-45eb-91d5-e3b600de85d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:17:29.795974 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b2944b-4d5c-4cd6-8781-d53653e26d16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:17:29.796625 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b2944b-4d5c-4cd6-8781-d53653e26d16 None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:29.796907 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b2944b-4d5c-4cd6-8781-d53653e26d16 None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:29.797180 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b2944b-4d5c-4cd6-8781-d53653e26d16 None admin] PATH_INFO: `/v3/domains` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:29.797836 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b2944b-4d5c-4cd6-8781-d53653e26d16 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 02:17:29.798136 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b2944b-4d5c-4cd6-8781-d53653e26d16 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:17:29.799516 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b2944b-4d5c-4cd6-8781-d53653e26d16 None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:17:29.839674 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 264/536] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Oct 12 02:17:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 358 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 02:17:29.840612 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b2944b-4d5c-4cd6-8781-d53653e26d16 None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:17:29.920974 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 273/537] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Oct 12 02:17:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 12 02:17:30.084130 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:17:30.148694 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b2944b-4d5c-4cd6-8781-d53653e26d16 None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:17:30.171830 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c58b3bb-2553-4db3-afb8-0b3e16257228 None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:30.172138 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c58b3bb-2553-4db3-afb8-0b3e16257228 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:30.172410 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c58b3bb-2553-4db3-afb8-0b3e16257228 None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:30.174271 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 274/538] 10.222.0.18 () {54 vars in 927 bytes} [Wed Oct 12 02:17:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 12 02:17:30.175291 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11761b6f-fa1b-431c-9288-4dcd59981112 None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:30.175570 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11761b6f-fa1b-431c-9288-4dcd59981112 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:30.175840 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11761b6f-fa1b-431c-9288-4dcd59981112 None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:30.183126 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 275/539] 10.222.0.18 () {54 vars in 927 bytes} [Wed Oct 12 02:17:30 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 02:17:30.188438 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672f9b4c-0494-44e1-900d-4485b179b28c None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:30.188438 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672f9b4c-0494-44e1-900d-4485b179b28c None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:30.188438 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672f9b4c-0494-44e1-900d-4485b179b28c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:30.202268 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6987f7e-3560-45d8-8034-dc1820104fe6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:17:30.202917 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6987f7e-3560-45d8-8034-dc1820104fe6 None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:30.203197 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6987f7e-3560-45d8-8034-dc1820104fe6 None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:30.203469 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6987f7e-3560-45d8-8034-dc1820104fe6 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:30.212521 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6987f7e-3560-45d8-8034-dc1820104fe6 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:17:30.213976 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6987f7e-3560-45d8-8034-dc1820104fe6 None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:17:30.215510 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-672f9b4c-0494-44e1-900d-4485b179b28c None None] MFA Rules not processed for user `a326a5bb7364479382f528a592371656`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:17:30.217613 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-672f9b4c-0494-44e1-900d-4485b179b28c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:17:30.228172 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application [None req-f6987f7e-3560-45d8-8034-dc1820104fe6 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 12 02:17:30.228172 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 02:17:30.228172 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 02:17:30.228172 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 02:17:30.228172 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 02:17:30.228172 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 02:17:30.228172 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 02:17:30.228172 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 02:17:30.228172 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 02:17:30.228172 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 02:17:30.228172 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 02:17:30.228172 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 02:17:30.228172 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 12 02:17:30.228172 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 12 02:17:30.228172 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 12 02:17:30.228172 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 12 02:17:30.229249 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 02:17:30.229249 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 02:17:30.229249 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 12 02:17:30.229249 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 12 02:17:30.229249 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 12 02:17:30.229249 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 12 02:17:30.229249 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 02:17:30.229249 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 02:17:30.229249 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 02:17:30.229249 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 02:17:30.229249 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 02:17:30.229249 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application with Lock( Oct 12 02:17:30.229249 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 02:17:30.229249 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._enter() Oct 12 02:17:30.229249 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 02:17:30.229249 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 02:17:30.229249 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 02:17:30.229249 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.creator() Oct 12 02:17:30.230237 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 02:17:30.230237 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application created_value = creator( Oct 12 02:17:30.230237 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 12 02:17:30.230237 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 12 02:17:30.230237 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 12 02:17:30.230237 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 12 02:17:30.230237 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 12 02:17:30.230237 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 12 02:17:30.230237 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 12 02:17:30.230237 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Oct 12 02:17:30.231524 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 265/540] 10.222.0.18 () {56 vars in 1093 bytes} [Wed Oct 12 02:17:29 2022] GET /identity/v3/users/nova => generated 82 bytes in 389 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 02:17:30.232776 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a557a0-03e1-44e3-9e8f-1b53b866aa98 None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:30.233062 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a557a0-03e1-44e3-9e8f-1b53b866aa98 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:30.233338 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a557a0-03e1-44e3-9e8f-1b53b866aa98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:30.252312 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-44a557a0-03e1-44e3-9e8f-1b53b866aa98 None None] MFA Rules not processed for user `a326a5bb7364479382f528a592371656`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:17:30.253541 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-44a557a0-03e1-44e3-9e8f-1b53b866aa98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:17:30.292669 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:17:30.298729 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 276/541] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Oct 12 02:17:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 12 02:17:30.299745 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672f9b4c-0494-44e1-900d-4485b179b28c None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:17:30.337651 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 266/542] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Oct 12 02:17:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 12 02:17:30.338951 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a557a0-03e1-44e3-9e8f-1b53b866aa98 None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:17:30.414153 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672f9b4c-0494-44e1-900d-4485b179b28c None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:17:30.420299 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:17:30.455263 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8fa07a-4bf0-4168-ab68-c00b475855a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:17:30.455917 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8fa07a-4bf0-4168-ab68-c00b475855a1 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:30.456322 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8fa07a-4bf0-4168-ab68-c00b475855a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:30.456669 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8fa07a-4bf0-4168-ab68-c00b475855a1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:30.466194 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a557a0-03e1-44e3-9e8f-1b53b866aa98 None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:17:30.470520 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8fa07a-4bf0-4168-ab68-c00b475855a1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 02:17:30.476118 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-6c8fa07a-4bf0-4168-ab68-c00b475855a1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 12 02:17:30.476118 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 02:17:30.476118 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 02:17:30.476118 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 02:17:30.476118 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 02:17:30.476118 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 02:17:30.476118 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 02:17:30.476118 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 02:17:30.476118 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 02:17:30.476118 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 02:17:30.476118 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 02:17:30.476118 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 02:17:30.476118 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 12 02:17:30.476118 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 12 02:17:30.476118 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 12 02:17:30.476118 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 12 02:17:30.477157 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 12 02:17:30.477157 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 12 02:17:30.477157 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 12 02:17:30.477157 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 12 02:17:30.477157 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 02:17:30.477157 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 02:17:30.477157 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 02:17:30.477157 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 02:17:30.477157 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 02:17:30.477157 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 02:17:30.477157 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 02:17:30.477157 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Oct 12 02:17:30.477157 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 02:17:30.477157 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Oct 12 02:17:30.477157 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 02:17:30.477157 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 02:17:30.478031 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 02:17:30.478031 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Oct 12 02:17:30.478031 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 02:17:30.478031 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Oct 12 02:17:30.478031 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 12 02:17:30.478031 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 12 02:17:30.478031 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 12 02:17:30.478031 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 12 02:17:30.478031 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 12 02:17:30.478031 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 12 02:17:30.478031 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 12 02:17:30.478031 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Oct 12 02:17:30.478031 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 277/543] 10.222.0.18 () {56 vars in 1096 bytes} [Wed Oct 12 02:17:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 02:17:30.486067 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8fa07a-4bf0-4168-ab68-c00b475855a1 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:17:30.547294 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885aee51-7b55-4056-84f6-de42f8ce2bb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:17:30.547931 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885aee51-7b55-4056-84f6-de42f8ce2bb4 None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:30.548273 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885aee51-7b55-4056-84f6-de42f8ce2bb4 None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:30.548574 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885aee51-7b55-4056-84f6-de42f8ce2bb4 None admin] PATH_INFO: `/v3/users` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:30.549384 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885aee51-7b55-4056-84f6-de42f8ce2bb4 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 02:17:30.549690 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885aee51-7b55-4056-84f6-de42f8ce2bb4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:17:30.551793 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885aee51-7b55-4056-84f6-de42f8ce2bb4 None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:17:30.602758 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 267/544] 10.222.0.18 () {56 vars in 1133 bytes} [Wed Oct 12 02:17:30 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 02:17:30.617143 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:17:30.617456 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885aee51-7b55-4056-84f6-de42f8ce2bb4 None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:17:30.670588 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8fa07a-4bf0-4168-ab68-c00b475855a1 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:17:30.713318 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3461e143-3be6-4407-a9c1-6c7ad0a985da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:17:30.713915 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3461e143-3be6-4407-a9c1-6c7ad0a985da None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:30.714185 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3461e143-3be6-4407-a9c1-6c7ad0a985da None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:30.714451 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3461e143-3be6-4407-a9c1-6c7ad0a985da None admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:30.715104 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3461e143-3be6-4407-a9c1-6c7ad0a985da None admin] RBAC: Adding query filter params (name=admin) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 02:17:30.715400 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3461e143-3be6-4407-a9c1-6c7ad0a985da None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:17:30.716791 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3461e143-3be6-4407-a9c1-6c7ad0a985da None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:17:30.725277 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 278/545] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Oct 12 02:17:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 02:17:30.726098 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3461e143-3be6-4407-a9c1-6c7ad0a985da None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:17:30.746233 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885aee51-7b55-4056-84f6-de42f8ce2bb4 None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:17:30.773347 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:17:30.782391 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20030edb-3e8a-4643-9423-71e732a0f9e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:17:30.783002 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20030edb-3e8a-4643-9423-71e732a0f9e2 None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:30.783396 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20030edb-3e8a-4643-9423-71e732a0f9e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:30.783672 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20030edb-3e8a-4643-9423-71e732a0f9e2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:30.827415 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3461e143-3be6-4407-a9c1-6c7ad0a985da None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:17:30.849499 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20030edb-3e8a-4643-9423-71e732a0f9e2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:17:30.850131 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:17:30.850980 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20030edb-3e8a-4643-9423-71e732a0f9e2 None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:17:30.861872 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a6d556-6b1e-4505-bc02-395248783809 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:17:30.862413 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a6d556-6b1e-4505-bc02-395248783809 None admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:30.862720 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a6d556-6b1e-4505-bc02-395248783809 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:30.862992 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a6d556-6b1e-4505-bc02-395248783809 None admin] PATH_INFO: `/v3/services` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:30.864214 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a6d556-6b1e-4505-bc02-395248783809 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:17:30.866134 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a6d556-6b1e-4505-bc02-395248783809 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:17:30.882485 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 279/546] 10.222.0.18 () {60 vars in 1141 bytes} [Wed Oct 12 02:17:30 2022] POST /identity/v3/services => generated 240 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 02:17:30.883266 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a6d556-6b1e-4505-bc02-395248783809 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:17:30.971838 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 268/547] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Oct 12 02:17:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 12 02:17:30.973796 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14189062-f45d-4030-be67-5c6a5c00e031 None None] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:30.974086 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14189062-f45d-4030-be67-5c6a5c00e031 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:30.974361 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14189062-f45d-4030-be67-5c6a5c00e031 None None] PATH_INFO: `/` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:30.976036 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 269/548] 10.222.0.18 () {54 vars in 927 bytes} [Wed Oct 12 02:17:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 02:17:30.977088 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14189062-f45d-4030-be67-5c6a5c00e031 None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:17:31.006958 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:17:31.018787 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a6d556-6b1e-4505-bc02-395248783809 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:17:31.056071 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d84e18c-1786-44d1-bf71-b1aea46ead62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:17:31.057548 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d84e18c-1786-44d1-bf71-b1aea46ead62 None admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:31.057975 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d84e18c-1786-44d1-bf71-b1aea46ead62 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:31.058258 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d84e18c-1786-44d1-bf71-b1aea46ead62 None admin] PATH_INFO: `/v3/services` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:31.058922 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d84e18c-1786-44d1-bf71-b1aea46ead62 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:17:31.061024 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d84e18c-1786-44d1-bf71-b1aea46ead62 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:17:31.077182 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 280/549] 10.222.0.18 () {60 vars in 1141 bytes} [Wed Oct 12 02:17:30 2022] POST /identity/v3/services => generated 251 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 02:17:31.078081 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d84e18c-1786-44d1-bf71-b1aea46ead62 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:17:31.109020 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14189062-f45d-4030-be67-5c6a5c00e031 None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:17:31.138180 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:17:31.157544 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feeae3a1-98c9-46d7-bcf7-bfbbdd3b432b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:17:31.158482 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feeae3a1-98c9-46d7-bcf7-bfbbdd3b432b None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:31.158902 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feeae3a1-98c9-46d7-bcf7-bfbbdd3b432b None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:31.159328 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feeae3a1-98c9-46d7-bcf7-bfbbdd3b432b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:31.174795 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feeae3a1-98c9-46d7-bcf7-bfbbdd3b432b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:17:31.177330 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feeae3a1-98c9-46d7-bcf7-bfbbdd3b432b None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:17:31.200675 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application [None req-feeae3a1-98c9-46d7-bcf7-bfbbdd3b432b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 02:17:31.200675 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 02:17:31.200675 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 02:17:31.200675 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 02:17:31.200675 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 02:17:31.200675 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 02:17:31.200675 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 02:17:31.200675 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 02:17:31.200675 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 02:17:31.200675 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 02:17:31.200675 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 02:17:31.200675 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 02:17:31.200675 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 12 02:17:31.200675 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 12 02:17:31.200675 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 12 02:17:31.200675 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 12 02:17:31.201915 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 02:17:31.201915 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 02:17:31.201915 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 02:17:31.201915 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 02:17:31.201915 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 02:17:31.201915 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 02:17:31.201915 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 02:17:31.201915 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application with Lock( Oct 12 02:17:31.201915 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 02:17:31.201915 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._enter() Oct 12 02:17:31.201915 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 02:17:31.201915 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 02:17:31.201915 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 02:17:31.201915 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.creator() Oct 12 02:17:31.201915 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 02:17:31.201915 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application created_value = creator( Oct 12 02:17:31.201915 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 12 02:17:31.203084 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 12 02:17:31.203084 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 02:17:31.203084 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Oct 12 02:17:31.203084 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 270/550] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Oct 12 02:17:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 02:17:31.208347 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9f438f-4e78-41e3-b924-38463f01f16d None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:31.208658 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9f438f-4e78-41e3-b924-38463f01f16d None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:31.208937 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9f438f-4e78-41e3-b924-38463f01f16d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:31.214538 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d84e18c-1786-44d1-bf71-b1aea46ead62 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:17:31.228772 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-8e9f438f-4e78-41e3-b924-38463f01f16d None None] MFA Rules not processed for user `a326a5bb7364479382f528a592371656`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:17:31.230268 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-8e9f438f-4e78-41e3-b924-38463f01f16d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:17:31.258583 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d711cf-0d01-4f9b-a2cb-a96a47436a06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:17:31.258583 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d711cf-0d01-4f9b-a2cb-a96a47436a06 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:31.258583 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d711cf-0d01-4f9b-a2cb-a96a47436a06 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:31.258583 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d711cf-0d01-4f9b-a2cb-a96a47436a06 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:31.271349 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d711cf-0d01-4f9b-a2cb-a96a47436a06 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:17:31.273048 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d711cf-0d01-4f9b-a2cb-a96a47436a06 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:17:31.290930 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-19d711cf-0d01-4f9b-a2cb-a96a47436a06 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 02:17:31.290930 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 02:17:31.290930 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 02:17:31.290930 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 02:17:31.290930 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 02:17:31.290930 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 02:17:31.290930 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 02:17:31.290930 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 02:17:31.290930 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 02:17:31.290930 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 02:17:31.290930 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 02:17:31.290930 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 02:17:31.290930 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 12 02:17:31.290930 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 12 02:17:31.290930 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 12 02:17:31.290930 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 12 02:17:31.292127 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 02:17:31.292127 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 02:17:31.292127 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 02:17:31.292127 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 02:17:31.292127 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 02:17:31.292127 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 02:17:31.292127 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 02:17:31.292127 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Oct 12 02:17:31.292127 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 02:17:31.292127 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Oct 12 02:17:31.292127 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 02:17:31.292127 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 02:17:31.292127 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 02:17:31.292127 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Oct 12 02:17:31.292127 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 02:17:31.292127 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Oct 12 02:17:31.292127 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 12 02:17:31.293288 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 12 02:17:31.293288 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 02:17:31.293288 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Oct 12 02:17:31.293288 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 281/551] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Oct 12 02:17:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 02:17:31.293288 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d711cf-0d01-4f9b-a2cb-a96a47436a06 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:17:31.319269 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 271/552] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Oct 12 02:17:31 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 12 02:17:31.320365 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9f438f-4e78-41e3-b924-38463f01f16d None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:17:31.323769 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:17:31.420219 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:17:31.446370 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9f438f-4e78-41e3-b924-38463f01f16d None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:17:31.446562 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d711cf-0d01-4f9b-a2cb-a96a47436a06 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:17:31.486668 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd9f7c3-a7d5-4028-b6cc-9d4235ac9bf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:17:31.487622 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd9f7c3-a7d5-4028-b6cc-9d4235ac9bf2 None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:31.487907 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd9f7c3-a7d5-4028-b6cc-9d4235ac9bf2 None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:31.489051 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd9f7c3-a7d5-4028-b6cc-9d4235ac9bf2 None admin] PATH_INFO: `/v3/domains` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:31.489774 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd9f7c3-a7d5-4028-b6cc-9d4235ac9bf2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 02:17:31.490196 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd9f7c3-a7d5-4028-b6cc-9d4235ac9bf2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:17:31.491846 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd9f7c3-a7d5-4028-b6cc-9d4235ac9bf2 None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:17:31.505043 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 272/553] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Oct 12 02:17:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 02:17:31.510239 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd9f7c3-a7d5-4028-b6cc-9d4235ac9bf2 None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:17:31.520375 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44de4829-90e2-4664-90ee-cf033286138c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:17:31.521027 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44de4829-90e2-4664-90ee-cf033286138c None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:31.521306 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44de4829-90e2-4664-90ee-cf033286138c None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:31.521576 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44de4829-90e2-4664-90ee-cf033286138c None admin] PATH_INFO: `/v3/domains` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:31.524679 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44de4829-90e2-4664-90ee-cf033286138c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 02:17:31.524679 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44de4829-90e2-4664-90ee-cf033286138c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:17:31.524679 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44de4829-90e2-4664-90ee-cf033286138c None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:17:31.538050 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 282/554] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Oct 12 02:17:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 02:17:31.548544 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44de4829-90e2-4664-90ee-cf033286138c None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:17:31.671178 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44de4829-90e2-4664-90ee-cf033286138c None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:17:31.673645 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:17:31.710837 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c13b79-793c-442d-b46f-c802628706b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:17:31.711475 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c13b79-793c-442d-b46f-c802628706b1 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:31.711751 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c13b79-793c-442d-b46f-c802628706b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:31.712025 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c13b79-793c-442d-b46f-c802628706b1 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:31.720965 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c13b79-793c-442d-b46f-c802628706b1 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:17:31.721633 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd9f7c3-a7d5-4028-b6cc-9d4235ac9bf2 None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:17:31.722419 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c13b79-793c-442d-b46f-c802628706b1 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:17:31.738634 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-b7c13b79-793c-442d-b46f-c802628706b1 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 12 02:17:31.738634 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 02:17:31.738634 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 02:17:31.738634 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 02:17:31.738634 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 02:17:31.738634 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 02:17:31.738634 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 02:17:31.738634 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 02:17:31.738634 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 02:17:31.738634 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 02:17:31.738634 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 02:17:31.738634 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 02:17:31.738634 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 12 02:17:31.738634 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 12 02:17:31.738634 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 12 02:17:31.738634 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 12 02:17:31.740112 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 02:17:31.740112 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 02:17:31.740112 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 12 02:17:31.740112 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 12 02:17:31.740112 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 12 02:17:31.740112 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 12 02:17:31.740112 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 02:17:31.740112 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 02:17:31.740112 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 02:17:31.740112 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 02:17:31.740112 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 02:17:31.740112 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Oct 12 02:17:31.740112 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 02:17:31.740112 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Oct 12 02:17:31.740112 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 02:17:31.740112 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 02:17:31.740112 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 02:17:31.740112 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Oct 12 02:17:31.741585 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 02:17:31.741585 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Oct 12 02:17:31.741585 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 12 02:17:31.741585 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 12 02:17:31.741585 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 12 02:17:31.741585 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 12 02:17:31.741585 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 12 02:17:31.741585 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 12 02:17:31.741585 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Oct 12 02:17:31.741585 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Oct 12 02:17:31.745038 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 283/555] 10.222.0.18 () {56 vars in 1096 bytes} [Wed Oct 12 02:17:31 2022] GET /identity/v3/users/swift => generated 83 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 02:17:31.746180 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c13b79-793c-442d-b46f-c802628706b1 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:17:31.762693 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:17:31.769032 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423fc8f7-64ca-49d9-b52c-da7baa6d773b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:17:31.770621 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423fc8f7-64ca-49d9-b52c-da7baa6d773b None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:31.771220 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423fc8f7-64ca-49d9-b52c-da7baa6d773b None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:31.771642 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423fc8f7-64ca-49d9-b52c-da7baa6d773b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:31.781030 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423fc8f7-64ca-49d9-b52c-da7baa6d773b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:17:31.783411 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423fc8f7-64ca-49d9-b52c-da7baa6d773b None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:17:31.799182 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application [None req-423fc8f7-64ca-49d9-b52c-da7baa6d773b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 12 02:17:31.799182 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 02:17:31.799182 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 02:17:31.799182 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 02:17:31.799182 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 02:17:31.799182 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 02:17:31.799182 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 02:17:31.799182 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 02:17:31.799182 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 02:17:31.799182 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 02:17:31.799182 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 02:17:31.799182 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 02:17:31.799182 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 12 02:17:31.799182 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 12 02:17:31.799182 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 12 02:17:31.800305 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 12 02:17:31.800305 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 02:17:31.800305 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 02:17:31.800305 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 02:17:31.800305 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 02:17:31.800305 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 02:17:31.800305 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 02:17:31.800305 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 02:17:31.800305 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application with Lock( Oct 12 02:17:31.800305 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 02:17:31.800305 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._enter() Oct 12 02:17:31.800305 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 02:17:31.800305 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 02:17:31.800305 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 02:17:31.800305 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.creator() Oct 12 02:17:31.800305 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 02:17:31.800305 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application created_value = creator( Oct 12 02:17:31.802389 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 12 02:17:31.802389 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 12 02:17:31.802389 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 12 02:17:31.802389 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 12 02:17:31.802389 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 12 02:17:31.802389 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 12 02:17:31.802389 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 12 02:17:31.802389 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Oct 12 02:17:31.802389 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 273/556] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Oct 12 02:17:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 292 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 02:17:31.803120 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423fc8f7-64ca-49d9-b52c-da7baa6d773b None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:17:31.872503 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c13b79-793c-442d-b46f-c802628706b1 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:17:31.912799 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb1c924-c55a-43fb-994a-f115bdb4667a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:17:31.913439 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb1c924-c55a-43fb-994a-f115bdb4667a None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:31.913717 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb1c924-c55a-43fb-994a-f115bdb4667a None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:31.913990 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb1c924-c55a-43fb-994a-f115bdb4667a None admin] PATH_INFO: `/v3/roles/service` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:31.928747 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb1c924-c55a-43fb-994a-f115bdb4667a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 02:17:31.935358 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-8fb1c924-c55a-43fb-994a-f115bdb4667a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 12 02:17:31.935358 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 02:17:31.935358 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 02:17:31.935358 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 02:17:31.935358 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 02:17:31.935358 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 02:17:31.935358 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 02:17:31.935358 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 02:17:31.935358 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 02:17:31.935358 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 02:17:31.935358 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 02:17:31.935358 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 02:17:31.935358 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 12 02:17:31.935358 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 12 02:17:31.935358 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 12 02:17:31.935358 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 12 02:17:31.936394 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 12 02:17:31.936394 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 12 02:17:31.936394 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 12 02:17:31.936394 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 12 02:17:31.936394 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 02:17:31.936394 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 02:17:31.936394 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 02:17:31.936394 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 02:17:31.936394 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 02:17:31.936394 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 02:17:31.936394 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 02:17:31.936394 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Oct 12 02:17:31.936394 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 02:17:31.936394 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Oct 12 02:17:31.936394 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 02:17:31.936394 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 02:17:31.937258 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 02:17:31.937258 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Oct 12 02:17:31.937258 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 02:17:31.937258 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Oct 12 02:17:31.937258 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 12 02:17:31.937258 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 12 02:17:31.937258 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 12 02:17:31.937258 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 12 02:17:31.937258 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 12 02:17:31.937258 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 12 02:17:31.937258 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 12 02:17:31.937258 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Oct 12 02:17:31.940628 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 284/557] 10.222.0.18 () {56 vars in 1102 bytes} [Wed Oct 12 02:17:31 2022] GET /identity/v3/roles/service => generated 85 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 02:17:31.943072 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb1c924-c55a-43fb-994a-f115bdb4667a None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:17:31.950335 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423fc8f7-64ca-49d9-b52c-da7baa6d773b None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:17:31.980738 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:17:31.995032 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbb3ef6-4659-47fc-a75a-d725c605026d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:17:31.995965 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbb3ef6-4659-47fc-a75a-d725c605026d None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:31.996577 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbb3ef6-4659-47fc-a75a-d725c605026d None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:31.997146 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbb3ef6-4659-47fc-a75a-d725c605026d None admin] PATH_INFO: `/v3/users` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:31.998080 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afbb3ef6-4659-47fc-a75a-d725c605026d None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 02:17:31.998600 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afbb3ef6-4659-47fc-a75a-d725c605026d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:17:32.000408 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afbb3ef6-4659-47fc-a75a-d725c605026d None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:17:32.026193 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 274/558] 10.222.0.18 () {56 vars in 1135 bytes} [Wed Oct 12 02:17:31 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 02:17:32.027482 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbb3ef6-4659-47fc-a75a-d725c605026d None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:17:32.028738 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:17:32.062955 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb1c924-c55a-43fb-994a-f115bdb4667a None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:17:32.099032 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d902638-b81f-49c4-b775-b84acc70e2b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:17:32.099651 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d902638-b81f-49c4-b775-b84acc70e2b7 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:32.099932 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d902638-b81f-49c4-b775-b84acc70e2b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:32.100209 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d902638-b81f-49c4-b775-b84acc70e2b7 None admin] PATH_INFO: `/v3/projects` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:32.100950 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d902638-b81f-49c4-b775-b84acc70e2b7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 02:17:32.101351 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d902638-b81f-49c4-b775-b84acc70e2b7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:17:32.102698 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d902638-b81f-49c4-b775-b84acc70e2b7 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:17:32.116975 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 285/559] 10.222.0.18 () {56 vars in 1148 bytes} [Wed Oct 12 02:17:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 02:17:32.117966 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d902638-b81f-49c4-b775-b84acc70e2b7 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:17:32.146894 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbb3ef6-4659-47fc-a75a-d725c605026d None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:17:32.186899 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1b7cc1-2125-4e9c-9eeb-035414ff6800 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:17:32.187875 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1b7cc1-2125-4e9c-9eeb-035414ff6800 None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:32.188374 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1b7cc1-2125-4e9c-9eeb-035414ff6800 None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:32.188977 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1b7cc1-2125-4e9c-9eeb-035414ff6800 None admin] PATH_INFO: `/v3/roles` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:32.190127 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1b7cc1-2125-4e9c-9eeb-035414ff6800 None admin] RBAC: Adding query filter params (name=service) {{(pid=81361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 02:17:32.190630 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1b7cc1-2125-4e9c-9eeb-035414ff6800 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:17:32.192749 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1b7cc1-2125-4e9c-9eeb-035414ff6800 None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:17:32.206424 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 275/560] 10.222.0.18 () {56 vars in 1103 bytes} [Wed Oct 12 02:17:32 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 02:17:32.208323 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1b7cc1-2125-4e9c-9eeb-035414ff6800 None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:17:32.226062 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d902638-b81f-49c4-b775-b84acc70e2b7 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:17:32.257383 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:17:32.261140 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:17:32.265060 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7e4a6f-79a5-40bc-8ec1-e378f8010ee1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:17:32.265691 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7e4a6f-79a5-40bc-8ec1-e378f8010ee1 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:32.265969 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7e4a6f-79a5-40bc-8ec1-e378f8010ee1 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:32.266242 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7e4a6f-79a5-40bc-8ec1-e378f8010ee1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:32.277258 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7e4a6f-79a5-40bc-8ec1-e378f8010ee1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:17:32.278697 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7e4a6f-79a5-40bc-8ec1-e378f8010ee1 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:17:32.294563 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-fa7e4a6f-79a5-40bc-8ec1-e378f8010ee1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 02:17:32.294563 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 02:17:32.294563 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 02:17:32.294563 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 02:17:32.294563 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 02:17:32.294563 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 02:17:32.294563 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 02:17:32.294563 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 02:17:32.294563 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 02:17:32.294563 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 02:17:32.294563 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 02:17:32.294563 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 02:17:32.294563 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 12 02:17:32.294563 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 12 02:17:32.294563 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 12 02:17:32.294563 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 12 02:17:32.295543 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 02:17:32.295543 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 02:17:32.295543 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 02:17:32.295543 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 02:17:32.295543 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 02:17:32.295543 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 02:17:32.295543 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 02:17:32.295543 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Oct 12 02:17:32.295543 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 02:17:32.295543 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Oct 12 02:17:32.295543 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 02:17:32.295543 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 02:17:32.295543 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 02:17:32.295543 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Oct 12 02:17:32.295543 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 02:17:32.295543 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Oct 12 02:17:32.295543 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 12 02:17:32.296448 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 12 02:17:32.296448 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 02:17:32.296448 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Oct 12 02:17:32.296448 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 286/561] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Oct 12 02:17:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 02:17:32.297125 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7e4a6f-79a5-40bc-8ec1-e378f8010ee1 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:17:32.333762 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1b7cc1-2125-4e9c-9eeb-035414ff6800 None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:17:32.373943 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f95d6b-ed77-43d4-a24a-51e682b19f7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:17:32.374871 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f95d6b-ed77-43d4-a24a-51e682b19f7a None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:32.375335 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f95d6b-ed77-43d4-a24a-51e682b19f7a None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:32.375808 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f95d6b-ed77-43d4-a24a-51e682b19f7a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:32.376869 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f95d6b-ed77-43d4-a24a-51e682b19f7a None admin] RBAC: Adding query filter params (role.id=39b1e8108dff402383def3c559f48189, scope.project.id=beb6def6fcad45959e56425bb8bff4d1, user.id=f2fca96c111b45b795fb757f77908ff1) {{(pid=81361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 02:17:32.377361 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f95d6b-ed77-43d4-a24a-51e682b19f7a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:17:32.378971 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f95d6b-ed77-43d4-a24a-51e682b19f7a None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:17:32.392892 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 276/562] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Oct 12 02:17:32 2022] GET /identity/v3/role_assignments?user.id=f2fca96c111b45b795fb757f77908ff1&scope.project.id=beb6def6fcad45959e56425bb8bff4d1&role.id=39b1e8108dff402383def3c559f48189 => generated 608 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 02:17:32.394179 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f95d6b-ed77-43d4-a24a-51e682b19f7a None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:17:32.412523 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7e4a6f-79a5-40bc-8ec1-e378f8010ee1 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:17:32.443000 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d3ce37-6c88-4ccb-b8d8-114fa21ca9d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:17:32.443654 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d3ce37-6c88-4ccb-b8d8-114fa21ca9d3 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:32.443928 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d3ce37-6c88-4ccb-b8d8-114fa21ca9d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:32.444350 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d3ce37-6c88-4ccb-b8d8-114fa21ca9d3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:32.458907 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d3ce37-6c88-4ccb-b8d8-114fa21ca9d3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:17:32.460374 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d3ce37-6c88-4ccb-b8d8-114fa21ca9d3 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:17:32.492718 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-16d3ce37-6c88-4ccb-b8d8-114fa21ca9d3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 02:17:32.492718 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 02:17:32.492718 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 02:17:32.492718 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 02:17:32.492718 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 02:17:32.492718 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 02:17:32.492718 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 02:17:32.492718 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 02:17:32.492718 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 02:17:32.492718 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 02:17:32.492718 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 02:17:32.492718 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 02:17:32.492718 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 12 02:17:32.492718 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 12 02:17:32.492718 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 12 02:17:32.492718 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 12 02:17:32.493747 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 02:17:32.493747 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 02:17:32.493747 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 02:17:32.493747 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 02:17:32.493747 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 02:17:32.493747 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 02:17:32.493747 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 02:17:32.493747 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Oct 12 02:17:32.493747 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 02:17:32.493747 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Oct 12 02:17:32.493747 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 02:17:32.493747 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 02:17:32.493747 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 02:17:32.493747 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Oct 12 02:17:32.493747 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 02:17:32.493747 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Oct 12 02:17:32.493747 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 12 02:17:32.494641 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 12 02:17:32.494641 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 02:17:32.494641 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Oct 12 02:17:32.495706 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 287/563] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Oct 12 02:17:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 02:17:32.505651 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d3ce37-6c88-4ccb-b8d8-114fa21ca9d3 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:17:32.572625 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f95d6b-ed77-43d4-a24a-51e682b19f7a None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:17:32.577452 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:17:32.612887 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:17:32.643303 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3c6106-f4b5-432d-b0e3-11c5250cc98d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:17:32.643916 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3c6106-f4b5-432d-b0e3-11c5250cc98d None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:32.644194 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3c6106-f4b5-432d-b0e3-11c5250cc98d None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:32.644464 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3c6106-f4b5-432d-b0e3-11c5250cc98d None admin] PATH_INFO: `/v3/domains` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:32.645694 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3c6106-f4b5-432d-b0e3-11c5250cc98d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 02:17:32.646060 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3c6106-f4b5-432d-b0e3-11c5250cc98d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:17:32.647449 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3c6106-f4b5-432d-b0e3-11c5250cc98d None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:17:32.670105 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 277/564] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Oct 12 02:17:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 02:17:32.671022 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3c6106-f4b5-432d-b0e3-11c5250cc98d None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:17:32.691446 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d3ce37-6c88-4ccb-b8d8-114fa21ca9d3 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:17:32.737157 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5548ee2d-458b-4f27-a59c-870f7f1e0e28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:17:32.739255 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5548ee2d-458b-4f27-a59c-870f7f1e0e28 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:32.739873 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5548ee2d-458b-4f27-a59c-870f7f1e0e28 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:32.740712 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5548ee2d-458b-4f27-a59c-870f7f1e0e28 None admin] PATH_INFO: `/v3/domains` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:32.741718 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5548ee2d-458b-4f27-a59c-870f7f1e0e28 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 02:17:32.742205 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5548ee2d-458b-4f27-a59c-870f7f1e0e28 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:17:32.743737 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5548ee2d-458b-4f27-a59c-870f7f1e0e28 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:17:32.758448 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 288/565] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Oct 12 02:17:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 02:17:32.765441 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5548ee2d-458b-4f27-a59c-870f7f1e0e28 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:17:32.784971 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3c6106-f4b5-432d-b0e3-11c5250cc98d None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:17:32.823949 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e4953b-7718-4d93-b681-3f38fc2657b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:17:32.824737 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e4953b-7718-4d93-b681-3f38fc2657b5 None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:32.825088 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e4953b-7718-4d93-b681-3f38fc2657b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:32.825433 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e4953b-7718-4d93-b681-3f38fc2657b5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:32.833926 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e4953b-7718-4d93-b681-3f38fc2657b5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:17:32.835482 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e4953b-7718-4d93-b681-3f38fc2657b5 None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:17:32.847650 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application [None req-26e4953b-7718-4d93-b681-3f38fc2657b5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 12 02:17:32.847650 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 02:17:32.847650 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 02:17:32.847650 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 02:17:32.847650 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 02:17:32.847650 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 02:17:32.847650 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 02:17:32.847650 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 02:17:32.847650 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 02:17:32.847650 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 02:17:32.847650 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 02:17:32.847650 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 02:17:32.847650 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 12 02:17:32.847650 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 12 02:17:32.847650 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 12 02:17:32.848805 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 12 02:17:32.848805 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 02:17:32.848805 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 02:17:32.848805 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 02:17:32.848805 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 02:17:32.848805 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 02:17:32.848805 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 02:17:32.848805 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 02:17:32.848805 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application with Lock( Oct 12 02:17:32.848805 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 02:17:32.848805 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._enter() Oct 12 02:17:32.848805 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 02:17:32.848805 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 02:17:32.848805 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 02:17:32.848805 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.creator() Oct 12 02:17:32.848805 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 02:17:32.848805 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application created_value = creator( Oct 12 02:17:32.849807 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 12 02:17:32.849807 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 12 02:17:32.849807 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 12 02:17:32.849807 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 12 02:17:32.849807 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 12 02:17:32.849807 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 12 02:17:32.849807 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 12 02:17:32.849807 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Oct 12 02:17:32.849807 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 278/566] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Oct 12 02:17:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 02:17:32.855085 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e4953b-7718-4d93-b681-3f38fc2657b5 None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:17:32.886149 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:17:32.888034 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:17:32.898583 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5548ee2d-458b-4f27-a59c-870f7f1e0e28 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:17:32.942360 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedd3079-134b-47e8-8f9f-79beb53b76ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:17:32.943343 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedd3079-134b-47e8-8f9f-79beb53b76ef None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:32.944201 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedd3079-134b-47e8-8f9f-79beb53b76ef None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:32.944851 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedd3079-134b-47e8-8f9f-79beb53b76ef None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:32.954079 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aedd3079-134b-47e8-8f9f-79beb53b76ef None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:17:32.956037 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aedd3079-134b-47e8-8f9f-79beb53b76ef None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:17:32.967093 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e4953b-7718-4d93-b681-3f38fc2657b5 None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:17:32.971945 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-aedd3079-134b-47e8-8f9f-79beb53b76ef None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 12 02:17:32.971945 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 02:17:32.971945 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 02:17:32.971945 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 02:17:32.971945 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 02:17:32.971945 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 02:17:32.971945 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 02:17:32.971945 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 02:17:32.971945 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 02:17:32.971945 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 02:17:32.971945 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 02:17:32.971945 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 02:17:32.971945 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 12 02:17:32.971945 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 12 02:17:32.971945 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 12 02:17:32.971945 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 12 02:17:32.973266 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 02:17:32.973266 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 02:17:32.973266 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 12 02:17:32.973266 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 12 02:17:32.973266 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 12 02:17:32.973266 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 12 02:17:32.973266 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 02:17:32.973266 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 02:17:32.973266 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 02:17:32.973266 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 02:17:32.973266 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 02:17:32.973266 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Oct 12 02:17:32.973266 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 02:17:32.973266 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Oct 12 02:17:32.973266 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 02:17:32.973266 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 02:17:32.973266 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 02:17:32.973266 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Oct 12 02:17:32.974292 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 02:17:32.974292 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Oct 12 02:17:32.974292 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 12 02:17:32.974292 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 12 02:17:32.974292 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 12 02:17:32.974292 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 12 02:17:32.974292 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 12 02:17:32.974292 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 12 02:17:32.974292 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 12 02:17:32.974292 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Oct 12 02:17:32.977411 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 289/567] 10.222.0.18 () {56 vars in 1117 bytes} [Wed Oct 12 02:17:32 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 02:17:32.983571 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedd3079-134b-47e8-8f9f-79beb53b76ef None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:17:33.030690 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a8a6d3-3ff0-4e81-a45d-87ee8d1d444c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:17:33.031269 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a8a6d3-3ff0-4e81-a45d-87ee8d1d444c None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:33.031551 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a8a6d3-3ff0-4e81-a45d-87ee8d1d444c None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:33.031887 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a8a6d3-3ff0-4e81-a45d-87ee8d1d444c None admin] PATH_INFO: `/v3/projects` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:33.032604 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a8a6d3-3ff0-4e81-a45d-87ee8d1d444c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 02:17:33.032910 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a8a6d3-3ff0-4e81-a45d-87ee8d1d444c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:17:33.034354 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a8a6d3-3ff0-4e81-a45d-87ee8d1d444c None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:17:33.059414 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 279/568] 10.222.0.18 () {56 vars in 1148 bytes} [Wed Oct 12 02:17:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 02:17:33.065368 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a8a6d3-3ff0-4e81-a45d-87ee8d1d444c None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:17:33.191987 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedd3079-134b-47e8-8f9f-79beb53b76ef None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:17:33.218950 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:17:33.249220 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a8a6d3-3ff0-4e81-a45d-87ee8d1d444c None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:17:33.266293 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4410111-cd2e-40f6-b96e-ce3754a17829 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:17:33.266905 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4410111-cd2e-40f6-b96e-ce3754a17829 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:33.267182 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4410111-cd2e-40f6-b96e-ce3754a17829 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:33.267453 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4410111-cd2e-40f6-b96e-ce3754a17829 None admin] PATH_INFO: `/v3/users` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:33.268263 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4410111-cd2e-40f6-b96e-ce3754a17829 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 02:17:33.268594 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4410111-cd2e-40f6-b96e-ce3754a17829 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:17:33.271621 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4410111-cd2e-40f6-b96e-ce3754a17829 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:17:33.307450 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 290/569] 10.222.0.18 () {56 vars in 1149 bytes} [Wed Oct 12 02:17:32 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 325 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 02:17:33.312985 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4410111-cd2e-40f6-b96e-ce3754a17829 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:17:33.325108 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856f6b93-fdbf-425c-b4e3-fbc31d22f827 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:17:33.325780 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856f6b93-fdbf-425c-b4e3-fbc31d22f827 None admin] REQUEST_METHOD: `PUT` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:33.326055 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856f6b93-fdbf-425c-b4e3-fbc31d22f827 None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:33.326327 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856f6b93-fdbf-425c-b4e3-fbc31d22f827 None admin] PATH_INFO: `/v3/projects/beb6def6fcad45959e56425bb8bff4d1/users/af9bd50c42cc437dbdd5a431d8adbb26/roles/39b1e8108dff402383def3c559f48189` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:33.328544 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856f6b93-fdbf-425c-b4e3-fbc31d22f827 None admin] RBAC: Authorizing `identity:create_grant(project_id=beb6def6fcad45959e56425bb8bff4d1, user_id=af9bd50c42cc437dbdd5a431d8adbb26, role_id=39b1e8108dff402383def3c559f48189)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:17:33.330535 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856f6b93-fdbf-425c-b4e3-fbc31d22f827 None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:17:33.336419 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:17:33.351983 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 280/570] 10.222.0.18 () {58 vars in 1439 bytes} [Wed Oct 12 02:17:33 2022] PUT /identity/v3/projects/beb6def6fcad45959e56425bb8bff4d1/users/af9bd50c42cc437dbdd5a431d8adbb26/roles/39b1e8108dff402383def3c559f48189 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 02:17:33.351983 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63237a3-d6fd-434e-b745-686687c461ba None None] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:33.351983 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63237a3-d6fd-434e-b745-686687c461ba None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:33.351983 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63237a3-d6fd-434e-b745-686687c461ba None None] PATH_INFO: `/` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:33.351983 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 281/571] 10.222.0.18 () {54 vars in 927 bytes} [Wed Oct 12 02:17:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 02:17:33.362926 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85c05df-bd2a-485d-9d38-1467c0374a62 None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:33.363202 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85c05df-bd2a-485d-9d38-1467c0374a62 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:33.363546 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85c05df-bd2a-485d-9d38-1467c0374a62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:33.386501 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-e85c05df-bd2a-485d-9d38-1467c0374a62 None None] MFA Rules not processed for user `a326a5bb7364479382f528a592371656`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:17:33.388022 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-e85c05df-bd2a-485d-9d38-1467c0374a62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:17:33.478381 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 282/572] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Oct 12 02:17:33 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 12 02:17:33.570336 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4410111-cd2e-40f6-b96e-ce3754a17829 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:17:33.584922 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7638e1c-d448-4b24-8280-ae4edba39a5f None None] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:33.585207 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7638e1c-d448-4b24-8280-ae4edba39a5f None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:33.585490 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7638e1c-d448-4b24-8280-ae4edba39a5f None None] PATH_INFO: `/` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:33.586866 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 283/573] 10.222.0.18 () {54 vars in 927 bytes} [Wed Oct 12 02:17:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 12 02:17:33.606162 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439e74ad-a69f-480a-812e-76fe118c907a None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:33.606504 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439e74ad-a69f-480a-812e-76fe118c907a None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:33.606711 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439e74ad-a69f-480a-812e-76fe118c907a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:33.629338 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de4967b-7d71-44f1-9e87-80467891de49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:17:33.629977 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de4967b-7d71-44f1-9e87-80467891de49 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:33.630316 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de4967b-7d71-44f1-9e87-80467891de49 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:33.630590 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de4967b-7d71-44f1-9e87-80467891de49 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:33.630789 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-439e74ad-a69f-480a-812e-76fe118c907a None None] MFA Rules not processed for user `a326a5bb7364479382f528a592371656`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:17:33.631980 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-439e74ad-a69f-480a-812e-76fe118c907a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:17:33.642667 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de4967b-7d71-44f1-9e87-80467891de49 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:17:33.645125 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de4967b-7d71-44f1-9e87-80467891de49 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:17:33.665007 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-3de4967b-7d71-44f1-9e87-80467891de49 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 02:17:33.665007 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 02:17:33.665007 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 02:17:33.665007 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 02:17:33.665007 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 02:17:33.665007 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 02:17:33.665007 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 02:17:33.665007 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 02:17:33.665007 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 02:17:33.665007 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 02:17:33.665007 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 02:17:33.665007 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 02:17:33.665007 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 12 02:17:33.665007 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 12 02:17:33.665007 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 12 02:17:33.665007 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 12 02:17:33.666073 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 02:17:33.666073 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 02:17:33.666073 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 02:17:33.666073 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 02:17:33.666073 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 02:17:33.666073 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 02:17:33.666073 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 02:17:33.666073 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Oct 12 02:17:33.666073 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 02:17:33.666073 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Oct 12 02:17:33.666073 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 02:17:33.666073 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 02:17:33.666073 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 02:17:33.666073 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Oct 12 02:17:33.666073 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 02:17:33.666073 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Oct 12 02:17:33.666073 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 12 02:17:33.666957 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 12 02:17:33.666957 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 02:17:33.666957 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Oct 12 02:17:33.667559 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 291/574] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Oct 12 02:17:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 354 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 02:17:33.673573 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de4967b-7d71-44f1-9e87-80467891de49 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:17:33.717464 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 284/575] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Oct 12 02:17:33 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 12 02:17:33.751535 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:17:33.811251 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de4967b-7d71-44f1-9e87-80467891de49 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:17:33.816218 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439e74ad-a69f-480a-812e-76fe118c907a None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:17:33.827959 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:17:33.877249 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a4c7e4-29e6-4ebc-8b20-4ce4b1c1e4dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:17:33.877865 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a4c7e4-29e6-4ebc-8b20-4ce4b1c1e4dd None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:33.878146 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a4c7e4-29e6-4ebc-8b20-4ce4b1c1e4dd None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:33.878421 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a4c7e4-29e6-4ebc-8b20-4ce4b1c1e4dd None admin] PATH_INFO: `/v3/domains` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:33.879668 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a4c7e4-29e6-4ebc-8b20-4ce4b1c1e4dd None admin] RBAC: Adding query filter params (name=Default) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 02:17:33.879968 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a4c7e4-29e6-4ebc-8b20-4ce4b1c1e4dd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:17:33.881443 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a4c7e4-29e6-4ebc-8b20-4ce4b1c1e4dd None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:17:33.898876 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 292/576] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Oct 12 02:17:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 02:17:33.904395 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a4c7e4-29e6-4ebc-8b20-4ce4b1c1e4dd None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:17:33.935163 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439e74ad-a69f-480a-812e-76fe118c907a None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:17:33.977674 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44170ad8-fbc7-46d9-bd74-938928ae1d48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:17:33.978305 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44170ad8-fbc7-46d9-bd74-938928ae1d48 None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:33.978580 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44170ad8-fbc7-46d9-bd74-938928ae1d48 None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:33.978852 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44170ad8-fbc7-46d9-bd74-938928ae1d48 None admin] PATH_INFO: `/v3/services/network` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:33.979429 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44170ad8-fbc7-46d9-bd74-938928ae1d48 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:17:33.980823 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44170ad8-fbc7-46d9-bd74-938928ae1d48 None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:17:33.999277 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application [None req-44170ad8-fbc7-46d9-bd74-938928ae1d48 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Oct 12 02:17:33.999277 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 02:17:33.999277 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 12 02:17:33.999277 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 12 02:17:33.999277 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 12 02:17:33.999277 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 12 02:17:33.999277 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 12 02:17:33.999277 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 12 02:17:33.999277 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 12 02:17:33.999277 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Oct 12 02:17:33.999277 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 12 02:17:33.999277 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Oct 12 02:17:33.999277 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 02:17:33.999277 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 02:17:33.999277 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 02:17:33.999277 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 02:17:33.999277 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 02:17:34.000310 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 02:17:34.000310 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 02:17:34.000310 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 02:17:34.000310 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 02:17:34.000310 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 02:17:34.000310 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 02:17:34.000310 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 12 02:17:34.000310 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 12 02:17:34.000310 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 12 02:17:34.000310 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 12 02:17:34.000310 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 02:17:34.000310 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 02:17:34.000310 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 02:17:34.000310 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 02:17:34.000310 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 02:17:34.000310 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 02:17:34.001260 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 02:17:34.001260 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application with Lock( Oct 12 02:17:34.001260 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 02:17:34.001260 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._enter() Oct 12 02:17:34.001260 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 02:17:34.001260 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 02:17:34.001260 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 02:17:34.001260 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.creator() Oct 12 02:17:34.001260 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 02:17:34.001260 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application created_value = creator( Oct 12 02:17:34.001260 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 12 02:17:34.001260 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 12 02:17:34.001260 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 12 02:17:34.001260 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Oct 12 02:17:34.004775 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 285/577] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Oct 12 02:17:33 2022] GET /identity/v3/services/network => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 12 02:17:34.007023 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44170ad8-fbc7-46d9-bd74-938928ae1d48 None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:17:34.089109 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a4c7e4-29e6-4ebc-8b20-4ce4b1c1e4dd None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:17:34.100219 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:17:34.123387 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:17:34.136316 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0d466a-6575-4353-b3a3-589e7a8ba441 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:17:34.137246 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0d466a-6575-4353-b3a3-589e7a8ba441 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:34.137732 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0d466a-6575-4353-b3a3-589e7a8ba441 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:34.138142 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0d466a-6575-4353-b3a3-589e7a8ba441 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:34.140761 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44170ad8-fbc7-46d9-bd74-938928ae1d48 None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:17:34.146135 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0d466a-6575-4353-b3a3-589e7a8ba441 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:17:34.147807 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0d466a-6575-4353-b3a3-589e7a8ba441 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:17:34.159644 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-3c0d466a-6575-4353-b3a3-589e7a8ba441 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 12 02:17:34.159644 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 02:17:34.159644 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 02:17:34.159644 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 02:17:34.159644 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 02:17:34.159644 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 02:17:34.159644 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 02:17:34.159644 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 02:17:34.159644 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 02:17:34.159644 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 02:17:34.159644 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 02:17:34.159644 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 02:17:34.159644 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 12 02:17:34.159644 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 12 02:17:34.159644 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 12 02:17:34.161052 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 12 02:17:34.161052 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 02:17:34.161052 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 02:17:34.161052 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 02:17:34.161052 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 02:17:34.161052 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 02:17:34.161052 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 02:17:34.161052 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 02:17:34.161052 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Oct 12 02:17:34.161052 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 02:17:34.161052 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Oct 12 02:17:34.161052 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 02:17:34.161052 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 02:17:34.161052 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 02:17:34.161052 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Oct 12 02:17:34.161052 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 02:17:34.161052 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Oct 12 02:17:34.162264 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 12 02:17:34.162264 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 12 02:17:34.162264 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 12 02:17:34.162264 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 12 02:17:34.162264 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 12 02:17:34.162264 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 12 02:17:34.162264 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 12 02:17:34.162264 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Oct 12 02:17:34.168734 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 293/578] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Oct 12 02:17:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 12 02:17:34.169745 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0d466a-6575-4353-b3a3-589e7a8ba441 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:17:34.177552 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96278603-7eaa-433a-bd24-7c0599b58df5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:17:34.178165 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96278603-7eaa-433a-bd24-7c0599b58df5 None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:34.178445 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96278603-7eaa-433a-bd24-7c0599b58df5 None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:34.178718 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96278603-7eaa-433a-bd24-7c0599b58df5 None admin] PATH_INFO: `/v3/services` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:34.179348 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96278603-7eaa-433a-bd24-7c0599b58df5 None admin] RBAC: Adding query filter params (name=network) {{(pid=81361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 02:17:34.179648 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96278603-7eaa-433a-bd24-7c0599b58df5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:17:34.181062 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96278603-7eaa-433a-bd24-7c0599b58df5 None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:17:34.185990 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 286/579] 10.222.0.18 () {56 vars in 1112 bytes} [Wed Oct 12 02:17:34 2022] GET /identity/v3/services?name=network => generated 124 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 02:17:34.186763 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96278603-7eaa-433a-bd24-7c0599b58df5 None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:17:34.279988 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0d466a-6575-4353-b3a3-589e7a8ba441 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:17:34.297580 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96278603-7eaa-433a-bd24-7c0599b58df5 None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:17:34.316329 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be98d012-d1d3-4be6-a8ad-36869096c90f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:17:34.317480 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be98d012-d1d3-4be6-a8ad-36869096c90f None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:34.317898 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be98d012-d1d3-4be6-a8ad-36869096c90f None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:34.318333 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be98d012-d1d3-4be6-a8ad-36869096c90f None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:34.319057 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be98d012-d1d3-4be6-a8ad-36869096c90f None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:17:34.320587 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be98d012-d1d3-4be6-a8ad-36869096c90f None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:17:34.333355 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-be98d012-d1d3-4be6-a8ad-36869096c90f None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 12 02:17:34.333355 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 02:17:34.333355 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 12 02:17:34.333355 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 12 02:17:34.333355 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 12 02:17:34.333355 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 12 02:17:34.333355 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 12 02:17:34.333355 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 12 02:17:34.333355 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 12 02:17:34.333355 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Oct 12 02:17:34.333355 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 12 02:17:34.333355 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Oct 12 02:17:34.333355 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 02:17:34.333355 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 02:17:34.333355 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 02:17:34.333355 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 02:17:34.333355 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 02:17:34.334637 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 02:17:34.334637 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 02:17:34.334637 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 02:17:34.334637 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 02:17:34.334637 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 02:17:34.334637 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 02:17:34.334637 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 12 02:17:34.334637 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 12 02:17:34.334637 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 12 02:17:34.334637 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 12 02:17:34.334637 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 02:17:34.334637 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 02:17:34.334637 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 02:17:34.334637 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 02:17:34.334637 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 02:17:34.334637 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 02:17:34.335724 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 02:17:34.335724 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Oct 12 02:17:34.335724 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 02:17:34.335724 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Oct 12 02:17:34.335724 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 02:17:34.335724 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 02:17:34.335724 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 02:17:34.335724 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Oct 12 02:17:34.335724 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 02:17:34.335724 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Oct 12 02:17:34.335724 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 12 02:17:34.335724 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 12 02:17:34.335724 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 12 02:17:34.335724 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Oct 12 02:17:34.336554 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13840d4a-89b6-4933-b712-2c88512e884b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:17:34.336554 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13840d4a-89b6-4933-b712-2c88512e884b None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:34.336554 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13840d4a-89b6-4933-b712-2c88512e884b None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:34.336554 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13840d4a-89b6-4933-b712-2c88512e884b None admin] PATH_INFO: `/v3/projects` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:34.336827 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13840d4a-89b6-4933-b712-2c88512e884b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 02:17:34.336893 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13840d4a-89b6-4933-b712-2c88512e884b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:17:34.344711 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13840d4a-89b6-4933-b712-2c88512e884b None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:17:34.344711 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:17:34.344945 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 294/580] 10.222.0.18 () {56 vars in 1129 bytes} [Wed Oct 12 02:17:34 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 02:17:34.344945 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be98d012-d1d3-4be6-a8ad-36869096c90f None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:17:34.353191 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 287/581] 10.222.0.18 () {56 vars in 1148 bytes} [Wed Oct 12 02:17:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 02:17:34.354028 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13840d4a-89b6-4933-b712-2c88512e884b None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:17:34.409493 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:17:34.466939 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be98d012-d1d3-4be6-a8ad-36869096c90f None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:17:34.467889 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13840d4a-89b6-4933-b712-2c88512e884b None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:17:34.507546 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b39145-e59e-4852-99b9-df758fb52281 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:17:34.508036 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3907b5-5a90-48a6-8869-19aa0cbf277c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:17:34.508188 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b39145-e59e-4852-99b9-df758fb52281 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:34.508411 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b39145-e59e-4852-99b9-df758fb52281 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:34.508682 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3907b5-5a90-48a6-8869-19aa0cbf277c None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:34.508787 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b39145-e59e-4852-99b9-df758fb52281 None admin] PATH_INFO: `/v3/services` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:34.508962 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3907b5-5a90-48a6-8869-19aa0cbf277c None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:34.509236 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3907b5-5a90-48a6-8869-19aa0cbf277c None admin] PATH_INFO: `/v3/services` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:34.509338 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b39145-e59e-4852-99b9-df758fb52281 None admin] RBAC: Adding query filter params (type=network) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 02:17:34.509607 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b39145-e59e-4852-99b9-df758fb52281 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:17:34.509860 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3907b5-5a90-48a6-8869-19aa0cbf277c None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 02:17:34.510162 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3907b5-5a90-48a6-8869-19aa0cbf277c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:17:34.510969 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b39145-e59e-4852-99b9-df758fb52281 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:17:34.511502 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3907b5-5a90-48a6-8869-19aa0cbf277c None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:17:34.516308 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 295/582] 10.222.0.18 () {56 vars in 1112 bytes} [Wed Oct 12 02:17:34 2022] GET /identity/v3/services?type=network => generated 350 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 02:17:34.517154 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b39145-e59e-4852-99b9-df758fb52281 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:17:34.525147 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 288/583] 10.222.0.18 () {56 vars in 1124 bytes} [Wed Oct 12 02:17:34 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 02:17:34.525857 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3907b5-5a90-48a6-8869-19aa0cbf277c None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:17:34.595992 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:17:34.643154 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3907b5-5a90-48a6-8869-19aa0cbf277c None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:17:34.645494 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b39145-e59e-4852-99b9-df758fb52281 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:17:34.660723 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:17:34.686542 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289588a6-5c08-4851-b7e3-ae47216e52de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:17:34.687154 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289588a6-5c08-4851-b7e3-ae47216e52de None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:34.687434 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289588a6-5c08-4851-b7e3-ae47216e52de None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:34.687707 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289588a6-5c08-4851-b7e3-ae47216e52de None admin] PATH_INFO: `/v3/endpoints` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:34.688410 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289588a6-5c08-4851-b7e3-ae47216e52de None admin] RBAC: Adding query filter params (interface=public, service_id=db805a170c5741bd997033e84a641606, region_id=RegionOne) {{(pid=81361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 02:17:34.688742 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289588a6-5c08-4851-b7e3-ae47216e52de None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:17:34.690138 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289588a6-5c08-4851-b7e3-ae47216e52de None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:17:34.693969 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ed9c10-a6f7-4a92-a07d-912ac88a43f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:17:34.694862 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ed9c10-a6f7-4a92-a07d-912ac88a43f0 None admin] REQUEST_METHOD: `PUT` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:34.695435 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ed9c10-a6f7-4a92-a07d-912ac88a43f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:34.695931 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ed9c10-a6f7-4a92-a07d-912ac88a43f0 None admin] PATH_INFO: `/v3/projects/beb6def6fcad45959e56425bb8bff4d1/users/8d0e2087e5324071926c3dc3a3cb9b1d/roles/91634b0ac542413bb04e5ce92e66459d` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:34.698911 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 289/584] 10.222.0.18 () {56 vars in 1251 bytes} [Wed Oct 12 02:17:34 2022] GET /identity/v3/endpoints?service_id=db805a170c5741bd997033e84a641606&interface=public®ion_id=RegionOne => generated 194 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 02:17:34.704203 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289588a6-5c08-4851-b7e3-ae47216e52de None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:17:34.719364 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ed9c10-a6f7-4a92-a07d-912ac88a43f0 None admin] RBAC: Authorizing `identity:create_grant(project_id=beb6def6fcad45959e56425bb8bff4d1, user_id=8d0e2087e5324071926c3dc3a3cb9b1d, role_id=91634b0ac542413bb04e5ce92e66459d)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:17:34.721277 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ed9c10-a6f7-4a92-a07d-912ac88a43f0 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:17:34.744718 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 296/585] 10.222.0.18 () {58 vars in 1439 bytes} [Wed Oct 12 02:17:34 2022] PUT /identity/v3/projects/beb6def6fcad45959e56425bb8bff4d1/users/8d0e2087e5324071926c3dc3a3cb9b1d/roles/91634b0ac542413bb04e5ce92e66459d => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 02:17:34.746680 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ed9c10-a6f7-4a92-a07d-912ac88a43f0 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:17:34.871104 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289588a6-5c08-4851-b7e3-ae47216e52de None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:17:34.924845 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:17:34.948584 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725972c4-4bab-4e81-926e-69d1a736f43f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:17:34.949213 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725972c4-4bab-4e81-926e-69d1a736f43f None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:34.949489 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725972c4-4bab-4e81-926e-69d1a736f43f None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:34.949760 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725972c4-4bab-4e81-926e-69d1a736f43f None admin] PATH_INFO: `/v3/services` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:34.950400 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725972c4-4bab-4e81-926e-69d1a736f43f None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 02:17:34.950705 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725972c4-4bab-4e81-926e-69d1a736f43f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:17:34.952094 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725972c4-4bab-4e81-926e-69d1a736f43f None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:17:34.963699 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ed9c10-a6f7-4a92-a07d-912ac88a43f0 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:17:34.970378 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 290/586] 10.222.0.18 () {56 vars in 1124 bytes} [Wed Oct 12 02:17:34 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 02:17:34.977184 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725972c4-4bab-4e81-926e-69d1a736f43f None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:17:35.009441 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1327627-d4df-4d8f-84a5-350c4a706946 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:17:35.010565 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1327627-d4df-4d8f-84a5-350c4a706946 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:35.011375 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1327627-d4df-4d8f-84a5-350c4a706946 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:35.011980 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1327627-d4df-4d8f-84a5-350c4a706946 None admin] PATH_INFO: `/v3/services` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:35.012956 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1327627-d4df-4d8f-84a5-350c4a706946 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:17:35.015417 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1327627-d4df-4d8f-84a5-350c4a706946 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:17:35.023048 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 297/587] 10.222.0.18 () {56 vars in 1087 bytes} [Wed Oct 12 02:17:34 2022] GET /identity/v3/services => generated 772 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 02:17:35.109511 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725972c4-4bab-4e81-926e-69d1a736f43f None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:17:35.150224 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28424fff-4f0e-4500-974f-82d7d11b82b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:17:35.151200 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28424fff-4f0e-4500-974f-82d7d11b82b4 None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:35.151653 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28424fff-4f0e-4500-974f-82d7d11b82b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:35.152111 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28424fff-4f0e-4500-974f-82d7d11b82b4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:35.153027 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28424fff-4f0e-4500-974f-82d7d11b82b4 None admin] RBAC: Adding query filter params (interface=public, service_id=eb48b336a3f34bef8777108d66cdb9c3, region_id=RegionOne) {{(pid=81361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 02:17:35.153512 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28424fff-4f0e-4500-974f-82d7d11b82b4 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:17:35.155140 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28424fff-4f0e-4500-974f-82d7d11b82b4 None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:17:35.161474 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 291/588] 10.222.0.18 () {56 vars in 1251 bytes} [Wed Oct 12 02:17:34 2022] GET /identity/v3/endpoints?service_id=eb48b336a3f34bef8777108d66cdb9c3&interface=public®ion_id=RegionOne => generated 194 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 02:17:35.167318 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1327627-d4df-4d8f-84a5-350c4a706946 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:17:35.201026 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076055d3-5a3b-496a-9b68-c33c1bb7da88 None None] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:35.201227 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076055d3-5a3b-496a-9b68-c33c1bb7da88 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:35.201594 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076055d3-5a3b-496a-9b68-c33c1bb7da88 None None] PATH_INFO: `/` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:35.203325 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 292/589] 10.222.0.18 () {54 vars in 927 bytes} [Wed Oct 12 02:17:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 02:17:35.209498 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87794f87-de47-44ab-bfa8-80b532c8852f None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:35.209842 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87794f87-de47-44ab-bfa8-80b532c8852f None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:35.210197 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87794f87-de47-44ab-bfa8-80b532c8852f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:35.219259 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:17:35.232087 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-87794f87-de47-44ab-bfa8-80b532c8852f None None] MFA Rules not processed for user `a326a5bb7364479382f528a592371656`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:17:35.233927 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-87794f87-de47-44ab-bfa8-80b532c8852f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:17:35.306265 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:17:35.328017 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1327627-d4df-4d8f-84a5-350c4a706946 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:17:35.329827 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 293/590] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Oct 12 02:17:35 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 12 02:17:35.371225 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27aea119-546c-4662-be3f-900f46c0305e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:17:35.371846 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27aea119-546c-4662-be3f-900f46c0305e None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:35.372125 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27aea119-546c-4662-be3f-900f46c0305e None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:35.372397 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27aea119-546c-4662-be3f-900f46c0305e None admin] PATH_INFO: `/v3/services` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:35.373039 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27aea119-546c-4662-be3f-900f46c0305e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:17:35.374431 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27aea119-546c-4662-be3f-900f46c0305e None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:17:35.381077 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 298/591] 10.222.0.18 () {56 vars in 1087 bytes} [Wed Oct 12 02:17:35 2022] GET /identity/v3/services => generated 772 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 02:17:35.693195 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87794f87-de47-44ab-bfa8-80b532c8852f None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:17:35.799192 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddeb9b30-c3a7-424f-9877-df92302fe334 None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:35.799676 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddeb9b30-c3a7-424f-9877-df92302fe334 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:35.799676 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddeb9b30-c3a7-424f-9877-df92302fe334 None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:35.801821 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 299/592] 10.222.0.18 () {54 vars in 927 bytes} [Wed Oct 12 02:17:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 02:17:35.802769 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87794f87-de47-44ab-bfa8-80b532c8852f None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:17:35.810762 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4f2481-8b4f-4309-bf44-77098dc34f0f None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:35.811044 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4f2481-8b4f-4309-bf44-77098dc34f0f None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:35.811324 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4f2481-8b4f-4309-bf44-77098dc34f0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:35.831017 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-7e4f2481-8b4f-4309-bf44-77098dc34f0f None None] MFA Rules not processed for user `a326a5bb7364479382f528a592371656`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:17:35.832853 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-7e4f2481-8b4f-4309-bf44-77098dc34f0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:17:35.858916 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61aa377a-13b4-4377-825e-1d311f928b9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:17:35.859556 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61aa377a-13b4-4377-825e-1d311f928b9a None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:35.859837 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61aa377a-13b4-4377-825e-1d311f928b9a None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:35.860109 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61aa377a-13b4-4377-825e-1d311f928b9a None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:35.860829 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61aa377a-13b4-4377-825e-1d311f928b9a None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:17:35.862317 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61aa377a-13b4-4377-825e-1d311f928b9a None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:17:35.881934 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application [None req-61aa377a-13b4-4377-825e-1d311f928b9a None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 12 02:17:35.881934 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 02:17:35.881934 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 12 02:17:35.881934 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 12 02:17:35.881934 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 12 02:17:35.881934 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 12 02:17:35.881934 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 12 02:17:35.881934 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 12 02:17:35.881934 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 12 02:17:35.881934 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Oct 12 02:17:35.881934 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 12 02:17:35.881934 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Oct 12 02:17:35.881934 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 02:17:35.881934 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 02:17:35.881934 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 02:17:35.881934 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 02:17:35.883344 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 02:17:35.883344 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 02:17:35.883344 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 02:17:35.883344 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 02:17:35.883344 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 02:17:35.883344 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 02:17:35.883344 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 02:17:35.883344 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 12 02:17:35.883344 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 12 02:17:35.883344 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 12 02:17:35.883344 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 12 02:17:35.883344 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 02:17:35.883344 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 02:17:35.883344 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 02:17:35.883344 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 02:17:35.883344 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 02:17:35.883344 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 02:17:35.884714 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 02:17:35.884714 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application with Lock( Oct 12 02:17:35.884714 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 02:17:35.884714 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._enter() Oct 12 02:17:35.884714 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 02:17:35.884714 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 02:17:35.884714 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 02:17:35.884714 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.creator() Oct 12 02:17:35.884714 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 02:17:35.884714 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application created_value = creator( Oct 12 02:17:35.884714 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 12 02:17:35.884714 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 12 02:17:35.884714 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 12 02:17:35.884714 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Oct 12 02:17:35.888898 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 294/593] 10.222.0.18 () {56 vars in 1132 bytes} [Wed Oct 12 02:17:35 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 02:17:35.889762 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61aa377a-13b4-4377-825e-1d311f928b9a None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:17:35.905563 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 300/594] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Oct 12 02:17:35 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 12 02:17:35.960951 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:17:36.034292 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61aa377a-13b4-4377-825e-1d311f928b9a None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:17:36.076050 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888f4030-1590-4fb8-847f-9ae93a841d54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:17:36.077006 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888f4030-1590-4fb8-847f-9ae93a841d54 None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:36.077501 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888f4030-1590-4fb8-847f-9ae93a841d54 None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:36.077994 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888f4030-1590-4fb8-847f-9ae93a841d54 None admin] PATH_INFO: `/v3/services` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:36.078823 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888f4030-1590-4fb8-847f-9ae93a841d54 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 02:17:36.079334 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888f4030-1590-4fb8-847f-9ae93a841d54 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:17:36.080920 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888f4030-1590-4fb8-847f-9ae93a841d54 None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:17:36.086474 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 295/595] 10.222.0.18 () {56 vars in 1126 bytes} [Wed Oct 12 02:17:35 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 02:17:36.091694 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4f2481-8b4f-4309-bf44-77098dc34f0f None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:17:36.139228 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:17:36.253086 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888f4030-1590-4fb8-847f-9ae93a841d54 None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:17:36.273751 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4f2481-8b4f-4309-bf44-77098dc34f0f None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:17:36.343541 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76307ec-f372-4348-b188-df4cc95a7db0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:17:36.344075 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76307ec-f372-4348-b188-df4cc95a7db0 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:36.344353 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76307ec-f372-4348-b188-df4cc95a7db0 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:36.344661 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76307ec-f372-4348-b188-df4cc95a7db0 None admin] PATH_INFO: `/v3/services` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:36.345299 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76307ec-f372-4348-b188-df4cc95a7db0 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 02:17:36.345602 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76307ec-f372-4348-b188-df4cc95a7db0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:17:36.346969 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76307ec-f372-4348-b188-df4cc95a7db0 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:17:36.352411 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 301/596] 10.222.0.18 () {56 vars in 1126 bytes} [Wed Oct 12 02:17:36 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 02:17:36.455477 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888f4030-1590-4fb8-847f-9ae93a841d54 None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:17:36.476957 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:17:36.515297 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af8f539-6df9-4d26-8d37-1b0faa1251ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:17:36.516245 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af8f539-6df9-4d26-8d37-1b0faa1251ef None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:36.516706 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af8f539-6df9-4d26-8d37-1b0faa1251ef None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:36.517116 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af8f539-6df9-4d26-8d37-1b0faa1251ef None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:36.542554 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af8f539-6df9-4d26-8d37-1b0faa1251ef None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 02:17:36.548736 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application [None req-9af8f539-6df9-4d26-8d37-1b0faa1251ef None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 12 02:17:36.548736 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 02:17:36.548736 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 02:17:36.548736 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 02:17:36.548736 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 02:17:36.548736 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 02:17:36.548736 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 02:17:36.548736 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 02:17:36.548736 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 02:17:36.548736 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 02:17:36.548736 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 02:17:36.548736 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 02:17:36.548736 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 12 02:17:36.548736 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 12 02:17:36.548736 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 12 02:17:36.548736 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 12 02:17:36.549720 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 12 02:17:36.549720 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 12 02:17:36.549720 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 12 02:17:36.549720 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 12 02:17:36.549720 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 02:17:36.549720 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 02:17:36.549720 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 02:17:36.549720 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 02:17:36.549720 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 02:17:36.549720 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 02:17:36.549720 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 02:17:36.549720 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application with Lock( Oct 12 02:17:36.549720 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 02:17:36.549720 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._enter() Oct 12 02:17:36.549720 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 02:17:36.549720 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 02:17:36.550546 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 02:17:36.550546 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.creator() Oct 12 02:17:36.550546 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 02:17:36.550546 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application created_value = creator( Oct 12 02:17:36.550546 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 12 02:17:36.550546 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 12 02:17:36.550546 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 12 02:17:36.550546 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 12 02:17:36.550546 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 12 02:17:36.550546 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 12 02:17:36.550546 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 12 02:17:36.550546 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Oct 12 02:17:36.553925 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 296/597] 10.222.0.18 () {56 vars in 1096 bytes} [Wed Oct 12 02:17:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 301 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 02:17:36.560080 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76307ec-f372-4348-b188-df4cc95a7db0 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:17:36.661468 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:17:36.678297 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76307ec-f372-4348-b188-df4cc95a7db0 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:17:36.713879 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648a703f-dd77-4871-9ad1-8cccdb350a65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:17:36.714489 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648a703f-dd77-4871-9ad1-8cccdb350a65 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:36.714756 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648a703f-dd77-4871-9ad1-8cccdb350a65 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:36.715026 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648a703f-dd77-4871-9ad1-8cccdb350a65 None admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:36.715690 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648a703f-dd77-4871-9ad1-8cccdb350a65 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 02:17:36.715989 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648a703f-dd77-4871-9ad1-8cccdb350a65 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:17:36.717371 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648a703f-dd77-4871-9ad1-8cccdb350a65 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:17:36.731770 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 302/598] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Oct 12 02:17:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 02:17:36.737674 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af8f539-6df9-4d26-8d37-1b0faa1251ef None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:17:36.863517 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af8f539-6df9-4d26-8d37-1b0faa1251ef None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:17:36.908021 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cabe448-27ba-4961-b781-7e8e50d07d35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:17:36.908696 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cabe448-27ba-4961-b781-7e8e50d07d35 None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:36.908940 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cabe448-27ba-4961-b781-7e8e50d07d35 None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:36.909194 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cabe448-27ba-4961-b781-7e8e50d07d35 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:36.922667 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cabe448-27ba-4961-b781-7e8e50d07d35 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:17:36.924158 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cabe448-27ba-4961-b781-7e8e50d07d35 None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:17:36.943788 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application [None req-6cabe448-27ba-4961-b781-7e8e50d07d35 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 02:17:36.943788 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 02:17:36.943788 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 02:17:36.943788 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 02:17:36.943788 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 02:17:36.943788 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 02:17:36.943788 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 02:17:36.943788 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 02:17:36.943788 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 02:17:36.943788 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 02:17:36.943788 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 02:17:36.943788 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 02:17:36.943788 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 12 02:17:36.943788 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 12 02:17:36.943788 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 12 02:17:36.943788 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 12 02:17:36.944872 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 02:17:36.944872 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 02:17:36.944872 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 02:17:36.944872 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 02:17:36.944872 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 02:17:36.944872 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 02:17:36.944872 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 02:17:36.944872 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application with Lock( Oct 12 02:17:36.944872 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 02:17:36.944872 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._enter() Oct 12 02:17:36.944872 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 02:17:36.944872 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 02:17:36.944872 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 02:17:36.944872 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.creator() Oct 12 02:17:36.944872 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 02:17:36.944872 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application created_value = creator( Oct 12 02:17:36.944872 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 12 02:17:36.946424 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 12 02:17:36.946424 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 02:17:36.946424 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Oct 12 02:17:36.946424 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 297/599] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Oct 12 02:17:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 02:17:36.950610 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648a703f-dd77-4871-9ad1-8cccdb350a65 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:17:37.078527 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648a703f-dd77-4871-9ad1-8cccdb350a65 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:17:37.122711 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169c2ee7-c331-42fd-a236-fe04f2070afd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:17:37.123318 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169c2ee7-c331-42fd-a236-fe04f2070afd None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:37.123594 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169c2ee7-c331-42fd-a236-fe04f2070afd None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:37.123863 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169c2ee7-c331-42fd-a236-fe04f2070afd None admin] PATH_INFO: `/v3/domains` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:37.124533 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169c2ee7-c331-42fd-a236-fe04f2070afd None admin] RBAC: Adding query filter params (name=Default) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 02:17:37.125022 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169c2ee7-c331-42fd-a236-fe04f2070afd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:17:37.126444 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169c2ee7-c331-42fd-a236-fe04f2070afd None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:17:37.138675 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 303/600] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Oct 12 02:17:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 02:17:37.144871 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cabe448-27ba-4961-b781-7e8e50d07d35 None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:17:37.170566 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:17:37.258351 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cabe448-27ba-4961-b781-7e8e50d07d35 None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:17:37.305738 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b523a9c0-1b99-46be-bc90-8b078a5fe3fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:17:37.306373 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b523a9c0-1b99-46be-bc90-8b078a5fe3fe None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:37.306653 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b523a9c0-1b99-46be-bc90-8b078a5fe3fe None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:37.306922 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b523a9c0-1b99-46be-bc90-8b078a5fe3fe None admin] PATH_INFO: `/v3/users/swift` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:37.315207 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b523a9c0-1b99-46be-bc90-8b078a5fe3fe None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:17:37.316856 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b523a9c0-1b99-46be-bc90-8b078a5fe3fe None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:17:37.333213 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application [None req-b523a9c0-1b99-46be-bc90-8b078a5fe3fe None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 12 02:17:37.333213 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 02:17:37.333213 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 02:17:37.333213 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 02:17:37.333213 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 02:17:37.333213 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 02:17:37.333213 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 02:17:37.333213 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 02:17:37.333213 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 02:17:37.333213 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 02:17:37.333213 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 02:17:37.333213 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 02:17:37.333213 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 12 02:17:37.333213 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 12 02:17:37.333213 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 12 02:17:37.333213 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 12 02:17:37.334192 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 02:17:37.334192 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 02:17:37.334192 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 12 02:17:37.334192 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 12 02:17:37.334192 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 12 02:17:37.334192 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 12 02:17:37.334192 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 02:17:37.334192 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 02:17:37.334192 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 02:17:37.334192 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 02:17:37.334192 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 02:17:37.334192 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application with Lock( Oct 12 02:17:37.334192 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 02:17:37.334192 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._enter() Oct 12 02:17:37.334192 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 02:17:37.334192 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 02:17:37.334192 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 02:17:37.334192 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.creator() Oct 12 02:17:37.335759 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 02:17:37.335759 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application created_value = creator( Oct 12 02:17:37.335759 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 12 02:17:37.335759 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 12 02:17:37.335759 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 12 02:17:37.335759 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 12 02:17:37.335759 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 12 02:17:37.335759 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 12 02:17:37.335759 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Oct 12 02:17:37.335759 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Oct 12 02:17:37.335759 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 298/601] 10.222.0.18 () {56 vars in 1096 bytes} [Wed Oct 12 02:17:37 2022] GET /identity/v3/users/swift => generated 83 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 02:17:37.340365 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169c2ee7-c331-42fd-a236-fe04f2070afd None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:17:37.349594 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:17:37.470937 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169c2ee7-c331-42fd-a236-fe04f2070afd None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:17:37.522613 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d533812-aea4-45d2-8986-7b0e95b8d687 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:17:37.523199 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d533812-aea4-45d2-8986-7b0e95b8d687 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:37.523479 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d533812-aea4-45d2-8986-7b0e95b8d687 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:37.523745 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d533812-aea4-45d2-8986-7b0e95b8d687 None admin] PATH_INFO: `/v3/users` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:37.524491 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d533812-aea4-45d2-8986-7b0e95b8d687 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 02:17:37.524851 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d533812-aea4-45d2-8986-7b0e95b8d687 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:17:37.526359 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d533812-aea4-45d2-8986-7b0e95b8d687 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:17:37.556118 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 304/602] 10.222.0.18 () {56 vars in 1135 bytes} [Wed Oct 12 02:17:37 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 02:17:37.561641 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b523a9c0-1b99-46be-bc90-8b078a5fe3fe None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:17:37.588319 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8766283b-d2f1-41ba-991a-cf26e244c90f None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:37.588710 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8766283b-d2f1-41ba-991a-cf26e244c90f None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:37.588988 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8766283b-d2f1-41ba-991a-cf26e244c90f None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:37.590497 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 305/603] 10.222.0.18 () {54 vars in 927 bytes} [Wed Oct 12 02:17:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 12 02:17:37.595409 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c6c07c-16d3-424e-9f22-9639f2cca934 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:37.595686 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c6c07c-16d3-424e-9f22-9639f2cca934 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:37.595955 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c6c07c-16d3-424e-9f22-9639f2cca934 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:37.620178 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-e7c6c07c-16d3-424e-9f22-9639f2cca934 None None] MFA Rules not processed for user `a326a5bb7364479382f528a592371656`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:17:37.621450 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-e7c6c07c-16d3-424e-9f22-9639f2cca934 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:17:37.686756 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:17:37.708839 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b523a9c0-1b99-46be-bc90-8b078a5fe3fe None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:17:37.754432 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8611c8f9-8501-45fa-a800-5e81e704adf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:17:37.755053 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8611c8f9-8501-45fa-a800-5e81e704adf2 None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:37.755391 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8611c8f9-8501-45fa-a800-5e81e704adf2 None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:37.755662 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8611c8f9-8501-45fa-a800-5e81e704adf2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:37.785487 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:17:37.800366 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 306/604] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Oct 12 02:17:37 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 12 02:17:37.850258 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8611c8f9-8501-45fa-a800-5e81e704adf2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:17:37.851708 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8611c8f9-8501-45fa-a800-5e81e704adf2 None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:17:37.935235 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:17:37.955221 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 299/605] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Oct 12 02:17:37 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 12 02:17:37.961663 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c6c07c-16d3-424e-9f22-9639f2cca934 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:17:38.073322 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c6c07c-16d3-424e-9f22-9639f2cca934 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:17:38.107723 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7474c7-7edd-4963-89fc-ab856c8f249c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:17:38.108366 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7474c7-7edd-4963-89fc-ab856c8f249c None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:38.108749 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7474c7-7edd-4963-89fc-ab856c8f249c None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:38.108950 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7474c7-7edd-4963-89fc-ab856c8f249c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:38.120973 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7474c7-7edd-4963-89fc-ab856c8f249c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:17:38.122442 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7474c7-7edd-4963-89fc-ab856c8f249c None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:17:38.137400 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-ba7474c7-7edd-4963-89fc-ab856c8f249c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 02:17:38.137400 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 02:17:38.137400 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 02:17:38.137400 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 02:17:38.137400 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 02:17:38.137400 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 02:17:38.137400 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 02:17:38.137400 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 02:17:38.137400 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 02:17:38.137400 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 02:17:38.137400 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 02:17:38.137400 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 02:17:38.137400 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 12 02:17:38.137400 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 12 02:17:38.137400 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 12 02:17:38.137400 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 12 02:17:38.138391 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 02:17:38.138391 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 02:17:38.138391 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 02:17:38.138391 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 02:17:38.138391 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 02:17:38.138391 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 02:17:38.138391 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 02:17:38.138391 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Oct 12 02:17:38.138391 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 02:17:38.138391 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Oct 12 02:17:38.138391 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 02:17:38.138391 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 02:17:38.138391 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 02:17:38.138391 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Oct 12 02:17:38.138391 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 02:17:38.138391 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Oct 12 02:17:38.138391 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 12 02:17:38.139335 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 12 02:17:38.139335 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 02:17:38.139335 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Oct 12 02:17:38.139335 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 307/606] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Oct 12 02:17:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 02:17:38.141229 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8611c8f9-8501-45fa-a800-5e81e704adf2 None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:17:38.153508 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7474c7-7edd-4963-89fc-ab856c8f249c None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:17:38.216367 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:17:38.263238 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8611c8f9-8501-45fa-a800-5e81e704adf2 None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:17:38.282419 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7474c7-7edd-4963-89fc-ab856c8f249c None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:17:38.301812 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0fe40c-70a0-4c33-be92-90a52107a2b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:17:38.302767 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0fe40c-70a0-4c33-be92-90a52107a2b7 None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:38.303356 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0fe40c-70a0-4c33-be92-90a52107a2b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:38.303843 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0fe40c-70a0-4c33-be92-90a52107a2b7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:38.318014 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0fe40c-70a0-4c33-be92-90a52107a2b7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 02:17:38.323579 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application [None req-4d0fe40c-70a0-4c33-be92-90a52107a2b7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 12 02:17:38.323579 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 02:17:38.323579 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 02:17:38.323579 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 02:17:38.323579 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 02:17:38.323579 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 02:17:38.323579 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 02:17:38.323579 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 02:17:38.323579 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 02:17:38.323579 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 02:17:38.323579 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 02:17:38.323579 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 02:17:38.323579 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 12 02:17:38.323579 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 12 02:17:38.323579 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 12 02:17:38.323579 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 12 02:17:38.324823 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 12 02:17:38.324823 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 12 02:17:38.324823 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 12 02:17:38.324823 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 12 02:17:38.324823 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 02:17:38.324823 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 02:17:38.324823 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 02:17:38.324823 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 02:17:38.324823 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 02:17:38.324823 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 02:17:38.324823 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 02:17:38.324823 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application with Lock( Oct 12 02:17:38.324823 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 02:17:38.324823 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._enter() Oct 12 02:17:38.324823 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 02:17:38.324823 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 02:17:38.325717 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 02:17:38.325717 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.creator() Oct 12 02:17:38.325717 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 02:17:38.325717 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application created_value = creator( Oct 12 02:17:38.325717 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 12 02:17:38.325717 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 12 02:17:38.325717 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 12 02:17:38.325717 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 12 02:17:38.325717 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 12 02:17:38.325717 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 12 02:17:38.325717 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 12 02:17:38.325717 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Oct 12 02:17:38.326481 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1610b1-3e07-47ea-847f-220d9226d8b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:17:38.326481 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1610b1-3e07-47ea-847f-220d9226d8b2 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:38.326481 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1610b1-3e07-47ea-847f-220d9226d8b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:38.326481 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1610b1-3e07-47ea-847f-220d9226d8b2 None admin] PATH_INFO: `/v3/domains` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:38.326761 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1610b1-3e07-47ea-847f-220d9226d8b2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 02:17:38.326839 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1610b1-3e07-47ea-847f-220d9226d8b2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:17:38.328229 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1610b1-3e07-47ea-847f-220d9226d8b2 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:17:38.329061 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 300/607] 10.222.0.18 () {56 vars in 1102 bytes} [Wed Oct 12 02:17:38 2022] GET /identity/v3/roles/service => generated 85 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 02:17:38.330644 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204937c4-bf3d-4465-bab2-c4e90558d571 None None] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:38.331217 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204937c4-bf3d-4465-bab2-c4e90558d571 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:38.331684 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204937c4-bf3d-4465-bab2-c4e90558d571 None None] PATH_INFO: `/` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:38.334693 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 301/608] 10.222.0.18 () {54 vars in 927 bytes} [Wed Oct 12 02:17:38 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 02:17:38.340090 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204937c4-bf3d-4465-bab2-c4e90558d571 None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:17:38.342214 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 308/609] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Oct 12 02:17:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 02:17:38.343790 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4720fd9e-bad5-4574-86ef-4b11686ce2e5 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:38.344081 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4720fd9e-bad5-4574-86ef-4b11686ce2e5 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:38.344351 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4720fd9e-bad5-4574-86ef-4b11686ce2e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:38.366410 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-4720fd9e-bad5-4574-86ef-4b11686ce2e5 None None] MFA Rules not processed for user `a326a5bb7364479382f528a592371656`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:17:38.368029 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-4720fd9e-bad5-4574-86ef-4b11686ce2e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:17:38.392688 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:17:38.454764 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 309/610] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Oct 12 02:17:38 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 12 02:17:38.455998 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4720fd9e-bad5-4574-86ef-4b11686ce2e5 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:17:38.473611 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204937c4-bf3d-4465-bab2-c4e90558d571 None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:17:38.501899 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:17:38.520607 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fae8442-5a0b-4bec-9c59-219ee9f33012 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:17:38.521226 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fae8442-5a0b-4bec-9c59-219ee9f33012 None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:38.521502 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fae8442-5a0b-4bec-9c59-219ee9f33012 None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:38.521769 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fae8442-5a0b-4bec-9c59-219ee9f33012 None admin] PATH_INFO: `/v3/roles` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:38.525127 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fae8442-5a0b-4bec-9c59-219ee9f33012 None admin] RBAC: Adding query filter params (name=service) {{(pid=81361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 02:17:38.525127 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fae8442-5a0b-4bec-9c59-219ee9f33012 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:17:38.525127 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fae8442-5a0b-4bec-9c59-219ee9f33012 None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:17:38.539955 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 302/611] 10.222.0.18 () {56 vars in 1103 bytes} [Wed Oct 12 02:17:38 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 02:17:38.539955 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c84282a-2d99-4139-8fbc-2a2632022474 None None] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:38.539955 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c84282a-2d99-4139-8fbc-2a2632022474 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:38.539955 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c84282a-2d99-4139-8fbc-2a2632022474 None None] PATH_INFO: `/` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:38.539955 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 303/612] 10.222.0.18 () {54 vars in 927 bytes} [Wed Oct 12 02:17:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 02:17:38.542705 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c84282a-2d99-4139-8fbc-2a2632022474 None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:17:38.605405 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4720fd9e-bad5-4574-86ef-4b11686ce2e5 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:17:38.641999 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54531891-1092-4a55-91a3-2c848ec08034 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:17:38.643075 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54531891-1092-4a55-91a3-2c848ec08034 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:38.643561 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54531891-1092-4a55-91a3-2c848ec08034 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:38.644062 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54531891-1092-4a55-91a3-2c848ec08034 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:38.652030 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54531891-1092-4a55-91a3-2c848ec08034 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:17:38.653841 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54531891-1092-4a55-91a3-2c848ec08034 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:17:38.671825 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-54531891-1092-4a55-91a3-2c848ec08034 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 12 02:17:38.671825 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 02:17:38.671825 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 02:17:38.671825 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 02:17:38.671825 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 02:17:38.671825 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 02:17:38.671825 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 02:17:38.671825 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 02:17:38.671825 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 02:17:38.671825 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 02:17:38.671825 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 02:17:38.671825 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 02:17:38.671825 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 12 02:17:38.671825 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 12 02:17:38.671825 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 12 02:17:38.672829 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 12 02:17:38.672829 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 02:17:38.672829 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 02:17:38.672829 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 02:17:38.672829 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 02:17:38.672829 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 02:17:38.672829 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 02:17:38.672829 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 02:17:38.672829 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Oct 12 02:17:38.672829 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 02:17:38.672829 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Oct 12 02:17:38.672829 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 02:17:38.672829 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 02:17:38.672829 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 02:17:38.672829 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Oct 12 02:17:38.672829 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 02:17:38.672829 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Oct 12 02:17:38.678942 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 12 02:17:38.678942 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 12 02:17:38.678942 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 12 02:17:38.678942 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 12 02:17:38.678942 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 12 02:17:38.678942 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 12 02:17:38.678942 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 12 02:17:38.678942 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Oct 12 02:17:38.678942 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 310/613] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Oct 12 02:17:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 02:17:38.678942 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a934106b-69b6-4f54-b12b-f03418a151f6 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:38.678942 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a934106b-69b6-4f54-b12b-f03418a151f6 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:38.679622 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a934106b-69b6-4f54-b12b-f03418a151f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:38.679690 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c84282a-2d99-4139-8fbc-2a2632022474 None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:17:38.684868 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:17:38.700361 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-a934106b-69b6-4f54-b12b-f03418a151f6 None None] MFA Rules not processed for user `a326a5bb7364479382f528a592371656`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:17:38.701891 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-a934106b-69b6-4f54-b12b-f03418a151f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:17:38.721866 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46d5b10-5d71-4623-ac13-77f3981a62b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:17:38.722992 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46d5b10-5d71-4623-ac13-77f3981a62b1 None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:38.723598 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46d5b10-5d71-4623-ac13-77f3981a62b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:38.724068 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46d5b10-5d71-4623-ac13-77f3981a62b1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:38.735730 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46d5b10-5d71-4623-ac13-77f3981a62b1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:17:38.737715 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46d5b10-5d71-4623-ac13-77f3981a62b1 None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:17:38.754897 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application [None req-d46d5b10-5d71-4623-ac13-77f3981a62b1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 02:17:38.754897 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 02:17:38.754897 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 02:17:38.754897 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 02:17:38.754897 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 02:17:38.754897 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 02:17:38.754897 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 02:17:38.754897 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 02:17:38.754897 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 02:17:38.754897 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 02:17:38.754897 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 02:17:38.754897 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 02:17:38.754897 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 12 02:17:38.754897 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 12 02:17:38.754897 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 12 02:17:38.754897 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 12 02:17:38.755939 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 02:17:38.755939 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 02:17:38.755939 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 02:17:38.755939 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 02:17:38.755939 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 02:17:38.755939 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 02:17:38.755939 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 02:17:38.755939 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application with Lock( Oct 12 02:17:38.755939 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 02:17:38.755939 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._enter() Oct 12 02:17:38.755939 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 02:17:38.755939 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 02:17:38.755939 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 02:17:38.755939 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.creator() Oct 12 02:17:38.755939 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 02:17:38.755939 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application created_value = creator( Oct 12 02:17:38.755939 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 12 02:17:38.756868 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 12 02:17:38.756868 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 02:17:38.756868 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Oct 12 02:17:38.760709 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 304/614] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Oct 12 02:17:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 02:17:38.761537 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46d5b10-5d71-4623-ac13-77f3981a62b1 None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:17:38.781547 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 311/615] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Oct 12 02:17:38 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 12 02:17:38.782380 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a934106b-69b6-4f54-b12b-f03418a151f6 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:17:38.815738 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:17:38.883082 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46d5b10-5d71-4623-ac13-77f3981a62b1 None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:17:38.911904 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a934106b-69b6-4f54-b12b-f03418a151f6 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:17:38.933702 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91e5478-fe9a-4b18-9d29-7171265d6fc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:17:38.934625 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91e5478-fe9a-4b18-9d29-7171265d6fc6 None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:38.935109 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91e5478-fe9a-4b18-9d29-7171265d6fc6 None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:38.937669 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91e5478-fe9a-4b18-9d29-7171265d6fc6 None admin] PATH_INFO: `/v3/projects` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:38.939649 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91e5478-fe9a-4b18-9d29-7171265d6fc6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 02:17:38.940248 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91e5478-fe9a-4b18-9d29-7171265d6fc6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:17:38.943399 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91e5478-fe9a-4b18-9d29-7171265d6fc6 None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:17:38.951319 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3603c0e6-662e-4884-b686-77c746fc3388 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:17:38.952060 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3603c0e6-662e-4884-b686-77c746fc3388 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:38.952795 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3603c0e6-662e-4884-b686-77c746fc3388 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:38.952992 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3603c0e6-662e-4884-b686-77c746fc3388 None admin] PATH_INFO: `/v3/services/network` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:38.953773 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3603c0e6-662e-4884-b686-77c746fc3388 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:17:38.955358 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3603c0e6-662e-4884-b686-77c746fc3388 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:17:38.959088 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 305/616] 10.222.0.18 () {56 vars in 1148 bytes} [Wed Oct 12 02:17:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 02:17:38.960196 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91e5478-fe9a-4b18-9d29-7171265d6fc6 None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:17:38.970704 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-3603c0e6-662e-4884-b686-77c746fc3388 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Oct 12 02:17:38.970704 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 02:17:38.970704 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 12 02:17:38.970704 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 12 02:17:38.970704 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 12 02:17:38.970704 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 12 02:17:38.970704 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 12 02:17:38.970704 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 12 02:17:38.970704 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 12 02:17:38.970704 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Oct 12 02:17:38.970704 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 12 02:17:38.970704 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Oct 12 02:17:38.970704 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 02:17:38.970704 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 02:17:38.970704 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 02:17:38.970704 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 02:17:38.970704 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 02:17:38.972415 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 02:17:38.972415 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 02:17:38.972415 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 02:17:38.972415 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 02:17:38.972415 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 02:17:38.972415 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 02:17:38.972415 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 12 02:17:38.972415 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 12 02:17:38.972415 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 12 02:17:38.972415 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 12 02:17:38.972415 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 02:17:38.972415 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 02:17:38.972415 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 02:17:38.972415 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 02:17:38.972415 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 02:17:38.972415 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 02:17:38.973805 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 02:17:38.973805 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Oct 12 02:17:38.973805 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 02:17:38.973805 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Oct 12 02:17:38.973805 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 02:17:38.973805 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 02:17:38.973805 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 02:17:38.973805 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Oct 12 02:17:38.973805 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 02:17:38.973805 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Oct 12 02:17:38.973805 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 12 02:17:38.973805 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 12 02:17:38.973805 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 12 02:17:38.973805 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Oct 12 02:17:38.979940 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 312/617] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Oct 12 02:17:38 2022] GET /identity/v3/services/network => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 02:17:38.979940 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3603c0e6-662e-4884-b686-77c746fc3388 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:17:38.991041 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:17:39.076254 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:17:39.081607 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91e5478-fe9a-4b18-9d29-7171265d6fc6 None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:17:39.086829 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3603c0e6-662e-4884-b686-77c746fc3388 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:17:39.117119 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4eb1c53-6134-46c6-b32e-2947ecc2806f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:17:39.117719 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4eb1c53-6134-46c6-b32e-2947ecc2806f None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:39.117994 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4eb1c53-6134-46c6-b32e-2947ecc2806f None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:39.118258 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4eb1c53-6134-46c6-b32e-2947ecc2806f None admin] PATH_INFO: `/v3/domains` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:39.118886 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4eb1c53-6134-46c6-b32e-2947ecc2806f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 02:17:39.119182 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4eb1c53-6134-46c6-b32e-2947ecc2806f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:17:39.120559 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4eb1c53-6134-46c6-b32e-2947ecc2806f None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:17:39.121009 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f570cd-fabc-435a-ae8f-3d031abe7ed6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:17:39.121613 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f570cd-fabc-435a-ae8f-3d031abe7ed6 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:39.121898 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f570cd-fabc-435a-ae8f-3d031abe7ed6 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:39.122189 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f570cd-fabc-435a-ae8f-3d031abe7ed6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:39.122922 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f570cd-fabc-435a-ae8f-3d031abe7ed6 None admin] RBAC: Adding query filter params (role.id=39b1e8108dff402383def3c559f48189, scope.project.id=beb6def6fcad45959e56425bb8bff4d1, user.id=af9bd50c42cc437dbdd5a431d8adbb26) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 02:17:39.123230 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f570cd-fabc-435a-ae8f-3d031abe7ed6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:17:39.124667 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f570cd-fabc-435a-ae8f-3d031abe7ed6 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:17:39.130380 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 313/618] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Oct 12 02:17:38 2022] GET /identity/v3/role_assignments?user.id=af9bd50c42cc437dbdd5a431d8adbb26&scope.project.id=beb6def6fcad45959e56425bb8bff4d1&role.id=39b1e8108dff402383def3c559f48189 => generated 608 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 02:17:39.131159 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f570cd-fabc-435a-ae8f-3d031abe7ed6 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:17:39.136206 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 306/619] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Oct 12 02:17:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 02:17:39.136206 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d3ec45-54fa-480c-8aa4-109e1ed8b19a None None] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:39.136206 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d3ec45-54fa-480c-8aa4-109e1ed8b19a None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:39.136206 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d3ec45-54fa-480c-8aa4-109e1ed8b19a None None] PATH_INFO: `/` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:39.136206 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 307/620] 10.222.0.18 () {54 vars in 927 bytes} [Wed Oct 12 02:17:39 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 02:17:39.136206 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d3ec45-54fa-480c-8aa4-109e1ed8b19a None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:17:39.226640 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:17:39.253716 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d3ec45-54fa-480c-8aa4-109e1ed8b19a None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:17:39.266530 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f570cd-fabc-435a-ae8f-3d031abe7ed6 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:17:39.293766 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffe1f1f-e953-4c00-a63f-8927c95c2e02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:17:39.294412 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffe1f1f-e953-4c00-a63f-8927c95c2e02 None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:39.294683 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffe1f1f-e953-4c00-a63f-8927c95c2e02 None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:39.294958 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffe1f1f-e953-4c00-a63f-8927c95c2e02 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:39.295548 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ffe1f1f-e953-4c00-a63f-8927c95c2e02 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:17:39.296957 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ffe1f1f-e953-4c00-a63f-8927c95c2e02 None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:17:39.306930 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application [None req-5ffe1f1f-e953-4c00-a63f-8927c95c2e02 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 12 02:17:39.306930 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 02:17:39.306930 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 12 02:17:39.306930 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 12 02:17:39.306930 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 12 02:17:39.306930 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 12 02:17:39.306930 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 12 02:17:39.306930 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 12 02:17:39.306930 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 12 02:17:39.306930 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Oct 12 02:17:39.306930 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 12 02:17:39.306930 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Oct 12 02:17:39.306930 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 02:17:39.306930 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 02:17:39.306930 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 02:17:39.306930 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 02:17:39.306930 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 02:17:39.308159 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 02:17:39.308159 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 02:17:39.308159 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 02:17:39.308159 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 02:17:39.308159 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 02:17:39.308159 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 02:17:39.308159 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 12 02:17:39.308159 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 12 02:17:39.308159 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 12 02:17:39.308159 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 12 02:17:39.308159 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 02:17:39.308159 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 02:17:39.308159 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 02:17:39.308159 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 02:17:39.308159 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 02:17:39.308159 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 02:17:39.309805 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 02:17:39.309805 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application with Lock( Oct 12 02:17:39.309805 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 02:17:39.309805 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._enter() Oct 12 02:17:39.309805 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 02:17:39.309805 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 02:17:39.309805 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 02:17:39.309805 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.creator() Oct 12 02:17:39.309805 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 02:17:39.309805 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application created_value = creator( Oct 12 02:17:39.309805 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 12 02:17:39.309805 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 12 02:17:39.309805 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 12 02:17:39.309805 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Oct 12 02:17:39.309805 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 308/621] 10.222.0.18 () {56 vars in 1129 bytes} [Wed Oct 12 02:17:39 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 02:17:39.310805 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffe1f1f-e953-4c00-a63f-8927c95c2e02 None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:17:39.313730 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7826826c-e974-4fda-b3b1-46711ff8b3d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:17:39.314456 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7826826c-e974-4fda-b3b1-46711ff8b3d7 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:39.314733 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7826826c-e974-4fda-b3b1-46711ff8b3d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:39.315001 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7826826c-e974-4fda-b3b1-46711ff8b3d7 None admin] PATH_INFO: `/v3/services` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:39.315636 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7826826c-e974-4fda-b3b1-46711ff8b3d7 None admin] RBAC: Adding query filter params (name=network) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 02:17:39.315994 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7826826c-e974-4fda-b3b1-46711ff8b3d7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:17:39.317921 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7826826c-e974-4fda-b3b1-46711ff8b3d7 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:17:39.322712 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 314/622] 10.222.0.18 () {56 vars in 1112 bytes} [Wed Oct 12 02:17:39 2022] GET /identity/v3/services?name=network => generated 124 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 02:17:39.324006 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d9ce96-3acd-4e2c-bf59-c7128c94fa5b None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:39.324290 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d9ce96-3acd-4e2c-bf59-c7128c94fa5b None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:39.324631 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d9ce96-3acd-4e2c-bf59-c7128c94fa5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:39.343710 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-a9d9ce96-3acd-4e2c-bf59-c7128c94fa5b None None] MFA Rules not processed for user `a326a5bb7364479382f528a592371656`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:17:39.344922 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-a9d9ce96-3acd-4e2c-bf59-c7128c94fa5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:17:39.359396 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:17:39.417443 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 315/623] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Oct 12 02:17:39 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 12 02:17:39.418174 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffe1f1f-e953-4c00-a63f-8927c95c2e02 None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:17:39.418841 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d9ce96-3acd-4e2c-bf59-c7128c94fa5b None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:17:39.468670 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e54a11a-392c-41e3-8e21-94a7288e67ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:17:39.469309 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e54a11a-392c-41e3-8e21-94a7288e67ba None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:39.469585 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e54a11a-392c-41e3-8e21-94a7288e67ba None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:39.469854 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e54a11a-392c-41e3-8e21-94a7288e67ba None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:39.480872 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e54a11a-392c-41e3-8e21-94a7288e67ba None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:17:39.482340 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e54a11a-392c-41e3-8e21-94a7288e67ba None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:17:39.486080 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:17:39.499405 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application [None req-1e54a11a-392c-41e3-8e21-94a7288e67ba None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 12 02:17:39.499405 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 02:17:39.499405 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 02:17:39.499405 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 02:17:39.499405 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 02:17:39.499405 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 02:17:39.499405 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 02:17:39.499405 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 02:17:39.499405 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 02:17:39.499405 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 02:17:39.499405 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 02:17:39.499405 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 02:17:39.499405 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 12 02:17:39.499405 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 12 02:17:39.499405 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 12 02:17:39.499405 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 12 02:17:39.500437 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 02:17:39.500437 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 02:17:39.500437 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 12 02:17:39.500437 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 12 02:17:39.500437 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 12 02:17:39.500437 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 12 02:17:39.500437 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 02:17:39.500437 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 02:17:39.500437 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 02:17:39.500437 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 02:17:39.500437 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 02:17:39.500437 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application with Lock( Oct 12 02:17:39.500437 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 02:17:39.500437 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._enter() Oct 12 02:17:39.500437 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 02:17:39.500437 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 02:17:39.500437 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 02:17:39.500437 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.creator() Oct 12 02:17:39.501429 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 02:17:39.501429 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application created_value = creator( Oct 12 02:17:39.501429 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 12 02:17:39.501429 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 12 02:17:39.501429 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 12 02:17:39.501429 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 12 02:17:39.501429 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 12 02:17:39.501429 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 12 02:17:39.501429 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 12 02:17:39.501429 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Oct 12 02:17:39.506007 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 309/624] 10.222.0.18 () {56 vars in 1117 bytes} [Wed Oct 12 02:17:39 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 02:17:39.507302 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e54a11a-392c-41e3-8e21-94a7288e67ba None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:17:39.555604 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d9ce96-3acd-4e2c-bf59-c7128c94fa5b None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:17:39.601194 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29617ac1-8e05-46b1-8066-f956dc0405c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:17:39.602291 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29617ac1-8e05-46b1-8066-f956dc0405c1 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:39.603574 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29617ac1-8e05-46b1-8066-f956dc0405c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:39.604678 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29617ac1-8e05-46b1-8066-f956dc0405c1 None admin] PATH_INFO: `/v3/services` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:39.605556 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29617ac1-8e05-46b1-8066-f956dc0405c1 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 02:17:39.606139 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29617ac1-8e05-46b1-8066-f956dc0405c1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:17:39.607828 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29617ac1-8e05-46b1-8066-f956dc0405c1 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:17:39.618835 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 316/625] 10.222.0.18 () {56 vars in 1124 bytes} [Wed Oct 12 02:17:39 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 02:17:39.620001 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29617ac1-8e05-46b1-8066-f956dc0405c1 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:17:39.638419 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:17:39.653745 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e54a11a-392c-41e3-8e21-94a7288e67ba None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:17:39.690410 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2914f6b-987d-48c3-838a-dcb11f8c9e69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:17:39.690936 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2914f6b-987d-48c3-838a-dcb11f8c9e69 None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:39.691275 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2914f6b-987d-48c3-838a-dcb11f8c9e69 None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:39.691570 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2914f6b-987d-48c3-838a-dcb11f8c9e69 None admin] PATH_INFO: `/v3/services` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:39.692259 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2914f6b-987d-48c3-838a-dcb11f8c9e69 None admin] RBAC: Adding query filter params (type=network) {{(pid=81361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 02:17:39.692602 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2914f6b-987d-48c3-838a-dcb11f8c9e69 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:17:39.694463 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2914f6b-987d-48c3-838a-dcb11f8c9e69 None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:17:39.699568 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 310/626] 10.222.0.18 () {56 vars in 1112 bytes} [Wed Oct 12 02:17:39 2022] GET /identity/v3/services?type=network => generated 350 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 02:17:39.700566 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2914f6b-987d-48c3-838a-dcb11f8c9e69 None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:17:39.734498 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29617ac1-8e05-46b1-8066-f956dc0405c1 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:17:39.771601 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902cb83b-a164-4735-a200-7108ee503f15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:17:39.772205 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902cb83b-a164-4735-a200-7108ee503f15 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:39.772669 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:17:39.772821 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902cb83b-a164-4735-a200-7108ee503f15 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:39.773370 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902cb83b-a164-4735-a200-7108ee503f15 None admin] PATH_INFO: `/v3/users` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:39.774089 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902cb83b-a164-4735-a200-7108ee503f15 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 02:17:39.774470 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902cb83b-a164-4735-a200-7108ee503f15 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:17:39.775931 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902cb83b-a164-4735-a200-7108ee503f15 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:17:39.799380 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 317/627] 10.222.0.18 () {56 vars in 1149 bytes} [Wed Oct 12 02:17:39 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 02:17:39.799380 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902cb83b-a164-4735-a200-7108ee503f15 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:17:39.823045 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2914f6b-987d-48c3-838a-dcb11f8c9e69 None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:17:39.858769 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1679c70-f136-4fc1-9fc9-8bee45ea7f68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:17:39.859369 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1679c70-f136-4fc1-9fc9-8bee45ea7f68 None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:39.859643 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1679c70-f136-4fc1-9fc9-8bee45ea7f68 None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:39.859910 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1679c70-f136-4fc1-9fc9-8bee45ea7f68 None admin] PATH_INFO: `/v3/services` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:39.860616 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1679c70-f136-4fc1-9fc9-8bee45ea7f68 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 02:17:39.860920 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1679c70-f136-4fc1-9fc9-8bee45ea7f68 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:17:39.862329 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1679c70-f136-4fc1-9fc9-8bee45ea7f68 None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:17:39.872357 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 311/628] 10.222.0.18 () {56 vars in 1124 bytes} [Wed Oct 12 02:17:39 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 02:17:39.872357 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1679c70-f136-4fc1-9fc9-8bee45ea7f68 None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:17:39.881836 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:17:39.915483 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902cb83b-a164-4735-a200-7108ee503f15 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:17:39.952167 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0081eca7-89c5-4cf6-8b44-89467efc65cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:17:39.952730 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0081eca7-89c5-4cf6-8b44-89467efc65cb None admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:39.953013 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0081eca7-89c5-4cf6-8b44-89467efc65cb None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:39.953284 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0081eca7-89c5-4cf6-8b44-89467efc65cb None admin] PATH_INFO: `/v3/endpoints` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:39.953955 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0081eca7-89c5-4cf6-8b44-89467efc65cb None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:17:39.955312 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0081eca7-89c5-4cf6-8b44-89467efc65cb None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:17:39.978651 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1679c70-f136-4fc1-9fc9-8bee45ea7f68 None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:17:39.989054 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 318/629] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Oct 12 02:17:39 2022] POST /identity/v3/endpoints => generated 337 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 02:17:39.989054 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0081eca7-89c5-4cf6-8b44-89467efc65cb None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:17:40.028185 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:17:40.053565 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26575ca-8993-464e-8540-173c2abf34a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:17:40.054383 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26575ca-8993-464e-8540-173c2abf34a2 None admin] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:40.054734 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26575ca-8993-464e-8540-173c2abf34a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:40.055083 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26575ca-8993-464e-8540-173c2abf34a2 None admin] PATH_INFO: `/v3/services` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:40.056220 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26575ca-8993-464e-8540-173c2abf34a2 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:17:40.058335 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26575ca-8993-464e-8540-173c2abf34a2 None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:17:40.088565 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 312/630] 10.222.0.18 () {60 vars in 1141 bytes} [Wed Oct 12 02:17:39 2022] POST /identity/v3/services => generated 269 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 02:17:40.088565 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26575ca-8993-464e-8540-173c2abf34a2 None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:17:40.160981 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0081eca7-89c5-4cf6-8b44-89467efc65cb None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:17:40.198995 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:17:40.221369 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcde5e1-aa18-456d-ab2a-9517b8953de9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:17:40.221926 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcde5e1-aa18-456d-ab2a-9517b8953de9 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:40.222232 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcde5e1-aa18-456d-ab2a-9517b8953de9 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:40.222587 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcde5e1-aa18-456d-ab2a-9517b8953de9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:40.282484 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26575ca-8993-464e-8540-173c2abf34a2 None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:17:40.318696 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bcde5e1-aa18-456d-ab2a-9517b8953de9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:17:40.320271 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bcde5e1-aa18-456d-ab2a-9517b8953de9 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:17:40.324426 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bccac5-acdb-4071-b9e2-6d87107090b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:17:40.325074 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bccac5-acdb-4071-b9e2-6d87107090b7 None admin] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:40.325351 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bccac5-acdb-4071-b9e2-6d87107090b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:40.325619 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bccac5-acdb-4071-b9e2-6d87107090b7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:40.326284 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74bccac5-acdb-4071-b9e2-6d87107090b7 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:17:40.327716 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74bccac5-acdb-4071-b9e2-6d87107090b7 None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:17:40.360231 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 313/631] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Oct 12 02:17:40 2022] POST /identity/v3/endpoints => generated 346 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 02:17:40.454660 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 319/632] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Oct 12 02:17:39 2022] GET /identity/v3/auth/tokens => generated 1271 bytes in 475 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 12 02:17:40.461405 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bccac5-acdb-4071-b9e2-6d87107090b7 None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:17:40.515422 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:17:40.596069 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bccac5-acdb-4071-b9e2-6d87107090b7 None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:17:40.633600 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61694198-82b7-4982-84db-7fbda5bbed54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:17:40.634236 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61694198-82b7-4982-84db-7fbda5bbed54 None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:40.634514 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61694198-82b7-4982-84db-7fbda5bbed54 None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:40.634787 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61694198-82b7-4982-84db-7fbda5bbed54 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:40.645544 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61694198-82b7-4982-84db-7fbda5bbed54 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:17:40.646995 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61694198-82b7-4982-84db-7fbda5bbed54 None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:17:40.663033 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application [None req-61694198-82b7-4982-84db-7fbda5bbed54 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 02:17:40.663033 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 02:17:40.663033 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 02:17:40.663033 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 02:17:40.663033 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 02:17:40.663033 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 02:17:40.663033 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 02:17:40.663033 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 02:17:40.663033 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 02:17:40.663033 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 02:17:40.663033 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 02:17:40.663033 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 02:17:40.663033 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 12 02:17:40.663033 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 12 02:17:40.663033 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 12 02:17:40.663033 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 12 02:17:40.664055 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 02:17:40.664055 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 02:17:40.664055 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 02:17:40.664055 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 02:17:40.664055 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 02:17:40.664055 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 02:17:40.664055 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 02:17:40.664055 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application with Lock( Oct 12 02:17:40.664055 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 02:17:40.664055 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._enter() Oct 12 02:17:40.664055 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 02:17:40.664055 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 02:17:40.664055 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 02:17:40.664055 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.creator() Oct 12 02:17:40.664055 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 02:17:40.664055 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application created_value = creator( Oct 12 02:17:40.664055 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 12 02:17:40.665065 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 12 02:17:40.665065 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 02:17:40.665065 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Oct 12 02:17:40.665065 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 314/633] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Oct 12 02:17:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 02:17:40.671871 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcde5e1-aa18-456d-ab2a-9517b8953de9 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:17:40.701412 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:17:40.798253 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcde5e1-aa18-456d-ab2a-9517b8953de9 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:17:40.840253 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77183a6b-574d-4d44-a2b0-3a2253a75edf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:17:40.841095 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77183a6b-574d-4d44-a2b0-3a2253a75edf None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:40.841532 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77183a6b-574d-4d44-a2b0-3a2253a75edf None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:40.841962 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77183a6b-574d-4d44-a2b0-3a2253a75edf None admin] PATH_INFO: `/v3/domains` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:40.843154 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77183a6b-574d-4d44-a2b0-3a2253a75edf None admin] RBAC: Adding query filter params (name=Default) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 02:17:40.843632 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77183a6b-574d-4d44-a2b0-3a2253a75edf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:17:40.845477 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77183a6b-574d-4d44-a2b0-3a2253a75edf None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:17:40.859705 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 320/634] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Oct 12 02:17:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 02:17:40.871743 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61694198-82b7-4982-84db-7fbda5bbed54 None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:17:40.978499 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:17:40.992791 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61694198-82b7-4982-84db-7fbda5bbed54 None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:17:41.028214 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23cc404-c8f8-4931-903f-a7bf2536932e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:17:41.028884 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23cc404-c8f8-4931-903f-a7bf2536932e None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:41.029185 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23cc404-c8f8-4931-903f-a7bf2536932e None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:41.029460 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23cc404-c8f8-4931-903f-a7bf2536932e None admin] PATH_INFO: `/v3/projects/service` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:41.036708 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23cc404-c8f8-4931-903f-a7bf2536932e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:17:41.038185 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23cc404-c8f8-4931-903f-a7bf2536932e None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:17:41.049860 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application [None req-e23cc404-c8f8-4931-903f-a7bf2536932e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 12 02:17:41.049860 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 02:17:41.049860 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 02:17:41.049860 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 02:17:41.049860 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 02:17:41.049860 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 02:17:41.049860 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 02:17:41.049860 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 02:17:41.049860 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 02:17:41.049860 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 02:17:41.049860 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 02:17:41.049860 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 02:17:41.049860 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 12 02:17:41.049860 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 12 02:17:41.049860 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 12 02:17:41.051442 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 12 02:17:41.051442 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 02:17:41.051442 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 02:17:41.051442 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 02:17:41.051442 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 02:17:41.051442 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 02:17:41.051442 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 02:17:41.051442 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 02:17:41.051442 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application with Lock( Oct 12 02:17:41.051442 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 02:17:41.051442 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._enter() Oct 12 02:17:41.051442 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 02:17:41.051442 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 02:17:41.051442 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 02:17:41.051442 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.creator() Oct 12 02:17:41.051442 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 02:17:41.051442 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application created_value = creator( Oct 12 02:17:41.053016 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 12 02:17:41.053016 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 12 02:17:41.053016 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 12 02:17:41.053016 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 12 02:17:41.053016 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 12 02:17:41.053016 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 12 02:17:41.053016 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 12 02:17:41.053016 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Oct 12 02:17:41.053016 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 315/635] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Oct 12 02:17:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 02:17:41.057159 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77183a6b-574d-4d44-a2b0-3a2253a75edf None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:17:41.154396 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:17:41.166656 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77183a6b-574d-4d44-a2b0-3a2253a75edf None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:17:41.201715 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337a61f5-cf5e-459c-a366-e5649ff5f42b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:17:41.202329 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337a61f5-cf5e-459c-a366-e5649ff5f42b None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:41.202606 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337a61f5-cf5e-459c-a366-e5649ff5f42b None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:41.202887 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337a61f5-cf5e-459c-a366-e5649ff5f42b None admin] PATH_INFO: `/v3/projects` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:41.203582 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337a61f5-cf5e-459c-a366-e5649ff5f42b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 02:17:41.203887 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337a61f5-cf5e-459c-a366-e5649ff5f42b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:17:41.205356 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337a61f5-cf5e-459c-a366-e5649ff5f42b None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:17:41.218729 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 321/636] 10.222.0.18 () {56 vars in 1148 bytes} [Wed Oct 12 02:17:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 02:17:41.225592 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23cc404-c8f8-4931-903f-a7bf2536932e None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:17:41.334825 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23cc404-c8f8-4931-903f-a7bf2536932e None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:17:41.369381 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa9b095-2583-45f5-8a1f-7a4678e746fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:17:41.369989 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa9b095-2583-45f5-8a1f-7a4678e746fd None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:41.370264 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa9b095-2583-45f5-8a1f-7a4678e746fd None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:41.370534 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa9b095-2583-45f5-8a1f-7a4678e746fd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:41.371261 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa9b095-2583-45f5-8a1f-7a4678e746fd None admin] RBAC: Adding query filter params (role.id=91634b0ac542413bb04e5ce92e66459d, scope.project.id=beb6def6fcad45959e56425bb8bff4d1, user.id=8d0e2087e5324071926c3dc3a3cb9b1d) {{(pid=81361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 02:17:41.371563 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa9b095-2583-45f5-8a1f-7a4678e746fd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:17:41.373031 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa9b095-2583-45f5-8a1f-7a4678e746fd None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:17:41.379929 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 316/637] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Oct 12 02:17:41 2022] GET /identity/v3/role_assignments?user.id=8d0e2087e5324071926c3dc3a3cb9b1d&scope.project.id=beb6def6fcad45959e56425bb8bff4d1&role.id=91634b0ac542413bb04e5ce92e66459d => generated 608 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 02:17:41.428722 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0ee404-9c63-4d22-bdca-1c4689802ec5 None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:41.429068 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0ee404-9c63-4d22-bdca-1c4689802ec5 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:41.429273 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0ee404-9c63-4d22-bdca-1c4689802ec5 None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:41.430913 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 322/638] 10.222.0.18 () {54 vars in 927 bytes} [Wed Oct 12 02:17:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 02:17:41.436738 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a7b5af-724f-46f9-9c5a-d8f5c11a42e6 None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:41.437069 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a7b5af-724f-46f9-9c5a-d8f5c11a42e6 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:41.437290 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a7b5af-724f-46f9-9c5a-d8f5c11a42e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:41.457488 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-26a7b5af-724f-46f9-9c5a-d8f5c11a42e6 None None] MFA Rules not processed for user `a326a5bb7364479382f528a592371656`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:17:41.458816 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-26a7b5af-724f-46f9-9c5a-d8f5c11a42e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:17:41.468119 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:17:41.546716 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 317/639] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Oct 12 02:17:41 2022] POST /identity/v3/auth/tokens => generated 1271 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 12 02:17:41.818351 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0ee404-9c63-4d22-bdca-1c4689802ec5 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:17:41.924128 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0ee404-9c63-4d22-bdca-1c4689802ec5 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:17:41.960049 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2546d3a-6445-4c01-8ed7-ed2eaeb8db0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:17:41.960709 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2546d3a-6445-4c01-8ed7-ed2eaeb8db0e None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:41.960993 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2546d3a-6445-4c01-8ed7-ed2eaeb8db0e None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:41.961267 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2546d3a-6445-4c01-8ed7-ed2eaeb8db0e None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:41.961857 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2546d3a-6445-4c01-8ed7-ed2eaeb8db0e None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:17:41.963213 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2546d3a-6445-4c01-8ed7-ed2eaeb8db0e None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:17:41.972183 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-e2546d3a-6445-4c01-8ed7-ed2eaeb8db0e None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 12 02:17:41.972183 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 02:17:41.972183 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 12 02:17:41.972183 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 12 02:17:41.972183 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 12 02:17:41.972183 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 12 02:17:41.972183 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 12 02:17:41.972183 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 12 02:17:41.972183 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 12 02:17:41.972183 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Oct 12 02:17:41.972183 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 12 02:17:41.972183 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Oct 12 02:17:41.972183 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 02:17:41.972183 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 02:17:41.972183 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 02:17:41.972183 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 02:17:41.972183 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 02:17:41.973406 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 02:17:41.973406 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 02:17:41.973406 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 02:17:41.973406 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 02:17:41.973406 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 02:17:41.973406 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 02:17:41.973406 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 12 02:17:41.973406 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 12 02:17:41.973406 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 12 02:17:41.973406 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 12 02:17:41.973406 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 02:17:41.973406 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 02:17:41.973406 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 02:17:41.973406 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 02:17:41.973406 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 02:17:41.973406 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 02:17:41.974832 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 02:17:41.974832 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Oct 12 02:17:41.974832 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 02:17:41.974832 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Oct 12 02:17:41.974832 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 02:17:41.974832 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 02:17:41.974832 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 02:17:41.974832 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Oct 12 02:17:41.974832 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 02:17:41.974832 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Oct 12 02:17:41.974832 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 12 02:17:41.974832 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 12 02:17:41.974832 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 12 02:17:41.974832 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Oct 12 02:17:41.974832 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 323/640] 10.222.0.18 () {56 vars in 1126 bytes} [Wed Oct 12 02:17:41 2022] GET /identity/v3/services/object-store => generated 93 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 02:17:41.979205 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a7b5af-724f-46f9-9c5a-d8f5c11a42e6 None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:17:42.084347 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a7b5af-724f-46f9-9c5a-d8f5c11a42e6 None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:17:42.120654 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c8deaa-583b-4388-8e64-b623e37b2a0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:17:42.121276 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c8deaa-583b-4388-8e64-b623e37b2a0d None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:42.121651 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c8deaa-583b-4388-8e64-b623e37b2a0d None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:42.121932 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c8deaa-583b-4388-8e64-b623e37b2a0d None admin] PATH_INFO: `/v3/services` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:42.122565 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c8deaa-583b-4388-8e64-b623e37b2a0d None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 02:17:42.122869 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c8deaa-583b-4388-8e64-b623e37b2a0d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:17:42.124239 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c8deaa-583b-4388-8e64-b623e37b2a0d None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:17:42.129815 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 318/641] 10.222.0.18 () {56 vars in 1122 bytes} [Wed Oct 12 02:17:41 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 02:17:42.137732 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2546d3a-6445-4c01-8ed7-ed2eaeb8db0e None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:17:42.148778 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:17:42.247413 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2546d3a-6445-4c01-8ed7-ed2eaeb8db0e None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:17:42.284508 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2772a36c-4425-4aa1-9519-f6c65ae671d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:17:42.285594 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2772a36c-4425-4aa1-9519-f6c65ae671d0 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:42.286080 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2772a36c-4425-4aa1-9519-f6c65ae671d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:42.286562 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2772a36c-4425-4aa1-9519-f6c65ae671d0 None admin] PATH_INFO: `/v3/services` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:42.287397 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2772a36c-4425-4aa1-9519-f6c65ae671d0 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 02:17:42.287905 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2772a36c-4425-4aa1-9519-f6c65ae671d0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:17:42.289504 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2772a36c-4425-4aa1-9519-f6c65ae671d0 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:17:42.295069 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 324/642] 10.222.0.18 () {56 vars in 1122 bytes} [Wed Oct 12 02:17:42 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 02:17:42.435059 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40443caa-80f4-4bba-8348-3b97a8b98c90 None None] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:42.435396 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40443caa-80f4-4bba-8348-3b97a8b98c90 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:42.435608 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40443caa-80f4-4bba-8348-3b97a8b98c90 None None] PATH_INFO: `/` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:42.437263 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 319/643] 10.222.0.18 () {54 vars in 927 bytes} [Wed Oct 12 02:17:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 02:17:42.443297 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8001048-5f0e-4311-8606-f4d4c6c3e01b None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:42.443593 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8001048-5f0e-4311-8606-f4d4c6c3e01b None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:42.443850 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8001048-5f0e-4311-8606-f4d4c6c3e01b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:42.463688 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-c8001048-5f0e-4311-8606-f4d4c6c3e01b None None] MFA Rules not processed for user `a326a5bb7364479382f528a592371656`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:17:42.464937 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-c8001048-5f0e-4311-8606-f4d4c6c3e01b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:17:42.540316 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:17:42.545649 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 325/644] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Oct 12 02:17:42 2022] POST /identity/v3/auth/tokens => generated 1271 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 12 02:17:42.793059 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7115924c-3a2e-4409-8d8a-b950aacdd28c None None] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:42.793499 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7115924c-3a2e-4409-8d8a-b950aacdd28c None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:42.793890 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7115924c-3a2e-4409-8d8a-b950aacdd28c None None] PATH_INFO: `/` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:42.795574 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 320/645] 10.222.0.18 () {54 vars in 927 bytes} [Wed Oct 12 02:17:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 02:17:42.801174 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5088d77c-80d9-417d-bd6f-b53e1c74ee36 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:42.801465 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5088d77c-80d9-417d-bd6f-b53e1c74ee36 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:42.801743 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5088d77c-80d9-417d-bd6f-b53e1c74ee36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:42.820451 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7115924c-3a2e-4409-8d8a-b950aacdd28c None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:17:42.823031 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-5088d77c-80d9-417d-bd6f-b53e1c74ee36 None None] MFA Rules not processed for user `a326a5bb7364479382f528a592371656`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:17:42.824452 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-5088d77c-80d9-417d-bd6f-b53e1c74ee36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:17:42.829763 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:17:42.902722 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 326/646] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Oct 12 02:17:42 2022] POST /identity/v3/auth/tokens => generated 1271 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 12 02:17:42.945695 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7115924c-3a2e-4409-8d8a-b950aacdd28c None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:17:42.981642 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bd55b0-214e-4488-a4d2-5dab23f7806f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:17:42.982640 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bd55b0-214e-4488-a4d2-5dab23f7806f None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:42.983113 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bd55b0-214e-4488-a4d2-5dab23f7806f None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:42.983604 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bd55b0-214e-4488-a4d2-5dab23f7806f None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:42.984375 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2bd55b0-214e-4488-a4d2-5dab23f7806f None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:17:42.986043 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2bd55b0-214e-4488-a4d2-5dab23f7806f None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:17:42.995749 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application [None req-c2bd55b0-214e-4488-a4d2-5dab23f7806f None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 12 02:17:42.995749 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 02:17:42.995749 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 12 02:17:42.995749 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 12 02:17:42.995749 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 12 02:17:42.995749 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 12 02:17:42.995749 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 12 02:17:42.995749 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 12 02:17:42.995749 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 12 02:17:42.995749 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Oct 12 02:17:42.995749 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 12 02:17:42.995749 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Oct 12 02:17:42.995749 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 02:17:42.995749 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 02:17:42.995749 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 02:17:42.995749 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 02:17:42.996729 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 02:17:42.996729 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 02:17:42.996729 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 02:17:42.996729 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 02:17:42.996729 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 02:17:42.996729 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 02:17:42.996729 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 02:17:42.996729 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 12 02:17:42.996729 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 12 02:17:42.996729 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 12 02:17:42.996729 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 12 02:17:42.996729 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 02:17:42.996729 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 02:17:42.996729 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 02:17:42.996729 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 02:17:42.996729 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 02:17:42.996729 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 02:17:42.997627 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 02:17:42.997627 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application with Lock( Oct 12 02:17:42.997627 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 02:17:42.997627 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._enter() Oct 12 02:17:42.997627 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 02:17:42.997627 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 02:17:42.997627 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 02:17:42.997627 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.creator() Oct 12 02:17:42.997627 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 02:17:42.997627 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application created_value = creator( Oct 12 02:17:42.997627 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 12 02:17:42.997627 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 12 02:17:42.997627 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 12 02:17:42.997627 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Oct 12 02:17:43.004583 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 321/647] 10.222.0.18 () {56 vars in 1132 bytes} [Wed Oct 12 02:17:42 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 02:17:43.006982 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5088d77c-80d9-417d-bd6f-b53e1c74ee36 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:17:43.116988 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5088d77c-80d9-417d-bd6f-b53e1c74ee36 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:17:43.148990 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:17:43.155840 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833ef72d-a303-492e-a98c-515e8238813d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:17:43.156462 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833ef72d-a303-492e-a98c-515e8238813d None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:43.157592 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833ef72d-a303-492e-a98c-515e8238813d None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:43.157889 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833ef72d-a303-492e-a98c-515e8238813d None admin] PATH_INFO: `/v3/services` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:43.158531 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833ef72d-a303-492e-a98c-515e8238813d None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 02:17:43.158834 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833ef72d-a303-492e-a98c-515e8238813d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:17:43.160301 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833ef72d-a303-492e-a98c-515e8238813d None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:17:43.165601 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 327/648] 10.222.0.18 () {56 vars in 1126 bytes} [Wed Oct 12 02:17:43 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 02:17:43.171170 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bd55b0-214e-4488-a4d2-5dab23f7806f None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:17:43.203153 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833ef72d-a303-492e-a98c-515e8238813d None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:17:43.258742 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:17:43.298093 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bd55b0-214e-4488-a4d2-5dab23f7806f None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:17:43.330350 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833ef72d-a303-492e-a98c-515e8238813d None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:17:43.334306 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84205b45-66f0-4f62-b813-028b5257edcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:17:43.335204 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84205b45-66f0-4f62-b813-028b5257edcf None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:43.335692 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84205b45-66f0-4f62-b813-028b5257edcf None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:43.336152 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84205b45-66f0-4f62-b813-028b5257edcf None admin] PATH_INFO: `/v3/services` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:43.337061 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84205b45-66f0-4f62-b813-028b5257edcf None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 02:17:43.337558 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84205b45-66f0-4f62-b813-028b5257edcf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:17:43.339115 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84205b45-66f0-4f62-b813-028b5257edcf None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:17:43.349201 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 322/649] 10.222.0.18 () {56 vars in 1126 bytes} [Wed Oct 12 02:17:43 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 02:17:43.350595 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84205b45-66f0-4f62-b813-028b5257edcf None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:17:43.371164 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd06e3b1-18e8-4f16-8f20-96e2168a4352 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:17:43.371728 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd06e3b1-18e8-4f16-8f20-96e2168a4352 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:43.372247 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd06e3b1-18e8-4f16-8f20-96e2168a4352 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:43.372589 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd06e3b1-18e8-4f16-8f20-96e2168a4352 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:43.373186 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd06e3b1-18e8-4f16-8f20-96e2168a4352 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:17:43.375006 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd06e3b1-18e8-4f16-8f20-96e2168a4352 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:17:43.387858 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-bd06e3b1-18e8-4f16-8f20-96e2168a4352 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 12 02:17:43.387858 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 02:17:43.387858 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 12 02:17:43.387858 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 12 02:17:43.387858 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 12 02:17:43.387858 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 12 02:17:43.387858 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 12 02:17:43.387858 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 12 02:17:43.387858 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 12 02:17:43.387858 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Oct 12 02:17:43.387858 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 12 02:17:43.387858 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Oct 12 02:17:43.387858 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 02:17:43.387858 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 02:17:43.387858 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 02:17:43.387858 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 02:17:43.387858 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 02:17:43.388920 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 02:17:43.388920 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 02:17:43.388920 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 02:17:43.388920 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 02:17:43.388920 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 02:17:43.388920 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 02:17:43.388920 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 12 02:17:43.388920 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 12 02:17:43.388920 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 12 02:17:43.388920 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 12 02:17:43.388920 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 02:17:43.388920 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 02:17:43.388920 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 02:17:43.388920 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 02:17:43.388920 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 02:17:43.388920 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 02:17:43.389773 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 02:17:43.389773 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Oct 12 02:17:43.389773 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 02:17:43.389773 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Oct 12 02:17:43.389773 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 02:17:43.389773 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 02:17:43.389773 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 02:17:43.389773 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Oct 12 02:17:43.389773 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 02:17:43.389773 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Oct 12 02:17:43.389773 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 12 02:17:43.389773 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 12 02:17:43.389773 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 12 02:17:43.389773 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Oct 12 02:17:43.394580 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 328/650] 10.222.0.18 () {56 vars in 1114 bytes} [Wed Oct 12 02:17:43 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 12 02:17:43.396504 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd06e3b1-18e8-4f16-8f20-96e2168a4352 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:17:43.468916 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84205b45-66f0-4f62-b813-028b5257edcf None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:17:43.474720 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:17:43.518554 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a652ee4d-d158-4388-83d0-b95531ca2af2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:17:43.519201 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a652ee4d-d158-4388-83d0-b95531ca2af2 None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:43.519479 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a652ee4d-d158-4388-83d0-b95531ca2af2 None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:43.519798 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a652ee4d-d158-4388-83d0-b95531ca2af2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:43.520454 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a652ee4d-d158-4388-83d0-b95531ca2af2 None admin] RBAC: Adding query filter params (interface=public, service_id=b312a40d8ba7473ca82b13d5f2241666, region_id=RegionOne) {{(pid=81361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 02:17:43.520787 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a652ee4d-d158-4388-83d0-b95531ca2af2 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:17:43.521917 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd06e3b1-18e8-4f16-8f20-96e2168a4352 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:17:43.525152 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a652ee4d-d158-4388-83d0-b95531ca2af2 None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:17:43.528123 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:17:43.544927 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 323/651] 10.222.0.18 () {56 vars in 1251 bytes} [Wed Oct 12 02:17:43 2022] GET /identity/v3/endpoints?service_id=b312a40d8ba7473ca82b13d5f2241666&interface=public®ion_id=RegionOne => generated 194 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 02:17:43.547551 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a652ee4d-d158-4388-83d0-b95531ca2af2 None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:17:43.583726 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2760e0-0e0e-4b87-85b1-5a7d27dacb1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:17:43.585307 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2760e0-0e0e-4b87-85b1-5a7d27dacb1e None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:43.585808 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2760e0-0e0e-4b87-85b1-5a7d27dacb1e None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:43.586317 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2760e0-0e0e-4b87-85b1-5a7d27dacb1e None admin] PATH_INFO: `/v3/services` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:43.587793 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2760e0-0e0e-4b87-85b1-5a7d27dacb1e None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 02:17:43.588428 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2760e0-0e0e-4b87-85b1-5a7d27dacb1e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:17:43.590059 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2760e0-0e0e-4b87-85b1-5a7d27dacb1e None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:17:43.601955 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 329/652] 10.222.0.18 () {56 vars in 1114 bytes} [Wed Oct 12 02:17:43 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 02:17:43.604395 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2760e0-0e0e-4b87-85b1-5a7d27dacb1e None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:17:43.687981 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a652ee4d-d158-4388-83d0-b95531ca2af2 None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:17:43.712142 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2760e0-0e0e-4b87-85b1-5a7d27dacb1e None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:17:43.724281 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7536f246-fe23-42e3-affc-cff05e427f1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:17:43.724914 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7536f246-fe23-42e3-affc-cff05e427f1e None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:43.725199 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7536f246-fe23-42e3-affc-cff05e427f1e None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:43.725469 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7536f246-fe23-42e3-affc-cff05e427f1e None admin] PATH_INFO: `/v3/services` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:43.726074 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7536f246-fe23-42e3-affc-cff05e427f1e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:17:43.727448 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7536f246-fe23-42e3-affc-cff05e427f1e None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:17:43.740498 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 324/653] 10.222.0.18 () {56 vars in 1087 bytes} [Wed Oct 12 02:17:43 2022] GET /identity/v3/services => generated 1029 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 12 02:17:43.740498 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b03eb8-b0bd-4b2e-bc36-0a08b4de5ce0 None None] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:43.740498 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b03eb8-b0bd-4b2e-bc36-0a08b4de5ce0 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:43.740498 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b03eb8-b0bd-4b2e-bc36-0a08b4de5ce0 None None] PATH_INFO: `/` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:43.740923 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 325/654] 10.222.0.18 () {54 vars in 927 bytes} [Wed Oct 12 02:17:43 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 02:17:43.742626 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f85eb6-e19d-4b6d-8cfd-e6a7c7a5f346 None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:43.742912 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f85eb6-e19d-4b6d-8cfd-e6a7c7a5f346 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:43.743188 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f85eb6-e19d-4b6d-8cfd-e6a7c7a5f346 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:43.745430 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:17:43.760562 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b89700d-4e8a-4a5c-8888-7c6eb5399f18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:17:43.761556 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b89700d-4e8a-4a5c-8888-7c6eb5399f18 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:43.762031 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b89700d-4e8a-4a5c-8888-7c6eb5399f18 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:43.762504 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b89700d-4e8a-4a5c-8888-7c6eb5399f18 None admin] PATH_INFO: `/v3/services` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:43.763466 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b89700d-4e8a-4a5c-8888-7c6eb5399f18 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 02:17:43.764009 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b89700d-4e8a-4a5c-8888-7c6eb5399f18 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:17:43.764115 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-50f85eb6-e19d-4b6d-8cfd-e6a7c7a5f346 None None] MFA Rules not processed for user `a326a5bb7364479382f528a592371656`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:17:43.765527 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-50f85eb6-e19d-4b6d-8cfd-e6a7c7a5f346 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:17:43.766030 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b89700d-4e8a-4a5c-8888-7c6eb5399f18 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:17:43.773595 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 330/655] 10.222.0.18 () {56 vars in 1114 bytes} [Wed Oct 12 02:17:43 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 02:17:43.834742 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:17:43.849148 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 326/656] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Oct 12 02:17:43 2022] POST /identity/v3/auth/tokens => generated 1271 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 12 02:17:44.134527 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b89700d-4e8a-4a5c-8888-7c6eb5399f18 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:17:44.241705 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b89700d-4e8a-4a5c-8888-7c6eb5399f18 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:17:44.277053 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffd0ca1-53d6-4795-bd33-f11a04d2822b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:17:44.277685 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffd0ca1-53d6-4795-bd33-f11a04d2822b None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:44.277961 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffd0ca1-53d6-4795-bd33-f11a04d2822b None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:44.278231 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffd0ca1-53d6-4795-bd33-f11a04d2822b None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:44.289734 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ffd0ca1-53d6-4795-bd33-f11a04d2822b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 02:17:44.294976 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-2ffd0ca1-53d6-4795-bd33-f11a04d2822b None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 12 02:17:44.294976 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 02:17:44.294976 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 02:17:44.294976 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 02:17:44.294976 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 02:17:44.294976 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 02:17:44.294976 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 02:17:44.294976 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 02:17:44.294976 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 02:17:44.294976 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 02:17:44.294976 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 02:17:44.294976 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 02:17:44.294976 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 12 02:17:44.294976 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 12 02:17:44.294976 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 12 02:17:44.294976 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 12 02:17:44.295899 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 12 02:17:44.295899 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 12 02:17:44.295899 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 12 02:17:44.295899 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 12 02:17:44.295899 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 02:17:44.295899 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 02:17:44.295899 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 02:17:44.295899 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 02:17:44.295899 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 02:17:44.295899 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 02:17:44.295899 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 02:17:44.295899 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Oct 12 02:17:44.295899 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 02:17:44.295899 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Oct 12 02:17:44.295899 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 02:17:44.295899 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 02:17:44.296936 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 02:17:44.296936 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Oct 12 02:17:44.296936 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 02:17:44.296936 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Oct 12 02:17:44.296936 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 12 02:17:44.296936 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 12 02:17:44.296936 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 12 02:17:44.296936 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 12 02:17:44.296936 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 12 02:17:44.296936 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 12 02:17:44.296936 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 12 02:17:44.296936 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Oct 12 02:17:44.296936 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 331/657] 10.222.0.18 () {56 vars in 1120 bytes} [Wed Oct 12 02:17:44 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 02:17:44.302657 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f85eb6-e19d-4b6d-8cfd-e6a7c7a5f346 None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:17:44.414849 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f85eb6-e19d-4b6d-8cfd-e6a7c7a5f346 None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:17:44.454955 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffefce99-996f-4ace-8fb0-45f87acc2fae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:17:44.455903 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffefce99-996f-4ace-8fb0-45f87acc2fae None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:44.456425 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffefce99-996f-4ace-8fb0-45f87acc2fae None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:44.456889 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffefce99-996f-4ace-8fb0-45f87acc2fae None admin] PATH_INFO: `/v3/roles` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:44.457867 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffefce99-996f-4ace-8fb0-45f87acc2fae None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 02:17:44.458341 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffefce99-996f-4ace-8fb0-45f87acc2fae None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:17:44.459882 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffefce99-996f-4ace-8fb0-45f87acc2fae None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:17:44.469028 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 327/658] 10.222.0.18 () {56 vars in 1115 bytes} [Wed Oct 12 02:17:44 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 02:17:44.477848 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffd0ca1-53d6-4795-bd33-f11a04d2822b None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:17:44.532993 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:17:44.541394 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186fb402-a1ec-4e04-8a79-6e4950ee9c6b None None] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:44.541923 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186fb402-a1ec-4e04-8a79-6e4950ee9c6b None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:44.542414 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186fb402-a1ec-4e04-8a79-6e4950ee9c6b None None] PATH_INFO: `/` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:44.544250 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 328/659] 10.222.0.18 () {54 vars in 927 bytes} [Wed Oct 12 02:17:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 02:17:44.549555 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328e6709-18b3-4089-93a8-f3dbb160aa36 None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:44.549840 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328e6709-18b3-4089-93a8-f3dbb160aa36 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:44.550442 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328e6709-18b3-4089-93a8-f3dbb160aa36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:44.570535 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-328e6709-18b3-4089-93a8-f3dbb160aa36 None None] MFA Rules not processed for user `a326a5bb7364479382f528a592371656`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:17:44.571839 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-328e6709-18b3-4089-93a8-f3dbb160aa36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:17:44.594379 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffd0ca1-53d6-4795-bd33-f11a04d2822b None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:17:44.626751 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:17:44.630599 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9d4ec8-6fb8-41d5-9dad-39368b91446a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:17:44.631247 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9d4ec8-6fb8-41d5-9dad-39368b91446a None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:44.631526 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9d4ec8-6fb8-41d5-9dad-39368b91446a None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:44.631797 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9d4ec8-6fb8-41d5-9dad-39368b91446a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:44.645608 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9d4ec8-6fb8-41d5-9dad-39368b91446a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:17:44.647128 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9d4ec8-6fb8-41d5-9dad-39368b91446a None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:17:44.649047 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 329/660] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Oct 12 02:17:44 2022] POST /identity/v3/auth/tokens => generated 1271 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 12 02:17:44.670139 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-fc9d4ec8-6fb8-41d5-9dad-39368b91446a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 02:17:44.670139 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 02:17:44.670139 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 02:17:44.670139 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 02:17:44.670139 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 02:17:44.670139 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 02:17:44.670139 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 02:17:44.670139 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 02:17:44.670139 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 02:17:44.670139 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 02:17:44.670139 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 02:17:44.670139 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 02:17:44.670139 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 12 02:17:44.670139 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 12 02:17:44.670139 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 12 02:17:44.670139 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 12 02:17:44.671089 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 02:17:44.671089 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 02:17:44.671089 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 02:17:44.671089 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 02:17:44.671089 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 02:17:44.671089 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 02:17:44.671089 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 02:17:44.671089 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Oct 12 02:17:44.671089 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 02:17:44.671089 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Oct 12 02:17:44.671089 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 02:17:44.671089 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 02:17:44.671089 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 02:17:44.671089 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Oct 12 02:17:44.671089 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 02:17:44.671089 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Oct 12 02:17:44.671089 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 12 02:17:44.671971 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 12 02:17:44.671971 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 02:17:44.671971 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Oct 12 02:17:44.674097 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 332/661] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Oct 12 02:17:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 02:17:44.680458 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328e6709-18b3-4089-93a8-f3dbb160aa36 None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:17:44.790945 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328e6709-18b3-4089-93a8-f3dbb160aa36 None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:17:44.825567 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620bd51e-dd5b-4170-979f-8fcc007c9040 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:17:44.826180 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620bd51e-dd5b-4170-979f-8fcc007c9040 None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:44.826514 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620bd51e-dd5b-4170-979f-8fcc007c9040 None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:44.826785 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620bd51e-dd5b-4170-979f-8fcc007c9040 None admin] PATH_INFO: `/v3/domains` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:44.827471 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620bd51e-dd5b-4170-979f-8fcc007c9040 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 02:17:44.827774 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620bd51e-dd5b-4170-979f-8fcc007c9040 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:17:44.829162 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620bd51e-dd5b-4170-979f-8fcc007c9040 None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:17:44.841566 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 330/662] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Oct 12 02:17:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 02:17:44.847596 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9d4ec8-6fb8-41d5-9dad-39368b91446a None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:17:44.936124 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620bd51e-dd5b-4170-979f-8fcc007c9040 None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:17:44.948641 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:17:44.957045 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9d4ec8-6fb8-41d5-9dad-39368b91446a None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:17:44.997099 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdc9618-2fa7-44d6-8656-5dc1b4567a81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:17:44.998439 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdc9618-2fa7-44d6-8656-5dc1b4567a81 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:44.999229 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdc9618-2fa7-44d6-8656-5dc1b4567a81 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:44.999855 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdc9618-2fa7-44d6-8656-5dc1b4567a81 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:45.001671 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:17:45.009574 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bdc9618-2fa7-44d6-8656-5dc1b4567a81 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:17:45.011474 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bdc9618-2fa7-44d6-8656-5dc1b4567a81 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:17:45.025642 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-6bdc9618-2fa7-44d6-8656-5dc1b4567a81 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 12 02:17:45.025642 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 02:17:45.025642 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 02:17:45.025642 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 02:17:45.025642 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 02:17:45.025642 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 02:17:45.025642 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 02:17:45.025642 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 02:17:45.025642 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 02:17:45.025642 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 02:17:45.025642 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 02:17:45.025642 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 02:17:45.025642 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 12 02:17:45.025642 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 12 02:17:45.025642 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 12 02:17:45.025642 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 12 02:17:45.026589 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 02:17:45.026589 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 02:17:45.026589 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 12 02:17:45.026589 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 12 02:17:45.026589 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 12 02:17:45.026589 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 12 02:17:45.026589 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 02:17:45.026589 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 02:17:45.026589 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 02:17:45.026589 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 02:17:45.026589 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 02:17:45.026589 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Oct 12 02:17:45.026589 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 02:17:45.026589 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Oct 12 02:17:45.026589 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 02:17:45.026589 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 02:17:45.026589 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 02:17:45.026589 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Oct 12 02:17:45.027524 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 02:17:45.027524 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Oct 12 02:17:45.027524 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 12 02:17:45.027524 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 12 02:17:45.027524 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 12 02:17:45.027524 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 12 02:17:45.027524 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 12 02:17:45.027524 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 12 02:17:45.027524 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 12 02:17:45.027524 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Oct 12 02:17:45.030150 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 333/663] 10.222.0.18 () {56 vars in 1117 bytes} [Wed Oct 12 02:17:44 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 02:17:45.035461 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdc9618-2fa7-44d6-8656-5dc1b4567a81 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:17:45.073093 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620bd51e-dd5b-4170-979f-8fcc007c9040 None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:17:45.120253 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1e5049-f9bf-4541-b6b0-6be9c8e73019 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:17:45.120907 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1e5049-f9bf-4541-b6b0-6be9c8e73019 None admin] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:45.121192 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1e5049-f9bf-4541-b6b0-6be9c8e73019 None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:45.121467 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1e5049-f9bf-4541-b6b0-6be9c8e73019 None admin] PATH_INFO: `/v3/services` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:45.122146 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1e5049-f9bf-4541-b6b0-6be9c8e73019 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:17:45.123534 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1e5049-f9bf-4541-b6b0-6be9c8e73019 None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:17:45.148575 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 331/664] 10.222.0.18 () {60 vars in 1141 bytes} [Wed Oct 12 02:17:44 2022] POST /identity/v3/services => generated 241 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 02:17:45.168501 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdc9618-2fa7-44d6-8656-5dc1b4567a81 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:17:45.215035 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2663f8-3845-45ee-b904-77224303ca7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:17:45.216076 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2663f8-3845-45ee-b904-77224303ca7c None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:45.216571 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2663f8-3845-45ee-b904-77224303ca7c None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:45.217037 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2663f8-3845-45ee-b904-77224303ca7c None admin] PATH_INFO: `/v3/users` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:45.218055 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2663f8-3845-45ee-b904-77224303ca7c None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 02:17:45.218582 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2663f8-3845-45ee-b904-77224303ca7c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:17:45.220245 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2663f8-3845-45ee-b904-77224303ca7c None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:17:45.247387 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 334/665] 10.222.0.18 () {56 vars in 1149 bytes} [Wed Oct 12 02:17:45 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 02:17:45.254942 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1e5049-f9bf-4541-b6b0-6be9c8e73019 None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:17:45.367111 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1e5049-f9bf-4541-b6b0-6be9c8e73019 None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:17:45.369486 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:17:45.405454 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80479133-15d3-492c-adb2-17ac768f99d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:17:45.406091 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80479133-15d3-492c-adb2-17ac768f99d4 None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:45.406369 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80479133-15d3-492c-adb2-17ac768f99d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:45.406641 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80479133-15d3-492c-adb2-17ac768f99d4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:45.418177 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80479133-15d3-492c-adb2-17ac768f99d4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:17:45.419636 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80479133-15d3-492c-adb2-17ac768f99d4 None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:17:45.435319 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application [None req-80479133-15d3-492c-adb2-17ac768f99d4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 02:17:45.435319 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 02:17:45.435319 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 02:17:45.435319 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 02:17:45.435319 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 02:17:45.435319 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 02:17:45.435319 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 02:17:45.435319 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 02:17:45.435319 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 02:17:45.435319 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 02:17:45.435319 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 02:17:45.435319 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 02:17:45.435319 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 12 02:17:45.435319 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 12 02:17:45.435319 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 12 02:17:45.435319 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 12 02:17:45.436543 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 02:17:45.436543 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 02:17:45.436543 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 02:17:45.436543 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 02:17:45.436543 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 02:17:45.436543 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 02:17:45.436543 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 02:17:45.436543 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application with Lock( Oct 12 02:17:45.436543 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 02:17:45.436543 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._enter() Oct 12 02:17:45.436543 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 02:17:45.436543 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 02:17:45.436543 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 02:17:45.436543 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.creator() Oct 12 02:17:45.436543 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 02:17:45.436543 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application created_value = creator( Oct 12 02:17:45.436543 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 12 02:17:45.437937 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 12 02:17:45.437937 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 02:17:45.437937 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Oct 12 02:17:45.437937 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 332/666] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Oct 12 02:17:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 02:17:45.442688 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2663f8-3845-45ee-b904-77224303ca7c None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:17:45.458108 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:17:45.548947 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2663f8-3845-45ee-b904-77224303ca7c None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:17:45.587149 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63973a2-373d-4ca7-8885-f83fd7b96bb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:17:45.587764 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63973a2-373d-4ca7-8885-f83fd7b96bb8 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:45.588042 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63973a2-373d-4ca7-8885-f83fd7b96bb8 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:45.588313 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63973a2-373d-4ca7-8885-f83fd7b96bb8 None admin] PATH_INFO: `/v3/domains` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:45.588990 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63973a2-373d-4ca7-8885-f83fd7b96bb8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 02:17:45.589293 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63973a2-373d-4ca7-8885-f83fd7b96bb8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:17:45.590655 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63973a2-373d-4ca7-8885-f83fd7b96bb8 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:17:45.603375 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 335/667] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Oct 12 02:17:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 02:17:45.608892 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80479133-15d3-492c-adb2-17ac768f99d4 None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:17:45.722271 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80479133-15d3-492c-adb2-17ac768f99d4 None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:17:45.761002 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a086ec00-b177-4793-8592-8f46abc99665 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:17:45.761720 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a086ec00-b177-4793-8592-8f46abc99665 None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:45.761997 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a086ec00-b177-4793-8592-8f46abc99665 None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:45.762325 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a086ec00-b177-4793-8592-8f46abc99665 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:45.769429 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a086ec00-b177-4793-8592-8f46abc99665 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:17:45.770931 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a086ec00-b177-4793-8592-8f46abc99665 None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:17:45.782720 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application [None req-a086ec00-b177-4793-8592-8f46abc99665 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 12 02:17:45.782720 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 02:17:45.782720 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 02:17:45.782720 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 02:17:45.782720 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 02:17:45.782720 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 02:17:45.782720 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 02:17:45.782720 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 02:17:45.782720 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 02:17:45.782720 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 02:17:45.782720 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 02:17:45.782720 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 02:17:45.782720 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 12 02:17:45.782720 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 12 02:17:45.782720 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 12 02:17:45.783620 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 12 02:17:45.783620 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 02:17:45.783620 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 02:17:45.783620 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 02:17:45.783620 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 02:17:45.783620 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 02:17:45.783620 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 02:17:45.783620 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 02:17:45.783620 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application with Lock( Oct 12 02:17:45.783620 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 02:17:45.783620 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._enter() Oct 12 02:17:45.783620 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 02:17:45.783620 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 02:17:45.783620 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 02:17:45.783620 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.creator() Oct 12 02:17:45.783620 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 02:17:45.783620 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application created_value = creator( Oct 12 02:17:45.785706 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 12 02:17:45.785706 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 12 02:17:45.785706 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 12 02:17:45.785706 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 12 02:17:45.785706 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 12 02:17:45.785706 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 12 02:17:45.785706 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 12 02:17:45.785706 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Oct 12 02:17:45.785706 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 333/668] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Oct 12 02:17:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 02:17:45.792445 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63973a2-373d-4ca7-8885-f83fd7b96bb8 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:17:45.866770 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:17:45.899220 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63973a2-373d-4ca7-8885-f83fd7b96bb8 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:17:45.938518 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3754c6c-8a47-41a5-8f0d-d187474c91a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:17:45.939373 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3754c6c-8a47-41a5-8f0d-d187474c91a6 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:45.939791 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3754c6c-8a47-41a5-8f0d-d187474c91a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:45.940232 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3754c6c-8a47-41a5-8f0d-d187474c91a6 None admin] PATH_INFO: `/v3/projects` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:45.941831 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3754c6c-8a47-41a5-8f0d-d187474c91a6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 02:17:45.942282 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3754c6c-8a47-41a5-8f0d-d187474c91a6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:17:45.943838 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3754c6c-8a47-41a5-8f0d-d187474c91a6 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:17:45.957107 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 336/669] 10.222.0.18 () {56 vars in 1148 bytes} [Wed Oct 12 02:17:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 02:17:45.962987 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a086ec00-b177-4793-8592-8f46abc99665 None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:17:45.983180 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:17:46.024249 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2663ce5-7ab4-468f-ad36-b2ac071011d2 None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:46.024948 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2663ce5-7ab4-468f-ad36-b2ac071011d2 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:46.025442 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2663ce5-7ab4-468f-ad36-b2ac071011d2 None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:46.027385 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 337/670] 10.222.0.18 () {54 vars in 927 bytes} [Wed Oct 12 02:17:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 12 02:17:46.033387 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7100df-e761-4480-bd70-b3f6b02261dd None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:46.034008 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7100df-e761-4480-bd70-b3f6b02261dd None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:46.035162 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7100df-e761-4480-bd70-b3f6b02261dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:46.056135 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-5f7100df-e761-4480-bd70-b3f6b02261dd None None] MFA Rules not processed for user `a326a5bb7364479382f528a592371656`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:17:46.057829 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-5f7100df-e761-4480-bd70-b3f6b02261dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:17:46.083998 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a086ec00-b177-4793-8592-8f46abc99665 None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:17:46.125431 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb879ad-8fe2-4a06-b672-112ef6928715 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:17:46.126610 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb879ad-8fe2-4a06-b672-112ef6928715 None admin] REQUEST_METHOD: `PUT` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:46.128212 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb879ad-8fe2-4a06-b672-112ef6928715 None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:46.128916 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb879ad-8fe2-4a06-b672-112ef6928715 None admin] PATH_INFO: `/v3/projects/beb6def6fcad45959e56425bb8bff4d1/users/8d0e2087e5324071926c3dc3a3cb9b1d/roles/b4f35c03154b4810bf6a5fafd0f5f978` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:46.132205 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb879ad-8fe2-4a06-b672-112ef6928715 None admin] RBAC: Authorizing `identity:create_grant(project_id=beb6def6fcad45959e56425bb8bff4d1, user_id=8d0e2087e5324071926c3dc3a3cb9b1d, role_id=b4f35c03154b4810bf6a5fafd0f5f978)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:17:46.134176 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb879ad-8fe2-4a06-b672-112ef6928715 None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:17:46.150139 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 338/671] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Oct 12 02:17:46 2022] POST /identity/v3/auth/tokens => generated 1373 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 12 02:17:46.150636 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 334/672] 10.222.0.18 () {58 vars in 1439 bytes} [Wed Oct 12 02:17:45 2022] PUT /identity/v3/projects/beb6def6fcad45959e56425bb8bff4d1/users/8d0e2087e5324071926c3dc3a3cb9b1d/roles/b4f35c03154b4810bf6a5fafd0f5f978 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 02:17:46.159471 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41fd940-f19c-4db1-98be-70ad86032151 None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:46.160103 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41fd940-f19c-4db1-98be-70ad86032151 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:46.160730 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41fd940-f19c-4db1-98be-70ad86032151 None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:46.162838 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 339/673] 10.222.0.18 () {54 vars in 927 bytes} [Wed Oct 12 02:17:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 02:17:46.170802 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dce877-e4d6-422a-9afc-9df63657f011 None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:46.171139 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dce877-e4d6-422a-9afc-9df63657f011 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:46.171370 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dce877-e4d6-422a-9afc-9df63657f011 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:46.192369 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-62dce877-e4d6-422a-9afc-9df63657f011 None None] MFA Rules not processed for user `a326a5bb7364479382f528a592371656`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:17:46.193673 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-62dce877-e4d6-422a-9afc-9df63657f011 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:17:46.274215 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 335/674] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Oct 12 02:17:46 2022] POST /identity/v3/auth/tokens => generated 1373 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 12 02:17:46.418720 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41fd940-f19c-4db1-98be-70ad86032151 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:17:46.488176 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:17:46.531708 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41fd940-f19c-4db1-98be-70ad86032151 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:17:46.569062 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110e1248-e1f6-4dc4-a60b-43276bcb1b5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:17:46.569674 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110e1248-e1f6-4dc4-a60b-43276bcb1b5e None admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:46.569953 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110e1248-e1f6-4dc4-a60b-43276bcb1b5e None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:46.570224 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110e1248-e1f6-4dc4-a60b-43276bcb1b5e None admin] PATH_INFO: `/v3/services` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:46.570895 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110e1248-e1f6-4dc4-a60b-43276bcb1b5e None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:17:46.572257 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110e1248-e1f6-4dc4-a60b-43276bcb1b5e None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:17:46.573271 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62dce877-e4d6-422a-9afc-9df63657f011 None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:17:46.583211 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:17:46.592012 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 340/675] 10.222.0.18 () {60 vars in 1141 bytes} [Wed Oct 12 02:17:46 2022] POST /identity/v3/services => generated 251 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 02:17:46.703953 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62dce877-e4d6-422a-9afc-9df63657f011 None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:17:46.750858 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7973dd2c-0e64-4856-bce8-0196c018ca04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:17:46.751866 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7973dd2c-0e64-4856-bce8-0196c018ca04 None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:46.752390 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7973dd2c-0e64-4856-bce8-0196c018ca04 None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:46.752909 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7973dd2c-0e64-4856-bce8-0196c018ca04 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:46.754277 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7973dd2c-0e64-4856-bce8-0196c018ca04 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:17:46.755897 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7973dd2c-0e64-4856-bce8-0196c018ca04 None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:17:46.765625 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application [None req-7973dd2c-0e64-4856-bce8-0196c018ca04 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 12 02:17:46.765625 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 02:17:46.765625 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 12 02:17:46.765625 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 12 02:17:46.765625 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 12 02:17:46.765625 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 12 02:17:46.765625 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 12 02:17:46.765625 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 12 02:17:46.765625 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 12 02:17:46.765625 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Oct 12 02:17:46.765625 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 12 02:17:46.765625 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Oct 12 02:17:46.765625 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 02:17:46.765625 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 02:17:46.765625 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 02:17:46.765625 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 02:17:46.766565 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 02:17:46.766565 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 02:17:46.766565 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 02:17:46.766565 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 02:17:46.766565 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 02:17:46.766565 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 02:17:46.766565 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 02:17:46.766565 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 12 02:17:46.766565 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 12 02:17:46.766565 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 12 02:17:46.766565 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 12 02:17:46.766565 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 02:17:46.766565 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 02:17:46.766565 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 02:17:46.766565 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 02:17:46.766565 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 02:17:46.766565 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 02:17:46.767449 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 02:17:46.767449 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application with Lock( Oct 12 02:17:46.767449 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 02:17:46.767449 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._enter() Oct 12 02:17:46.767449 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 02:17:46.767449 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 02:17:46.767449 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 02:17:46.767449 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.creator() Oct 12 02:17:46.767449 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 02:17:46.767449 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application created_value = creator( Oct 12 02:17:46.767449 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 12 02:17:46.767449 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 12 02:17:46.767449 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 12 02:17:46.767449 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Oct 12 02:17:46.772608 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 336/676] 10.222.0.18 () {56 vars in 1132 bytes} [Wed Oct 12 02:17:46 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 02:17:46.776502 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110e1248-e1f6-4dc4-a60b-43276bcb1b5e None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:17:46.886079 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110e1248-e1f6-4dc4-a60b-43276bcb1b5e None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:17:46.909932 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:17:46.923935 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cac22aa-bad7-4f33-9b4c-a8c3cebf6d01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:17:46.925527 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cac22aa-bad7-4f33-9b4c-a8c3cebf6d01 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:46.926091 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cac22aa-bad7-4f33-9b4c-a8c3cebf6d01 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:46.926557 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cac22aa-bad7-4f33-9b4c-a8c3cebf6d01 None admin] PATH_INFO: `/v3/services` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:46.927426 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cac22aa-bad7-4f33-9b4c-a8c3cebf6d01 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 02:17:46.927922 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cac22aa-bad7-4f33-9b4c-a8c3cebf6d01 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:17:46.929505 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cac22aa-bad7-4f33-9b4c-a8c3cebf6d01 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:17:46.939495 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 341/677] 10.222.0.18 () {56 vars in 1126 bytes} [Wed Oct 12 02:17:46 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 02:17:46.941191 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7973dd2c-0e64-4856-bce8-0196c018ca04 None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:17:47.011296 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:17:47.052442 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7973dd2c-0e64-4856-bce8-0196c018ca04 None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:17:47.088221 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c016e38d-a6a7-4c57-9dc7-06e97c98bf0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:17:47.089196 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c016e38d-a6a7-4c57-9dc7-06e97c98bf0b None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:47.089713 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c016e38d-a6a7-4c57-9dc7-06e97c98bf0b None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:47.090280 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c016e38d-a6a7-4c57-9dc7-06e97c98bf0b None admin] PATH_INFO: `/v3/services` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:47.091193 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c016e38d-a6a7-4c57-9dc7-06e97c98bf0b None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 02:17:47.091685 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c016e38d-a6a7-4c57-9dc7-06e97c98bf0b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:17:47.093277 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c016e38d-a6a7-4c57-9dc7-06e97c98bf0b None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:17:47.103416 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 337/678] 10.222.0.18 () {56 vars in 1126 bytes} [Wed Oct 12 02:17:46 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 02:17:47.105068 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cac22aa-bad7-4f33-9b4c-a8c3cebf6d01 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:17:47.213959 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cac22aa-bad7-4f33-9b4c-a8c3cebf6d01 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:17:47.250874 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c296876c-16b6-43a3-abde-a97745245feb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:17:47.251831 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c296876c-16b6-43a3-abde-a97745245feb None admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:47.252311 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c296876c-16b6-43a3-abde-a97745245feb None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:47.252836 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c296876c-16b6-43a3-abde-a97745245feb None admin] PATH_INFO: `/v3/endpoints` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:47.254517 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c296876c-16b6-43a3-abde-a97745245feb None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:17:47.256130 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c296876c-16b6-43a3-abde-a97745245feb None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:17:47.284867 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 342/679] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Oct 12 02:17:47 2022] POST /identity/v3/endpoints => generated 347 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 02:17:47.583088 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d552699-2a19-449f-9197-62c8018e30eb None None] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:47.583654 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d552699-2a19-449f-9197-62c8018e30eb None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:47.583654 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d552699-2a19-449f-9197-62c8018e30eb None None] PATH_INFO: `/` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:47.585372 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 338/680] 10.222.0.18 () {54 vars in 927 bytes} [Wed Oct 12 02:17:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 02:17:47.591244 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853bd995-f974-4fd0-a184-6a42fc2fb61d None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:47.591766 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853bd995-f974-4fd0-a184-6a42fc2fb61d None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:47.591876 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853bd995-f974-4fd0-a184-6a42fc2fb61d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:47.612206 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-853bd995-f974-4fd0-a184-6a42fc2fb61d None None] MFA Rules not processed for user `a326a5bb7364479382f528a592371656`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:17:47.614060 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-853bd995-f974-4fd0-a184-6a42fc2fb61d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:17:47.651008 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:17:47.697017 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 343/681] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Oct 12 02:17:47 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 12 02:17:47.969801 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d552699-2a19-449f-9197-62c8018e30eb None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:17:48.078089 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d552699-2a19-449f-9197-62c8018e30eb None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:17:48.113530 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:17:48.116717 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21bfa1d-bde6-46af-8152-53dbc2bf5f08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:17:48.117357 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21bfa1d-bde6-46af-8152-53dbc2bf5f08 None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:48.117638 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21bfa1d-bde6-46af-8152-53dbc2bf5f08 None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:48.118005 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21bfa1d-bde6-46af-8152-53dbc2bf5f08 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:48.118639 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21bfa1d-bde6-46af-8152-53dbc2bf5f08 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:17:48.120065 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21bfa1d-bde6-46af-8152-53dbc2bf5f08 None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:17:48.129829 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application [None req-f21bfa1d-bde6-46af-8152-53dbc2bf5f08 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 12 02:17:48.129829 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 02:17:48.129829 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 12 02:17:48.129829 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 12 02:17:48.129829 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 12 02:17:48.129829 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 12 02:17:48.129829 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 12 02:17:48.129829 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 12 02:17:48.129829 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 12 02:17:48.129829 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Oct 12 02:17:48.129829 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 12 02:17:48.129829 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Oct 12 02:17:48.129829 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 02:17:48.129829 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 02:17:48.129829 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 02:17:48.129829 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 02:17:48.129829 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 02:17:48.131067 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 02:17:48.131067 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 02:17:48.131067 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 02:17:48.131067 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 02:17:48.131067 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 02:17:48.131067 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 02:17:48.131067 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 12 02:17:48.131067 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 12 02:17:48.131067 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 12 02:17:48.131067 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 12 02:17:48.131067 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 02:17:48.131067 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 02:17:48.131067 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 02:17:48.131067 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 02:17:48.131067 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 02:17:48.131067 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 02:17:48.132112 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 02:17:48.132112 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application with Lock( Oct 12 02:17:48.132112 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 02:17:48.132112 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._enter() Oct 12 02:17:48.132112 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 02:17:48.132112 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 02:17:48.132112 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 02:17:48.132112 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.creator() Oct 12 02:17:48.132112 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 02:17:48.132112 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application created_value = creator( Oct 12 02:17:48.132112 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 12 02:17:48.132112 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 12 02:17:48.132112 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 12 02:17:48.132112 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Oct 12 02:17:48.134803 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 339/682] 10.222.0.18 () {56 vars in 1126 bytes} [Wed Oct 12 02:17:47 2022] GET /identity/v3/services/object-store => generated 93 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 02:17:48.140910 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853bd995-f974-4fd0-a184-6a42fc2fb61d None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:17:48.248334 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853bd995-f974-4fd0-a184-6a42fc2fb61d None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:17:48.287267 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa17d22-405f-43a3-b462-b296e3bb8dd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:17:48.288263 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa17d22-405f-43a3-b462-b296e3bb8dd1 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:48.288785 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa17d22-405f-43a3-b462-b296e3bb8dd1 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:48.289249 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa17d22-405f-43a3-b462-b296e3bb8dd1 None admin] PATH_INFO: `/v3/services` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:48.290077 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa17d22-405f-43a3-b462-b296e3bb8dd1 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 02:17:48.290588 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa17d22-405f-43a3-b462-b296e3bb8dd1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:17:48.292193 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa17d22-405f-43a3-b462-b296e3bb8dd1 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:17:48.298404 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 344/683] 10.222.0.18 () {56 vars in 1122 bytes} [Wed Oct 12 02:17:48 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 02:17:48.305010 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21bfa1d-bde6-46af-8152-53dbc2bf5f08 None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:17:48.351444 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc9eb6e-5eab-4093-ba6d-1816e0fe04a9 None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:48.351755 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc9eb6e-5eab-4093-ba6d-1816e0fe04a9 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:48.351987 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc9eb6e-5eab-4093-ba6d-1816e0fe04a9 None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:48.353601 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 345/684] 10.222.0.18 () {54 vars in 927 bytes} [Wed Oct 12 02:17:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 02:17:48.358425 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cdd603-967d-4c90-8fd2-2df57af3261f None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:48.358708 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cdd603-967d-4c90-8fd2-2df57af3261f None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:48.358981 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cdd603-967d-4c90-8fd2-2df57af3261f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:48.380767 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-54cdd603-967d-4c90-8fd2-2df57af3261f None None] MFA Rules not processed for user `a326a5bb7364479382f528a592371656`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:17:48.383074 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-54cdd603-967d-4c90-8fd2-2df57af3261f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:17:48.415959 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21bfa1d-bde6-46af-8152-53dbc2bf5f08 None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:17:48.416758 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:17:48.455592 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9386ee86-ff9e-4fdd-a72b-7d3e2e0dc5f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:17:48.456789 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9386ee86-ff9e-4fdd-a72b-7d3e2e0dc5f3 None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:48.457092 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9386ee86-ff9e-4fdd-a72b-7d3e2e0dc5f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:48.457445 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9386ee86-ff9e-4fdd-a72b-7d3e2e0dc5f3 None admin] PATH_INFO: `/v3/services` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:48.458183 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9386ee86-ff9e-4fdd-a72b-7d3e2e0dc5f3 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 02:17:48.458491 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9386ee86-ff9e-4fdd-a72b-7d3e2e0dc5f3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:17:48.459863 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9386ee86-ff9e-4fdd-a72b-7d3e2e0dc5f3 None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:17:48.470713 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 340/686] 10.222.0.18 () {56 vars in 1122 bytes} [Wed Oct 12 02:17:48 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 02:17:48.471892 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9386ee86-ff9e-4fdd-a72b-7d3e2e0dc5f3 None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:17:48.472720 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 346/686] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Oct 12 02:17:48 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 12 02:17:48.534684 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:17:48.583889 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9386ee86-ff9e-4fdd-a72b-7d3e2e0dc5f3 None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:17:48.619691 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfbbbc8-4682-4aba-919b-c700b85f2349 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:17:48.620662 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfbbbc8-4682-4aba-919b-c700b85f2349 None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:48.621139 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfbbbc8-4682-4aba-919b-c700b85f2349 None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:48.621605 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfbbbc8-4682-4aba-919b-c700b85f2349 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:48.622508 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfbbbc8-4682-4aba-919b-c700b85f2349 None admin] RBAC: Adding query filter params (interface=public, service_id=2ba7b620cfa24da0a64755c9d8a92d6c, region_id=RegionOne) {{(pid=81361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 02:17:48.623009 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfbbbc8-4682-4aba-919b-c700b85f2349 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:17:48.624583 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfbbbc8-4682-4aba-919b-c700b85f2349 None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:17:48.630366 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 341/687] 10.222.0.18 () {56 vars in 1251 bytes} [Wed Oct 12 02:17:48 2022] GET /identity/v3/endpoints?service_id=2ba7b620cfa24da0a64755c9d8a92d6c&interface=public®ion_id=RegionOne => generated 194 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 02:17:48.636509 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cdd603-967d-4c90-8fd2-2df57af3261f None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:17:48.735856 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cdd603-967d-4c90-8fd2-2df57af3261f None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:17:48.776758 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f8fe97-d6c0-460b-b410-50afb3157b96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:17:48.777769 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f8fe97-d6c0-460b-b410-50afb3157b96 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:48.778244 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f8fe97-d6c0-460b-b410-50afb3157b96 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:48.778752 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f8fe97-d6c0-460b-b410-50afb3157b96 None admin] PATH_INFO: `/v3/services` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:48.779570 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f8fe97-d6c0-460b-b410-50afb3157b96 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:17:48.781295 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f8fe97-d6c0-460b-b410-50afb3157b96 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:17:48.789927 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 347/688] 10.222.0.18 () {56 vars in 1087 bytes} [Wed Oct 12 02:17:48 2022] GET /identity/v3/services => generated 1497 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 02:17:48.792445 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfbbbc8-4682-4aba-919b-c700b85f2349 None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:17:48.885723 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5c1d49-c2e2-4d47-a99f-4216735e3835 None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:48.886087 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5c1d49-c2e2-4d47-a99f-4216735e3835 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:48.886269 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5c1d49-c2e2-4d47-a99f-4216735e3835 None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:48.887926 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 348/689] 10.222.0.18 () {54 vars in 927 bytes} [Wed Oct 12 02:17:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 12 02:17:48.894894 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f559d2-87b2-4c20-a854-3ffdc10ad41f None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:48.895085 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f559d2-87b2-4c20-a854-3ffdc10ad41f None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:48.895347 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f559d2-87b2-4c20-a854-3ffdc10ad41f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:48.913580 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfbbbc8-4682-4aba-919b-c700b85f2349 None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:17:48.915875 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-f1f559d2-87b2-4c20-a854-3ffdc10ad41f None None] MFA Rules not processed for user `a326a5bb7364479382f528a592371656`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:17:48.917510 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-f1f559d2-87b2-4c20-a854-3ffdc10ad41f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:17:48.944359 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:17:48.950624 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:17:48.966742 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241ce271-b0e7-4aff-8edd-1746968e9994 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:17:48.967374 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241ce271-b0e7-4aff-8edd-1746968e9994 None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:48.967651 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241ce271-b0e7-4aff-8edd-1746968e9994 None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:48.967912 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241ce271-b0e7-4aff-8edd-1746968e9994 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:48.982454 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241ce271-b0e7-4aff-8edd-1746968e9994 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 02:17:48.989456 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application [None req-241ce271-b0e7-4aff-8edd-1746968e9994 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 12 02:17:48.989456 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 02:17:48.989456 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 02:17:48.989456 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 02:17:48.989456 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 02:17:48.989456 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 02:17:48.989456 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 02:17:48.989456 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 02:17:48.989456 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 02:17:48.989456 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 02:17:48.989456 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 02:17:48.989456 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 02:17:48.989456 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 12 02:17:48.989456 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 12 02:17:48.989456 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 12 02:17:48.989456 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 12 02:17:48.990690 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 12 02:17:48.990690 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 12 02:17:48.990690 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 12 02:17:48.990690 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 12 02:17:48.990690 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 02:17:48.990690 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 02:17:48.990690 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 02:17:48.990690 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 02:17:48.990690 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 02:17:48.990690 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 02:17:48.990690 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 02:17:48.990690 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application with Lock( Oct 12 02:17:48.990690 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 02:17:48.990690 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._enter() Oct 12 02:17:48.990690 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 02:17:48.990690 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 02:17:48.991525 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 02:17:48.991525 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.creator() Oct 12 02:17:48.991525 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 02:17:48.991525 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application created_value = creator( Oct 12 02:17:48.991525 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 12 02:17:48.991525 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 12 02:17:48.991525 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 12 02:17:48.991525 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 12 02:17:48.991525 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 12 02:17:48.991525 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 12 02:17:48.991525 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 12 02:17:48.991525 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Oct 12 02:17:48.998474 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 342/690] 10.222.0.18 () {56 vars in 1120 bytes} [Wed Oct 12 02:17:48 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 02:17:49.000519 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241ce271-b0e7-4aff-8edd-1746968e9994 None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:17:49.007921 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 349/691] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Oct 12 02:17:48 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 12 02:17:49.112134 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241ce271-b0e7-4aff-8edd-1746968e9994 None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:17:49.149769 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff11f0a-4796-4ba8-a6e7-ab7284cfff48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:17:49.150379 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff11f0a-4796-4ba8-a6e7-ab7284cfff48 None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:49.150660 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff11f0a-4796-4ba8-a6e7-ab7284cfff48 None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:49.150936 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff11f0a-4796-4ba8-a6e7-ab7284cfff48 None admin] PATH_INFO: `/v3/roles` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:49.151610 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff11f0a-4796-4ba8-a6e7-ab7284cfff48 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 02:17:49.151915 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff11f0a-4796-4ba8-a6e7-ab7284cfff48 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:17:49.153332 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff11f0a-4796-4ba8-a6e7-ab7284cfff48 None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:17:49.162390 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 343/692] 10.222.0.18 () {56 vars in 1115 bytes} [Wed Oct 12 02:17:48 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 02:17:49.168172 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f559d2-87b2-4c20-a854-3ffdc10ad41f None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:17:49.272233 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f559d2-87b2-4c20-a854-3ffdc10ad41f None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:17:49.288230 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff11f0a-4796-4ba8-a6e7-ab7284cfff48 None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:17:49.309084 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa8d2f7-fa22-47b9-898a-5f102338ca3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:17:49.310060 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa8d2f7-fa22-47b9-898a-5f102338ca3c None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:49.310575 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa8d2f7-fa22-47b9-898a-5f102338ca3c None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:49.311042 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa8d2f7-fa22-47b9-898a-5f102338ca3c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:49.322035 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa8d2f7-fa22-47b9-898a-5f102338ca3c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:17:49.323768 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa8d2f7-fa22-47b9-898a-5f102338ca3c None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:17:49.339380 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-8aa8d2f7-fa22-47b9-898a-5f102338ca3c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 02:17:49.339380 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 02:17:49.339380 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 02:17:49.339380 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 02:17:49.339380 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 02:17:49.339380 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 02:17:49.339380 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 02:17:49.339380 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 02:17:49.339380 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 02:17:49.339380 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 02:17:49.339380 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 02:17:49.339380 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 02:17:49.339380 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 12 02:17:49.339380 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 12 02:17:49.339380 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 12 02:17:49.339380 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 12 02:17:49.340379 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 02:17:49.340379 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 02:17:49.340379 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 02:17:49.340379 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 02:17:49.340379 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 02:17:49.340379 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 02:17:49.340379 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 02:17:49.340379 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Oct 12 02:17:49.340379 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 02:17:49.340379 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Oct 12 02:17:49.340379 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 02:17:49.340379 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 02:17:49.340379 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 02:17:49.340379 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Oct 12 02:17:49.340379 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 02:17:49.340379 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Oct 12 02:17:49.340379 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 12 02:17:49.341300 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 12 02:17:49.341300 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 02:17:49.341300 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Oct 12 02:17:49.341471 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:17:49.347613 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 350/693] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Oct 12 02:17:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 02:17:49.349521 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa8d2f7-fa22-47b9-898a-5f102338ca3c None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:17:49.361074 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:17:49.402265 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff11f0a-4796-4ba8-a6e7-ab7284cfff48 None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:17:49.437642 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c94f1b-babc-4cd3-b55e-18a48098ef5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:17:49.438274 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c94f1b-babc-4cd3-b55e-18a48098ef5c None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:49.438551 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c94f1b-babc-4cd3-b55e-18a48098ef5c None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:49.438824 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c94f1b-babc-4cd3-b55e-18a48098ef5c None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:49.439555 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c94f1b-babc-4cd3-b55e-18a48098ef5c None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:17:49.440980 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c94f1b-babc-4cd3-b55e-18a48098ef5c None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:17:49.450243 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application [None req-e0c94f1b-babc-4cd3-b55e-18a48098ef5c None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 12 02:17:49.450243 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 02:17:49.450243 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 12 02:17:49.450243 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 12 02:17:49.450243 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 12 02:17:49.450243 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 12 02:17:49.450243 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 12 02:17:49.450243 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 12 02:17:49.450243 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 12 02:17:49.450243 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Oct 12 02:17:49.450243 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 12 02:17:49.450243 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Oct 12 02:17:49.450243 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 02:17:49.450243 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 02:17:49.450243 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 02:17:49.450243 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 02:17:49.450243 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 02:17:49.451229 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 02:17:49.451229 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 02:17:49.451229 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 02:17:49.451229 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 02:17:49.451229 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 02:17:49.451229 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 02:17:49.451229 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 12 02:17:49.451229 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 12 02:17:49.451229 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 12 02:17:49.451229 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 12 02:17:49.451229 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 02:17:49.451229 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 02:17:49.451229 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 02:17:49.451229 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 02:17:49.451229 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 02:17:49.451229 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 02:17:49.452442 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 02:17:49.452442 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application with Lock( Oct 12 02:17:49.452442 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 02:17:49.452442 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._enter() Oct 12 02:17:49.452442 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 02:17:49.452442 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 02:17:49.452442 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 02:17:49.452442 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.creator() Oct 12 02:17:49.452442 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 02:17:49.452442 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application created_value = creator( Oct 12 02:17:49.452442 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 12 02:17:49.452442 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 12 02:17:49.452442 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 12 02:17:49.452442 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Oct 12 02:17:49.456849 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 344/694] 10.222.0.18 () {56 vars in 1114 bytes} [Wed Oct 12 02:17:49 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 12 02:17:49.458204 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c94f1b-babc-4cd3-b55e-18a48098ef5c None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:17:49.463258 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa8d2f7-fa22-47b9-898a-5f102338ca3c None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:17:49.499699 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f5788d-7bf0-42d4-a4d1-f788e64094c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:17:49.500412 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f5788d-7bf0-42d4-a4d1-f788e64094c6 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:49.500798 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f5788d-7bf0-42d4-a4d1-f788e64094c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:49.501154 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f5788d-7bf0-42d4-a4d1-f788e64094c6 None admin] PATH_INFO: `/v3/domains` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:49.501862 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f5788d-7bf0-42d4-a4d1-f788e64094c6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 02:17:49.502226 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f5788d-7bf0-42d4-a4d1-f788e64094c6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:17:49.503906 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f5788d-7bf0-42d4-a4d1-f788e64094c6 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:17:49.528193 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 351/695] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Oct 12 02:17:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 02:17:49.529180 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f5788d-7bf0-42d4-a4d1-f788e64094c6 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:17:49.585420 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c94f1b-babc-4cd3-b55e-18a48098ef5c None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:17:49.608886 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:17:49.624004 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a3f3fb-edca-48f8-a451-fa35b3bcdc16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:17:49.624960 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a3f3fb-edca-48f8-a451-fa35b3bcdc16 None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:49.625688 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a3f3fb-edca-48f8-a451-fa35b3bcdc16 None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:49.626137 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a3f3fb-edca-48f8-a451-fa35b3bcdc16 None admin] PATH_INFO: `/v3/services` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:49.627379 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:17:49.628970 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a3f3fb-edca-48f8-a451-fa35b3bcdc16 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 02:17:49.630191 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a3f3fb-edca-48f8-a451-fa35b3bcdc16 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:17:49.631186 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a3f3fb-edca-48f8-a451-fa35b3bcdc16 None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:17:49.638244 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 345/696] 10.222.0.18 () {56 vars in 1114 bytes} [Wed Oct 12 02:17:49 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 02:17:49.643400 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a3f3fb-edca-48f8-a451-fa35b3bcdc16 None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:17:49.672602 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f5788d-7bf0-42d4-a4d1-f788e64094c6 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:17:49.709348 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b80ddcb-1951-4980-b5d0-57e9fac443a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:17:49.709975 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b80ddcb-1951-4980-b5d0-57e9fac443a3 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:49.710252 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b80ddcb-1951-4980-b5d0-57e9fac443a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:49.710522 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b80ddcb-1951-4980-b5d0-57e9fac443a3 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:49.717586 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b80ddcb-1951-4980-b5d0-57e9fac443a3 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:17:49.719366 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b80ddcb-1951-4980-b5d0-57e9fac443a3 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:17:49.731303 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-2b80ddcb-1951-4980-b5d0-57e9fac443a3 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 12 02:17:49.731303 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 02:17:49.731303 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 02:17:49.731303 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 02:17:49.731303 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 02:17:49.731303 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 02:17:49.731303 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 02:17:49.731303 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 02:17:49.731303 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 02:17:49.731303 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 02:17:49.731303 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 02:17:49.731303 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 02:17:49.731303 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 12 02:17:49.731303 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 12 02:17:49.731303 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 12 02:17:49.731303 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 12 02:17:49.732253 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 02:17:49.732253 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 02:17:49.732253 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 12 02:17:49.732253 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 12 02:17:49.732253 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 12 02:17:49.732253 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 12 02:17:49.732253 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 02:17:49.732253 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 02:17:49.732253 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 02:17:49.732253 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 02:17:49.732253 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 02:17:49.732253 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Oct 12 02:17:49.732253 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 02:17:49.732253 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Oct 12 02:17:49.732253 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 02:17:49.732253 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 02:17:49.732253 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 02:17:49.732253 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Oct 12 02:17:49.733260 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 02:17:49.733260 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Oct 12 02:17:49.733260 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 12 02:17:49.733260 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 12 02:17:49.733260 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 12 02:17:49.733260 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 12 02:17:49.733260 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 12 02:17:49.733260 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 12 02:17:49.733260 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 12 02:17:49.733260 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Oct 12 02:17:49.733260 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 352/697] 10.222.0.18 () {56 vars in 1117 bytes} [Wed Oct 12 02:17:49 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 02:17:49.733855 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b1b630-7ccb-4674-9efa-de540c88f9bc None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:49.733855 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b1b630-7ccb-4674-9efa-de540c88f9bc None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:49.734417 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b1b630-7ccb-4674-9efa-de540c88f9bc None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:49.739265 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 353/698] 10.222.0.18 () {54 vars in 927 bytes} [Wed Oct 12 02:17:49 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 02:17:49.741040 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b1b630-7ccb-4674-9efa-de540c88f9bc None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:17:49.759949 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a3f3fb-edca-48f8-a451-fa35b3bcdc16 None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:17:49.794497 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc84390-f364-4c64-b777-dd16a9e67842 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:17:49.795122 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc84390-f364-4c64-b777-dd16a9e67842 None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:49.795399 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc84390-f364-4c64-b777-dd16a9e67842 None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:49.795777 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc84390-f364-4c64-b777-dd16a9e67842 None admin] PATH_INFO: `/v3/services` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:49.796394 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc84390-f364-4c64-b777-dd16a9e67842 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 02:17:49.796989 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc84390-f364-4c64-b777-dd16a9e67842 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:17:49.798192 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc84390-f364-4c64-b777-dd16a9e67842 None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:17:49.808271 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 346/699] 10.222.0.18 () {56 vars in 1114 bytes} [Wed Oct 12 02:17:49 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 02:17:49.808271 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71256866-aa3e-4bf8-9a82-957ea48af330 None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:49.808271 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71256866-aa3e-4bf8-9a82-957ea48af330 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:49.808271 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71256866-aa3e-4bf8-9a82-957ea48af330 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:49.823281 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-71256866-aa3e-4bf8-9a82-957ea48af330 None None] MFA Rules not processed for user `a326a5bb7364479382f528a592371656`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:17:49.824444 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-71256866-aa3e-4bf8-9a82-957ea48af330 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:17:49.855556 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:17:49.860758 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b1b630-7ccb-4674-9efa-de540c88f9bc None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:17:49.887305 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:17:49.897006 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ace076a-ab11-406a-9f4c-1b42e09908d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:17:49.897842 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 347/700] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Oct 12 02:17:49 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 12 02:17:49.897961 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ace076a-ab11-406a-9f4c-1b42e09908d2 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:49.898181 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ace076a-ab11-406a-9f4c-1b42e09908d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:49.898557 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ace076a-ab11-406a-9f4c-1b42e09908d2 None admin] PATH_INFO: `/v3/users` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:49.899392 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ace076a-ab11-406a-9f4c-1b42e09908d2 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 02:17:49.899805 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ace076a-ab11-406a-9f4c-1b42e09908d2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:17:49.901383 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ace076a-ab11-406a-9f4c-1b42e09908d2 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:17:49.905306 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71256866-aa3e-4bf8-9a82-957ea48af330 None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:17:49.920628 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 354/701] 10.222.0.18 () {56 vars in 1149 bytes} [Wed Oct 12 02:17:49 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 02:17:49.926459 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ace076a-ab11-406a-9f4c-1b42e09908d2 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:17:50.026874 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71256866-aa3e-4bf8-9a82-957ea48af330 None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:17:50.055530 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ace076a-ab11-406a-9f4c-1b42e09908d2 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:17:50.062566 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e75637-94f5-4744-be46-a6bfe2725a3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:17:50.063292 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e75637-94f5-4744-be46-a6bfe2725a3a None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:50.063695 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e75637-94f5-4744-be46-a6bfe2725a3a None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:50.064068 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e75637-94f5-4744-be46-a6bfe2725a3a None admin] PATH_INFO: `/v3/endpoints` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:50.065289 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e75637-94f5-4744-be46-a6bfe2725a3a None admin] RBAC: Adding query filter params (interface=public, service_id=4fdd60a8927946f3895d9597a206e869, region_id=RegionOne) {{(pid=81361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 02:17:50.065289 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e75637-94f5-4744-be46-a6bfe2725a3a None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:17:50.067484 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e75637-94f5-4744-be46-a6bfe2725a3a None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:17:50.077719 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 348/702] 10.222.0.18 () {56 vars in 1251 bytes} [Wed Oct 12 02:17:49 2022] GET /identity/v3/endpoints?service_id=4fdd60a8927946f3895d9597a206e869&interface=public®ion_id=RegionOne => generated 194 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 02:17:50.078581 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e75637-94f5-4744-be46-a6bfe2725a3a None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:17:50.094967 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af478bb-398d-4108-b481-54c3ed068237 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:17:50.096328 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af478bb-398d-4108-b481-54c3ed068237 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:50.097099 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af478bb-398d-4108-b481-54c3ed068237 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:50.097666 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af478bb-398d-4108-b481-54c3ed068237 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:50.111856 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:17:50.165927 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:17:50.183374 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af478bb-398d-4108-b481-54c3ed068237 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:17:50.184754 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af478bb-398d-4108-b481-54c3ed068237 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:17:50.192017 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e75637-94f5-4744-be46-a6bfe2725a3a None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:17:50.228661 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bd17d1-2949-465a-b09e-bb393355865d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:17:50.229400 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bd17d1-2949-465a-b09e-bb393355865d None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:50.229680 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bd17d1-2949-465a-b09e-bb393355865d None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:50.229949 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bd17d1-2949-465a-b09e-bb393355865d None admin] PATH_INFO: `/v3/services` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:50.230547 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01bd17d1-2949-465a-b09e-bb393355865d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:17:50.231902 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01bd17d1-2949-465a-b09e-bb393355865d None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:17:50.248519 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 349/703] 10.222.0.18 () {56 vars in 1087 bytes} [Wed Oct 12 02:17:50 2022] GET /identity/v3/services => generated 1497 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 02:17:50.248519 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bd17d1-2949-465a-b09e-bb393355865d None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:17:50.317139 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 355/704] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Oct 12 02:17:49 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Oct 12 02:17:50.323367 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af478bb-398d-4108-b481-54c3ed068237 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:17:50.376760 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:17:50.386027 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bd17d1-2949-465a-b09e-bb393355865d None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:17:50.426645 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e14108f-8c3d-45f2-98c7-65154a6e3765 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:17:50.427289 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e14108f-8c3d-45f2-98c7-65154a6e3765 None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:50.427568 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e14108f-8c3d-45f2-98c7-65154a6e3765 None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:50.427845 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e14108f-8c3d-45f2-98c7-65154a6e3765 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:50.428431 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e14108f-8c3d-45f2-98c7-65154a6e3765 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:17:50.429843 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e14108f-8c3d-45f2-98c7-65154a6e3765 None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:17:50.441775 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application [None req-9e14108f-8c3d-45f2-98c7-65154a6e3765 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Oct 12 02:17:50.441775 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 02:17:50.441775 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 12 02:17:50.441775 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 12 02:17:50.441775 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 12 02:17:50.441775 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 12 02:17:50.441775 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 12 02:17:50.441775 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 12 02:17:50.441775 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 12 02:17:50.441775 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Oct 12 02:17:50.441775 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 12 02:17:50.441775 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Oct 12 02:17:50.441775 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 02:17:50.441775 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 02:17:50.441775 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 02:17:50.441775 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 02:17:50.441775 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 02:17:50.442768 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 02:17:50.442768 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 02:17:50.442768 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 02:17:50.442768 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 02:17:50.442768 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 02:17:50.442768 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 02:17:50.442768 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 12 02:17:50.442768 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 12 02:17:50.442768 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 12 02:17:50.442768 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 12 02:17:50.442768 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 02:17:50.442768 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 02:17:50.442768 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 02:17:50.442768 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 02:17:50.442768 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 02:17:50.442768 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 02:17:50.443650 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 02:17:50.443650 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application with Lock( Oct 12 02:17:50.443650 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 02:17:50.443650 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._enter() Oct 12 02:17:50.443650 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 02:17:50.443650 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 02:17:50.443650 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 02:17:50.443650 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.creator() Oct 12 02:17:50.443650 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 02:17:50.443650 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application created_value = creator( Oct 12 02:17:50.443650 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 12 02:17:50.443650 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 12 02:17:50.443650 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 12 02:17:50.443650 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Oct 12 02:17:50.444745 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 350/705] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Oct 12 02:17:50 2022] GET /identity/v3/services/compute => generated 88 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 02:17:50.448824 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:17:50.451571 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e14108f-8c3d-45f2-98c7-65154a6e3765 None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:17:50.480556 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af478bb-398d-4108-b481-54c3ed068237 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:17:50.539873 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36dc21ba-8149-451e-87e9-7da22ce85d2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:17:50.540817 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dc21ba-8149-451e-87e9-7da22ce85d2c None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:50.541302 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dc21ba-8149-451e-87e9-7da22ce85d2c None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:50.541775 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dc21ba-8149-451e-87e9-7da22ce85d2c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:50.556797 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36dc21ba-8149-451e-87e9-7da22ce85d2c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:17:50.559135 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36dc21ba-8149-451e-87e9-7da22ce85d2c None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:17:50.569382 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e14108f-8c3d-45f2-98c7-65154a6e3765 None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:17:50.586593 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-36dc21ba-8149-451e-87e9-7da22ce85d2c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 02:17:50.586593 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 02:17:50.586593 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 02:17:50.586593 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 02:17:50.586593 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 02:17:50.586593 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 02:17:50.586593 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 02:17:50.586593 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 02:17:50.586593 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 02:17:50.586593 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 02:17:50.586593 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 02:17:50.586593 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 02:17:50.586593 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 12 02:17:50.586593 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 12 02:17:50.586593 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 12 02:17:50.586593 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 12 02:17:50.587623 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 02:17:50.587623 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 02:17:50.587623 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 02:17:50.587623 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 02:17:50.587623 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 02:17:50.587623 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 02:17:50.587623 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 02:17:50.587623 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Oct 12 02:17:50.587623 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 02:17:50.587623 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Oct 12 02:17:50.587623 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 02:17:50.587623 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 02:17:50.587623 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 02:17:50.587623 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Oct 12 02:17:50.587623 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 02:17:50.587623 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Oct 12 02:17:50.587623 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 12 02:17:50.588578 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 12 02:17:50.588578 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 02:17:50.588578 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Oct 12 02:17:50.590057 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 356/706] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Oct 12 02:17:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 12 02:17:50.595175 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36dc21ba-8149-451e-87e9-7da22ce85d2c None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:17:50.611175 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bb8e97-c0c6-419b-b5f3-a60331bd6208 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:17:50.613003 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bb8e97-c0c6-419b-b5f3-a60331bd6208 None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:50.613500 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bb8e97-c0c6-419b-b5f3-a60331bd6208 None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:50.614273 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bb8e97-c0c6-419b-b5f3-a60331bd6208 None admin] PATH_INFO: `/v3/services` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:50.615397 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8bb8e97-c0c6-419b-b5f3-a60331bd6208 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 02:17:50.616045 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8bb8e97-c0c6-419b-b5f3-a60331bd6208 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:17:50.617853 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8bb8e97-c0c6-419b-b5f3-a60331bd6208 None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:17:50.627400 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 351/707] 10.222.0.18 () {56 vars in 1112 bytes} [Wed Oct 12 02:17:50 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 02:17:50.628586 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bb8e97-c0c6-419b-b5f3-a60331bd6208 None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:17:50.660889 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:17:50.727380 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36dc21ba-8149-451e-87e9-7da22ce85d2c None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:17:50.738842 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bb8e97-c0c6-419b-b5f3-a60331bd6208 None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:17:50.774474 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e732b8-aefc-4c8a-b76d-12978623ab88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:17:50.775504 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e732b8-aefc-4c8a-b76d-12978623ab88 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:50.775948 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e732b8-aefc-4c8a-b76d-12978623ab88 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:50.776448 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e732b8-aefc-4c8a-b76d-12978623ab88 None admin] PATH_INFO: `/v3/domains` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:50.777383 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e732b8-aefc-4c8a-b76d-12978623ab88 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 02:17:50.777834 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e732b8-aefc-4c8a-b76d-12978623ab88 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:17:50.778965 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33495ac6-31a2-4d1c-adf0-a776ae01df95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:17:50.779661 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e732b8-aefc-4c8a-b76d-12978623ab88 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:17:50.779779 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33495ac6-31a2-4d1c-adf0-a776ae01df95 None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:50.780117 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33495ac6-31a2-4d1c-adf0-a776ae01df95 None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:50.780513 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33495ac6-31a2-4d1c-adf0-a776ae01df95 None admin] PATH_INFO: `/v3/services` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:50.781299 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33495ac6-31a2-4d1c-adf0-a776ae01df95 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 02:17:50.781699 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33495ac6-31a2-4d1c-adf0-a776ae01df95 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:17:50.783482 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33495ac6-31a2-4d1c-adf0-a776ae01df95 None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:17:50.796532 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 352/708] 10.222.0.18 () {56 vars in 1112 bytes} [Wed Oct 12 02:17:50 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 02:17:50.796760 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:17:50.805239 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 357/709] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Oct 12 02:17:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 02:17:50.812504 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33495ac6-31a2-4d1c-adf0-a776ae01df95 None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:17:50.907522 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:17:50.922273 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33495ac6-31a2-4d1c-adf0-a776ae01df95 None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:17:50.967738 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40efdb81-0394-4400-aa68-21535cfd5709 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:17:50.968706 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40efdb81-0394-4400-aa68-21535cfd5709 None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:50.969127 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40efdb81-0394-4400-aa68-21535cfd5709 None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:50.969532 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40efdb81-0394-4400-aa68-21535cfd5709 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:50.977843 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40efdb81-0394-4400-aa68-21535cfd5709 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:17:50.979540 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40efdb81-0394-4400-aa68-21535cfd5709 None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:17:50.993607 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application [None req-40efdb81-0394-4400-aa68-21535cfd5709 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 12 02:17:50.993607 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 02:17:50.993607 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 02:17:50.993607 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 02:17:50.993607 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 02:17:50.993607 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 02:17:50.993607 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 02:17:50.993607 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 02:17:50.993607 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 02:17:50.993607 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 02:17:50.993607 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 02:17:50.993607 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 02:17:50.993607 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 12 02:17:50.993607 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 12 02:17:50.993607 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 12 02:17:50.994599 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 12 02:17:50.994599 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 02:17:50.994599 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 02:17:50.994599 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 02:17:50.994599 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 02:17:50.994599 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 02:17:50.994599 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 02:17:50.994599 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 02:17:50.994599 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application with Lock( Oct 12 02:17:50.994599 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 02:17:50.994599 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._enter() Oct 12 02:17:50.994599 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 02:17:50.994599 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 02:17:50.994599 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 02:17:50.994599 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.creator() Oct 12 02:17:50.994599 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 02:17:50.994599 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application created_value = creator( Oct 12 02:17:50.995531 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 12 02:17:50.995531 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 12 02:17:50.995531 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 12 02:17:50.995531 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 12 02:17:50.995531 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 12 02:17:50.995531 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 12 02:17:50.995531 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 12 02:17:50.995531 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Oct 12 02:17:50.997570 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 353/710] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Oct 12 02:17:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 02:17:51.004519 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e732b8-aefc-4c8a-b76d-12978623ab88 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:17:51.058807 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f07ec1-5a9f-4166-9255-b26ffcb4b2d0 None None] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:51.059140 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f07ec1-5a9f-4166-9255-b26ffcb4b2d0 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:51.059358 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f07ec1-5a9f-4166-9255-b26ffcb4b2d0 None None] PATH_INFO: `/` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:51.061153 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 354/711] 10.222.0.18 () {54 vars in 927 bytes} [Wed Oct 12 02:17:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 12 02:17:51.067238 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7768fdb5-1675-4a55-b429-6c464d855e4b None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:51.067514 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7768fdb5-1675-4a55-b429-6c464d855e4b None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:51.067788 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7768fdb5-1675-4a55-b429-6c464d855e4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:51.087523 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-7768fdb5-1675-4a55-b429-6c464d855e4b None None] MFA Rules not processed for user `a326a5bb7364479382f528a592371656`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:17:51.088845 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-7768fdb5-1675-4a55-b429-6c464d855e4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:17:51.117651 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e732b8-aefc-4c8a-b76d-12978623ab88 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:17:51.160189 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10dbb0e0-e56d-4d61-baae-80ae6c8ad959 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:17:51.161300 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dbb0e0-e56d-4d61-baae-80ae6c8ad959 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:51.161774 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dbb0e0-e56d-4d61-baae-80ae6c8ad959 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:51.162239 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dbb0e0-e56d-4d61-baae-80ae6c8ad959 None admin] PATH_INFO: `/v3/projects` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:51.163185 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10dbb0e0-e56d-4d61-baae-80ae6c8ad959 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 02:17:51.163685 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10dbb0e0-e56d-4d61-baae-80ae6c8ad959 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:17:51.165478 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10dbb0e0-e56d-4d61-baae-80ae6c8ad959 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:17:51.165940 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 355/712] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Oct 12 02:17:51 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 12 02:17:51.179679 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 358/713] 10.222.0.18 () {56 vars in 1148 bytes} [Wed Oct 12 02:17:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 02:17:51.185473 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7768fdb5-1675-4a55-b429-6c464d855e4b None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:17:51.264705 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:17:51.289198 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7768fdb5-1675-4a55-b429-6c464d855e4b None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:17:51.324443 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017f353d-666c-4dff-8740-9e3b4285b8a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:17:51.325077 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017f353d-666c-4dff-8740-9e3b4285b8a2 None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:51.325357 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017f353d-666c-4dff-8740-9e3b4285b8a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:51.325631 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017f353d-666c-4dff-8740-9e3b4285b8a2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:51.326360 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017f353d-666c-4dff-8740-9e3b4285b8a2 None admin] RBAC: Adding query filter params (role.id=b4f35c03154b4810bf6a5fafd0f5f978, scope.project.id=beb6def6fcad45959e56425bb8bff4d1, user.id=8d0e2087e5324071926c3dc3a3cb9b1d) {{(pid=81361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 02:17:51.326667 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017f353d-666c-4dff-8740-9e3b4285b8a2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:17:51.328185 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017f353d-666c-4dff-8740-9e3b4285b8a2 None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:17:51.334647 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 356/714] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Oct 12 02:17:51 2022] GET /identity/v3/role_assignments?user.id=8d0e2087e5324071926c3dc3a3cb9b1d&scope.project.id=beb6def6fcad45959e56425bb8bff4d1&role.id=b4f35c03154b4810bf6a5fafd0f5f978 => generated 608 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 02:17:51.458655 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10dbb0e0-e56d-4d61-baae-80ae6c8ad959 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:17:51.528300 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:17:51.574265 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10dbb0e0-e56d-4d61-baae-80ae6c8ad959 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:17:51.611463 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040dd9a1-3b1b-42ee-bdcc-d5463fa5a380 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:17:51.612147 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040dd9a1-3b1b-42ee-bdcc-d5463fa5a380 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:51.613032 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040dd9a1-3b1b-42ee-bdcc-d5463fa5a380 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:51.613314 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040dd9a1-3b1b-42ee-bdcc-d5463fa5a380 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:51.613905 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040dd9a1-3b1b-42ee-bdcc-d5463fa5a380 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:17:51.615574 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040dd9a1-3b1b-42ee-bdcc-d5463fa5a380 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:17:51.624817 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-040dd9a1-3b1b-42ee-bdcc-d5463fa5a380 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 12 02:17:51.624817 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 02:17:51.624817 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 12 02:17:51.624817 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 12 02:17:51.624817 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 12 02:17:51.624817 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 12 02:17:51.624817 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 12 02:17:51.624817 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 12 02:17:51.624817 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 12 02:17:51.624817 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Oct 12 02:17:51.624817 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 12 02:17:51.624817 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Oct 12 02:17:51.624817 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 02:17:51.624817 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 02:17:51.624817 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 02:17:51.624817 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 02:17:51.624817 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 02:17:51.625861 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 02:17:51.625861 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 02:17:51.625861 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 02:17:51.625861 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 02:17:51.625861 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 02:17:51.625861 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 02:17:51.625861 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 12 02:17:51.625861 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 12 02:17:51.625861 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 12 02:17:51.625861 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 12 02:17:51.625861 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 02:17:51.625861 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 02:17:51.625861 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 02:17:51.625861 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 02:17:51.625861 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 02:17:51.625861 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 02:17:51.626717 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 02:17:51.626717 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Oct 12 02:17:51.626717 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 02:17:51.626717 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Oct 12 02:17:51.626717 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 02:17:51.626717 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 02:17:51.626717 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 02:17:51.626717 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Oct 12 02:17:51.626717 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 02:17:51.626717 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Oct 12 02:17:51.626717 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 12 02:17:51.626717 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 12 02:17:51.626717 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 12 02:17:51.626717 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Oct 12 02:17:51.626717 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 359/715] 10.222.0.18 () {56 vars in 1126 bytes} [Wed Oct 12 02:17:51 2022] GET /identity/v3/services/object-store => generated 93 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 02:17:51.632708 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017f353d-666c-4dff-8740-9e3b4285b8a2 None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:17:51.740500 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017f353d-666c-4dff-8740-9e3b4285b8a2 None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:17:51.774978 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae19060-b2b3-4d5e-9d9e-4f0e1ec17ce3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:17:51.775588 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae19060-b2b3-4d5e-9d9e-4f0e1ec17ce3 None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:51.775927 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae19060-b2b3-4d5e-9d9e-4f0e1ec17ce3 None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:51.776204 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae19060-b2b3-4d5e-9d9e-4f0e1ec17ce3 None admin] PATH_INFO: `/v3/services` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:51.776867 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae19060-b2b3-4d5e-9d9e-4f0e1ec17ce3 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 02:17:51.777170 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae19060-b2b3-4d5e-9d9e-4f0e1ec17ce3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:17:51.778598 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae19060-b2b3-4d5e-9d9e-4f0e1ec17ce3 None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:17:51.783617 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 357/716] 10.222.0.18 () {56 vars in 1122 bytes} [Wed Oct 12 02:17:51 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 02:17:51.792628 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040dd9a1-3b1b-42ee-bdcc-d5463fa5a380 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:17:51.903816 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040dd9a1-3b1b-42ee-bdcc-d5463fa5a380 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:17:51.928531 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:17:51.942360 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60977cd6-b02f-484b-968b-83dc802da825 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:17:51.943256 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60977cd6-b02f-484b-968b-83dc802da825 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:51.943754 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60977cd6-b02f-484b-968b-83dc802da825 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:51.944240 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60977cd6-b02f-484b-968b-83dc802da825 None admin] PATH_INFO: `/v3/services` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:51.945107 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60977cd6-b02f-484b-968b-83dc802da825 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 02:17:51.945608 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60977cd6-b02f-484b-968b-83dc802da825 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:17:51.947201 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60977cd6-b02f-484b-968b-83dc802da825 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:17:51.952764 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 360/717] 10.222.0.18 () {56 vars in 1122 bytes} [Wed Oct 12 02:17:51 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 02:17:51.959351 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae19060-b2b3-4d5e-9d9e-4f0e1ec17ce3 None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:17:51.967951 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:17:52.074013 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae19060-b2b3-4d5e-9d9e-4f0e1ec17ce3 None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:17:52.110099 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e4a7a5-97b6-417c-b2b1-8be7c8221798 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:17:52.110753 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e4a7a5-97b6-417c-b2b1-8be7c8221798 None admin] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:52.111038 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e4a7a5-97b6-417c-b2b1-8be7c8221798 None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:52.111350 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e4a7a5-97b6-417c-b2b1-8be7c8221798 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:52.112089 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e4a7a5-97b6-417c-b2b1-8be7c8221798 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:17:52.113605 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e4a7a5-97b6-417c-b2b1-8be7c8221798 None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:17:52.136291 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 358/718] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Oct 12 02:17:51 2022] POST /identity/v3/endpoints => generated 349 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 02:17:52.461286 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d43c00-23ed-493c-8ec5-73673d7d690b None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:52.461645 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d43c00-23ed-493c-8ec5-73673d7d690b None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:52.461824 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d43c00-23ed-493c-8ec5-73673d7d690b None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:52.463394 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 361/719] 10.222.0.18 () {54 vars in 927 bytes} [Wed Oct 12 02:17:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 02:17:52.468721 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cf092f-5c15-42ab-896f-1eec276ce0d9 None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:52.469009 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cf092f-5c15-42ab-896f-1eec276ce0d9 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:52.469283 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cf092f-5c15-42ab-896f-1eec276ce0d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:52.488054 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-91cf092f-5c15-42ab-896f-1eec276ce0d9 None None] MFA Rules not processed for user `a326a5bb7364479382f528a592371656`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:17:52.489132 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-91cf092f-5c15-42ab-896f-1eec276ce0d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:17:52.552173 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:17:52.571378 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 359/720] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Oct 12 02:17:52 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 12 02:17:52.837051 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d43c00-23ed-493c-8ec5-73673d7d690b None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:17:52.947184 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d43c00-23ed-493c-8ec5-73673d7d690b None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:17:52.983205 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1cb17f-ba78-4480-8b4c-00f6ba57f34d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:17:52.983838 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1cb17f-ba78-4480-8b4c-00f6ba57f34d None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:52.984115 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1cb17f-ba78-4480-8b4c-00f6ba57f34d None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:52.984383 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1cb17f-ba78-4480-8b4c-00f6ba57f34d None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:52.984998 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1cb17f-ba78-4480-8b4c-00f6ba57f34d None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:17:52.986374 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1cb17f-ba78-4480-8b4c-00f6ba57f34d None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:17:52.996213 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-5e1cb17f-ba78-4480-8b4c-00f6ba57f34d None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 12 02:17:52.996213 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 02:17:52.996213 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 12 02:17:52.996213 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 12 02:17:52.996213 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 12 02:17:52.996213 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 12 02:17:52.996213 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 12 02:17:52.996213 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 12 02:17:52.996213 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 12 02:17:52.996213 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Oct 12 02:17:52.996213 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 12 02:17:52.996213 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Oct 12 02:17:52.996213 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 02:17:52.996213 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 02:17:52.996213 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 02:17:52.996213 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 02:17:52.996213 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 02:17:52.997249 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 02:17:52.997249 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 02:17:52.997249 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 02:17:52.997249 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 02:17:52.997249 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 02:17:52.997249 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 02:17:52.997249 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 12 02:17:52.997249 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 12 02:17:52.997249 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 12 02:17:52.997249 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 12 02:17:52.997249 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 02:17:52.997249 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 02:17:52.997249 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 02:17:52.997249 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 02:17:52.997249 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 02:17:52.997249 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 02:17:52.998098 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 02:17:52.998098 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Oct 12 02:17:52.998098 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 02:17:52.998098 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Oct 12 02:17:52.998098 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 02:17:52.998098 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 02:17:52.998098 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 02:17:52.998098 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Oct 12 02:17:52.998098 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 02:17:52.998098 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Oct 12 02:17:52.998098 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 12 02:17:52.998098 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 12 02:17:52.998098 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 12 02:17:52.998098 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Oct 12 02:17:52.998098 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 362/721] 10.222.0.18 () {56 vars in 1114 bytes} [Wed Oct 12 02:17:52 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 02:17:53.003896 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cf092f-5c15-42ab-896f-1eec276ce0d9 None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:17:53.117124 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cf092f-5c15-42ab-896f-1eec276ce0d9 None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:17:53.153189 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739caa25-21db-4aa9-a061-38b20db54997 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:17:53.153856 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739caa25-21db-4aa9-a061-38b20db54997 None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:53.154143 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739caa25-21db-4aa9-a061-38b20db54997 None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:53.154418 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739caa25-21db-4aa9-a061-38b20db54997 None admin] PATH_INFO: `/v3/services` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:53.155048 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739caa25-21db-4aa9-a061-38b20db54997 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 02:17:53.155350 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739caa25-21db-4aa9-a061-38b20db54997 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:17:53.156745 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739caa25-21db-4aa9-a061-38b20db54997 None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:17:53.161971 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 360/722] 10.222.0.18 () {56 vars in 1114 bytes} [Wed Oct 12 02:17:53 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 02:17:53.167425 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1cb17f-ba78-4480-8b4c-00f6ba57f34d None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:17:53.194025 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3341eb1a-b630-4ca7-9c5b-ce4650775387 None None] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:53.194322 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3341eb1a-b630-4ca7-9c5b-ce4650775387 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:53.194592 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3341eb1a-b630-4ca7-9c5b-ce4650775387 None None] PATH_INFO: `/` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:53.196171 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 361/723] 10.222.0.18 () {54 vars in 927 bytes} [Wed Oct 12 02:17:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 12 02:17:53.201011 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d325703-6cac-4721-a871-516a05dc570e None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:53.201288 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d325703-6cac-4721-a871-516a05dc570e None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:53.201568 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d325703-6cac-4721-a871-516a05dc570e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:53.221629 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:17:53.224305 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-1d325703-6cac-4721-a871-516a05dc570e None None] MFA Rules not processed for user `a326a5bb7364479382f528a592371656`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:17:53.225641 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-1d325703-6cac-4721-a871-516a05dc570e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:17:53.277970 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1cb17f-ba78-4480-8b4c-00f6ba57f34d None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:17:53.286103 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:17:53.314745 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 362/724] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Oct 12 02:17:53 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 12 02:17:53.324744 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604d1896-6cbb-44c1-af1f-c26336bc0353 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:17:53.325538 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604d1896-6cbb-44c1-af1f-c26336bc0353 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:53.325975 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604d1896-6cbb-44c1-af1f-c26336bc0353 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:53.326386 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604d1896-6cbb-44c1-af1f-c26336bc0353 None admin] PATH_INFO: `/v3/services` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:53.327156 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604d1896-6cbb-44c1-af1f-c26336bc0353 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 02:17:53.327611 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604d1896-6cbb-44c1-af1f-c26336bc0353 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:17:53.329130 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604d1896-6cbb-44c1-af1f-c26336bc0353 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:17:53.339155 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 363/725] 10.222.0.18 () {56 vars in 1114 bytes} [Wed Oct 12 02:17:53 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 02:17:53.340683 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d325703-6cac-4721-a871-516a05dc570e None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:17:53.447618 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d325703-6cac-4721-a871-516a05dc570e None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:17:53.483370 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f151fb-e18d-4587-b5ce-57336e8434cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:17:53.483972 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f151fb-e18d-4587-b5ce-57336e8434cd None admin] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:53.484250 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f151fb-e18d-4587-b5ce-57336e8434cd None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:53.484549 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f151fb-e18d-4587-b5ce-57336e8434cd None admin] PATH_INFO: `/v3/endpoints` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:53.485231 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f151fb-e18d-4587-b5ce-57336e8434cd None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:17:53.486810 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f151fb-e18d-4587-b5ce-57336e8434cd None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:17:53.509623 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 363/726] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Oct 12 02:17:53 2022] POST /identity/v3/endpoints => generated 346 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 02:17:53.618586 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604d1896-6cbb-44c1-af1f-c26336bc0353 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:17:53.677317 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf995b2f-4a33-48e8-90aa-680d34e9c9da None None] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:53.677631 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf995b2f-4a33-48e8-90aa-680d34e9c9da None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:53.677857 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf995b2f-4a33-48e8-90aa-680d34e9c9da None None] PATH_INFO: `/` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:53.679451 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 364/727] 10.222.0.18 () {54 vars in 927 bytes} [Wed Oct 12 02:17:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 02:17:53.685051 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c146252-46c0-4097-8135-0b4361475776 None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:53.685333 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c146252-46c0-4097-8135-0b4361475776 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:53.685614 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c146252-46c0-4097-8135-0b4361475776 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:53.705180 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-7c146252-46c0-4097-8135-0b4361475776 None None] MFA Rules not processed for user `a326a5bb7364479382f528a592371656`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:17:53.706698 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-7c146252-46c0-4097-8135-0b4361475776 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:17:53.733763 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604d1896-6cbb-44c1-af1f-c26336bc0353 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:17:53.742626 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:17:53.750471 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:17:53.787093 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654c8956-fb06-446a-a10a-a8bce752730b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:17:53.788133 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654c8956-fb06-446a-a10a-a8bce752730b None admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:53.788574 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654c8956-fb06-446a-a10a-a8bce752730b None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:53.788981 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654c8956-fb06-446a-a10a-a8bce752730b None admin] PATH_INFO: `/v3/services` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:53.789882 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654c8956-fb06-446a-a10a-a8bce752730b None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:17:53.791929 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654c8956-fb06-446a-a10a-a8bce752730b None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:17:53.795310 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 365/728] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Oct 12 02:17:53 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 12 02:17:53.819847 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 364/729] 10.222.0.18 () {60 vars in 1141 bytes} [Wed Oct 12 02:17:53 2022] POST /identity/v3/services => generated 242 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 02:17:54.070031 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c146252-46c0-4097-8135-0b4361475776 None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:17:54.177750 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c146252-46c0-4097-8135-0b4361475776 None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:17:54.220883 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e05a64-af4c-4953-84ab-35bae688a101 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:17:54.222587 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e05a64-af4c-4953-84ab-35bae688a101 None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:54.222870 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e05a64-af4c-4953-84ab-35bae688a101 None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:54.223141 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e05a64-af4c-4953-84ab-35bae688a101 None admin] PATH_INFO: `/v3/services/image` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:54.223718 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e05a64-af4c-4953-84ab-35bae688a101 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:17:54.225120 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e05a64-af4c-4953-84ab-35bae688a101 None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:17:54.234135 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application [None req-b9e05a64-af4c-4953-84ab-35bae688a101 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Oct 12 02:17:54.234135 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 02:17:54.234135 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 12 02:17:54.234135 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 12 02:17:54.234135 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 12 02:17:54.234135 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 12 02:17:54.234135 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 12 02:17:54.234135 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 12 02:17:54.234135 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 12 02:17:54.234135 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Oct 12 02:17:54.234135 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 12 02:17:54.234135 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Oct 12 02:17:54.234135 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 02:17:54.234135 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 02:17:54.234135 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 02:17:54.234135 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 02:17:54.234135 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 02:17:54.235127 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 02:17:54.235127 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 02:17:54.235127 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 02:17:54.235127 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 02:17:54.235127 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 02:17:54.235127 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 02:17:54.235127 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 12 02:17:54.235127 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 12 02:17:54.235127 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 12 02:17:54.235127 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 12 02:17:54.235127 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 02:17:54.235127 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 02:17:54.235127 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 02:17:54.235127 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 02:17:54.235127 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 02:17:54.235127 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 02:17:54.235984 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 02:17:54.235984 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application with Lock( Oct 12 02:17:54.235984 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 02:17:54.235984 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._enter() Oct 12 02:17:54.235984 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 02:17:54.235984 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 02:17:54.235984 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 02:17:54.235984 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.creator() Oct 12 02:17:54.235984 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 02:17:54.235984 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application created_value = creator( Oct 12 02:17:54.235984 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 12 02:17:54.235984 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 12 02:17:54.235984 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 12 02:17:54.235984 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Oct 12 02:17:54.235984 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 366/730] 10.222.0.18 () {56 vars in 1105 bytes} [Wed Oct 12 02:17:54 2022] GET /identity/v3/services/image => generated 86 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 02:17:54.243802 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654c8956-fb06-446a-a10a-a8bce752730b None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:17:54.358782 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654c8956-fb06-446a-a10a-a8bce752730b None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:17:54.393759 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957fde1b-845e-4bd7-9fc3-d7a6c356cd6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:17:54.394371 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957fde1b-845e-4bd7-9fc3-d7a6c356cd6f None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:54.394645 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957fde1b-845e-4bd7-9fc3-d7a6c356cd6f None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:54.394913 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957fde1b-845e-4bd7-9fc3-d7a6c356cd6f None admin] PATH_INFO: `/v3/services` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:54.395547 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957fde1b-845e-4bd7-9fc3-d7a6c356cd6f None admin] RBAC: Adding query filter params (name=image) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 02:17:54.395844 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957fde1b-845e-4bd7-9fc3-d7a6c356cd6f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:17:54.397241 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957fde1b-845e-4bd7-9fc3-d7a6c356cd6f None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:17:54.402533 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 365/731] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Oct 12 02:17:54 2022] GET /identity/v3/services?name=image => generated 122 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 02:17:54.408039 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e05a64-af4c-4953-84ab-35bae688a101 None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:17:54.437772 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:17:54.446626 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1e1afc-81ee-48e1-a71f-e9ed554afa62 None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:54.446919 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1e1afc-81ee-48e1-a71f-e9ed554afa62 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:54.447186 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1e1afc-81ee-48e1-a71f-e9ed554afa62 None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:54.448768 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 366/732] 10.222.0.18 () {54 vars in 927 bytes} [Wed Oct 12 02:17:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 02:17:54.453573 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c799af-7bd5-4d09-b838-53efb4108c17 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:54.453847 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c799af-7bd5-4d09-b838-53efb4108c17 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:54.454115 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c799af-7bd5-4d09-b838-53efb4108c17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:54.477207 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-d5c799af-7bd5-4d09-b838-53efb4108c17 None None] MFA Rules not processed for user `a326a5bb7364479382f528a592371656`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:17:54.478736 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-d5c799af-7bd5-4d09-b838-53efb4108c17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:17:54.512508 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:17:54.546006 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e05a64-af4c-4953-84ab-35bae688a101 None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:17:54.559198 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 367/733] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Oct 12 02:17:54 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 12 02:17:54.588706 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef5942e-27e2-42c9-96dc-74636ca221eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:17:54.589307 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef5942e-27e2-42c9-96dc-74636ca221eb None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:54.589579 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef5942e-27e2-42c9-96dc-74636ca221eb None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:54.589847 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef5942e-27e2-42c9-96dc-74636ca221eb None admin] PATH_INFO: `/v3/services` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:54.590473 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef5942e-27e2-42c9-96dc-74636ca221eb None admin] RBAC: Adding query filter params (type=image) {{(pid=81361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 02:17:54.590771 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef5942e-27e2-42c9-96dc-74636ca221eb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:17:54.592123 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef5942e-27e2-42c9-96dc-74636ca221eb None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:17:54.597231 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 367/734] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Oct 12 02:17:54 2022] GET /identity/v3/services?type=image => generated 122 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 02:17:54.826755 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c799af-7bd5-4d09-b838-53efb4108c17 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:17:54.930782 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c799af-7bd5-4d09-b838-53efb4108c17 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:17:54.965341 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f61716-919e-4c0a-8757-347f301c46d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:17:54.965974 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f61716-919e-4c0a-8757-347f301c46d5 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:54.966247 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f61716-919e-4c0a-8757-347f301c46d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:54.966516 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f61716-919e-4c0a-8757-347f301c46d5 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:54.967100 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f61716-919e-4c0a-8757-347f301c46d5 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:17:54.968482 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f61716-919e-4c0a-8757-347f301c46d5 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:17:54.977935 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-61f61716-919e-4c0a-8757-347f301c46d5 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 12 02:17:54.977935 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 02:17:54.977935 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 12 02:17:54.977935 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 12 02:17:54.977935 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 12 02:17:54.977935 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 12 02:17:54.977935 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 12 02:17:54.977935 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 12 02:17:54.977935 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 12 02:17:54.977935 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Oct 12 02:17:54.977935 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 12 02:17:54.977935 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Oct 12 02:17:54.977935 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 02:17:54.977935 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 02:17:54.977935 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 02:17:54.977935 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 02:17:54.977935 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 02:17:54.978927 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 02:17:54.978927 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 02:17:54.978927 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 02:17:54.978927 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 02:17:54.978927 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 02:17:54.978927 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 02:17:54.978927 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 12 02:17:54.978927 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 12 02:17:54.978927 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 12 02:17:54.978927 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 12 02:17:54.978927 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 02:17:54.978927 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 02:17:54.978927 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 02:17:54.978927 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 02:17:54.978927 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 02:17:54.978927 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 02:17:54.979812 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 02:17:54.979812 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Oct 12 02:17:54.979812 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 02:17:54.979812 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Oct 12 02:17:54.979812 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 02:17:54.979812 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 02:17:54.979812 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 02:17:54.979812 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Oct 12 02:17:54.979812 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 02:17:54.979812 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Oct 12 02:17:54.979812 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 12 02:17:54.979812 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 12 02:17:54.979812 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 12 02:17:54.979812 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Oct 12 02:17:54.979812 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 368/735] 10.222.0.18 () {56 vars in 1126 bytes} [Wed Oct 12 02:17:54 2022] GET /identity/v3/services/object-store => generated 93 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 02:17:54.987172 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef5942e-27e2-42c9-96dc-74636ca221eb None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:17:55.083257 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:17:55.093597 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef5942e-27e2-42c9-96dc-74636ca221eb None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:17:55.129754 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b1070b-5ccb-4a50-9758-0b5ad15c4828 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:17:55.130371 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b1070b-5ccb-4a50-9758-0b5ad15c4828 None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:55.130645 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b1070b-5ccb-4a50-9758-0b5ad15c4828 None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:55.130918 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b1070b-5ccb-4a50-9758-0b5ad15c4828 None admin] PATH_INFO: `/v3/services` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:55.131544 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b1070b-5ccb-4a50-9758-0b5ad15c4828 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 02:17:55.131850 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b1070b-5ccb-4a50-9758-0b5ad15c4828 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:17:55.133240 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b1070b-5ccb-4a50-9758-0b5ad15c4828 None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:17:55.138570 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 368/736] 10.222.0.18 () {56 vars in 1122 bytes} [Wed Oct 12 02:17:54 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 02:17:55.145036 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f61716-919e-4c0a-8757-347f301c46d5 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:17:55.175923 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:17:55.249881 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f61716-919e-4c0a-8757-347f301c46d5 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:17:55.285144 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb8fd89-f2e6-421a-8754-e5557e374b7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:17:55.285749 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb8fd89-f2e6-421a-8754-e5557e374b7f None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:55.286023 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb8fd89-f2e6-421a-8754-e5557e374b7f None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:55.286289 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb8fd89-f2e6-421a-8754-e5557e374b7f None admin] PATH_INFO: `/v3/services` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:55.286981 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb8fd89-f2e6-421a-8754-e5557e374b7f None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 02:17:55.287282 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb8fd89-f2e6-421a-8754-e5557e374b7f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:17:55.288657 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb8fd89-f2e6-421a-8754-e5557e374b7f None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:17:55.294130 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 369/737] 10.222.0.18 () {56 vars in 1122 bytes} [Wed Oct 12 02:17:55 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 02:17:55.301009 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b1070b-5ccb-4a50-9758-0b5ad15c4828 None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:17:55.412223 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b1070b-5ccb-4a50-9758-0b5ad15c4828 None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:17:55.447655 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa5261e-2269-4631-bc8d-6a3ca3b30f41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:17:55.448265 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa5261e-2269-4631-bc8d-6a3ca3b30f41 None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:55.448570 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa5261e-2269-4631-bc8d-6a3ca3b30f41 None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:55.448844 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa5261e-2269-4631-bc8d-6a3ca3b30f41 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:55.449554 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa5261e-2269-4631-bc8d-6a3ca3b30f41 None admin] RBAC: Adding query filter params (interface=admin, service_id=2ba7b620cfa24da0a64755c9d8a92d6c, region_id=RegionOne) {{(pid=81361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 02:17:55.449860 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa5261e-2269-4631-bc8d-6a3ca3b30f41 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:17:55.451231 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa5261e-2269-4631-bc8d-6a3ca3b30f41 None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:17:55.457885 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 369/738] 10.222.0.18 () {56 vars in 1249 bytes} [Wed Oct 12 02:17:55 2022] GET /identity/v3/endpoints?service_id=2ba7b620cfa24da0a64755c9d8a92d6c&interface=admin®ion_id=RegionOne => generated 193 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 02:17:55.463732 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb8fd89-f2e6-421a-8754-e5557e374b7f None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:17:55.564256 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:17:55.574463 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb8fd89-f2e6-421a-8754-e5557e374b7f None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:17:55.609408 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d61a82b-6757-4971-89a5-5382d46de44c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:17:55.610013 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d61a82b-6757-4971-89a5-5382d46de44c None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:55.610288 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d61a82b-6757-4971-89a5-5382d46de44c None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:55.610558 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d61a82b-6757-4971-89a5-5382d46de44c None admin] PATH_INFO: `/v3/services` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:55.611164 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d61a82b-6757-4971-89a5-5382d46de44c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:17:55.613554 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d61a82b-6757-4971-89a5-5382d46de44c None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:17:55.620346 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 370/739] 10.222.0.18 () {56 vars in 1087 bytes} [Wed Oct 12 02:17:55 2022] GET /identity/v3/services => generated 1727 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 02:17:55.841177 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda7bd05-7458-483b-91bf-2b473bae1cd9 None None] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:55.841516 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda7bd05-7458-483b-91bf-2b473bae1cd9 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:55.841693 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda7bd05-7458-483b-91bf-2b473bae1cd9 None None] PATH_INFO: `/` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:55.843249 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 370/740] 10.222.0.18 () {54 vars in 927 bytes} [Wed Oct 12 02:17:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 02:17:55.849454 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6e7039-67ff-41ef-b1be-242f79917887 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:55.849739 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6e7039-67ff-41ef-b1be-242f79917887 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:55.850011 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6e7039-67ff-41ef-b1be-242f79917887 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:55.868537 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-6f6e7039-67ff-41ef-b1be-242f79917887 None None] MFA Rules not processed for user `a326a5bb7364479382f528a592371656`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:17:55.869713 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-6f6e7039-67ff-41ef-b1be-242f79917887 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:17:55.941567 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 371/741] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Oct 12 02:17:55 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 12 02:17:56.186802 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600d15dc-686d-495e-8ce9-9cd98c192cf2 None None] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:56.187317 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600d15dc-686d-495e-8ce9-9cd98c192cf2 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:56.187317 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600d15dc-686d-495e-8ce9-9cd98c192cf2 None None] PATH_INFO: `/` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:56.189001 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 371/742] 10.222.0.18 () {54 vars in 927 bytes} [Wed Oct 12 02:17:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 02:17:56.194452 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbeff34-45df-439e-905d-3d3cd21c2212 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:56.194743 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbeff34-45df-439e-905d-3d3cd21c2212 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:56.195021 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbeff34-45df-439e-905d-3d3cd21c2212 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:56.214642 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-adbeff34-45df-439e-905d-3d3cd21c2212 None None] MFA Rules not processed for user `a326a5bb7364479382f528a592371656`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:17:56.215832 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-adbeff34-45df-439e-905d-3d3cd21c2212 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:17:56.226978 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600d15dc-686d-495e-8ce9-9cd98c192cf2 None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:17:56.249074 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:17:56.300052 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 372/743] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Oct 12 02:17:56 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 12 02:17:56.354949 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600d15dc-686d-495e-8ce9-9cd98c192cf2 None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:17:56.391407 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad621fd-a99d-42d8-91bf-fab62db894fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:17:56.392012 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad621fd-a99d-42d8-91bf-fab62db894fe None admin] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:56.392290 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad621fd-a99d-42d8-91bf-fab62db894fe None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:56.392586 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad621fd-a99d-42d8-91bf-fab62db894fe None admin] PATH_INFO: `/v3/projects` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:56.393511 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad621fd-a99d-42d8-91bf-fab62db894fe None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:17:56.394998 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad621fd-a99d-42d8-91bf-fab62db894fe None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:17:56.397639 dv-cinder-849143-14-smb devstack@keystone.service[81361]: WARNING keystone.server.flask.common [None req-2ad621fd-a99d-42d8-91bf-fab62db894fe None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Oct 12 02:17:56.416947 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.sql.core [None req-2ad621fd-a99d-42d8-91bf-fab62db894fe None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Oct 12 02:17:56.416947 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 12 02:17:56.416947 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [parameters: {'id': 'f82c44c7875448f3a427376e1e21f9d4', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Oct 12 02:17:56.416947 dv-cinder-849143-14-smb devstack@keystone.service[81361]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81361) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 12 02:17:56.424690 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application [None req-2ad621fd-a99d-42d8-91bf-fab62db894fe None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id f82c44c7875448f3a427376e1e21f9d4.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id f82c44c7875448f3a427376e1e21f9d4. Oct 12 02:17:56.424690 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 02:17:56.424690 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 12 02:17:56.424690 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 12 02:17:56.424690 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 12 02:17:56.424690 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 12 02:17:56.424690 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 12 02:17:56.424690 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application result = self._query(query) Oct 12 02:17:56.424690 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 12 02:17:56.424690 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application conn.query(q) Oct 12 02:17:56.424690 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 12 02:17:56.424690 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 12 02:17:56.424690 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 12 02:17:56.425512 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application result.read() Oct 12 02:17:56.425512 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 12 02:17:56.425512 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 12 02:17:56.425512 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 12 02:17:56.425512 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 12 02:17:56.425512 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 12 02:17:56.425512 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 12 02:17:56.425512 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 12 02:17:56.425512 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 12 02:17:56.425512 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Oct 12 02:17:56.425512 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Oct 12 02:17:56.425512 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 12 02:17:56.425512 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Oct 12 02:17:56.425512 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 02:17:56.425512 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 12 02:17:56.425512 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 12 02:17:56.425512 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Oct 12 02:17:56.425512 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return project_ref.to_dict() Oct 12 02:17:56.426475 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 12 02:17:56.426475 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application next(self.gen) Oct 12 02:17:56.426475 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Oct 12 02:17:56.426475 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application yield resource Oct 12 02:17:56.426475 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 12 02:17:56.426475 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application next(self.gen) Oct 12 02:17:56.426475 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Oct 12 02:17:56.426475 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application self.session.rollback() Oct 12 02:17:56.426475 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 12 02:17:56.426475 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application self.force_reraise() Oct 12 02:17:56.426475 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 12 02:17:56.426475 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application raise self.value Oct 12 02:17:56.426475 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Oct 12 02:17:56.426475 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 12 02:17:56.426475 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Oct 12 02:17:56.426475 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application session.commit() Oct 12 02:17:56.426475 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 12 02:17:56.427424 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 12 02:17:56.427424 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 12 02:17:56.427424 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application self._prepare_impl() Oct 12 02:17:56.427424 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 12 02:17:56.427424 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application self.session.flush() Oct 12 02:17:56.427424 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 12 02:17:56.427424 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application self._flush(objects) Oct 12 02:17:56.427424 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 12 02:17:56.427424 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 12 02:17:56.427424 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 12 02:17:56.427424 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application compat.raise_( Oct 12 02:17:56.427424 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 12 02:17:56.427424 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application raise exception Oct 12 02:17:56.427424 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 12 02:17:56.427424 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application flush_context.execute() Oct 12 02:17:56.427424 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 12 02:17:56.427424 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application rec.execute(self) Oct 12 02:17:56.428352 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 12 02:17:56.428352 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 12 02:17:56.428352 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 12 02:17:56.428352 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 12 02:17:56.428352 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Oct 12 02:17:56.428352 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application c = connection._execute_20( Oct 12 02:17:56.428352 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 12 02:17:56.428352 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 12 02:17:56.428352 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 12 02:17:56.428352 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 12 02:17:56.428352 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 12 02:17:56.428352 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 12 02:17:56.428352 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 12 02:17:56.428352 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 12 02:17:56.428352 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 12 02:17:56.430867 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 12 02:17:56.430867 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 12 02:17:56.430867 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application raise exception Oct 12 02:17:56.430867 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 12 02:17:56.430867 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 12 02:17:56.430867 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 12 02:17:56.430867 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 12 02:17:56.430867 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 12 02:17:56.430867 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application result = self._query(query) Oct 12 02:17:56.430867 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 12 02:17:56.430867 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application conn.query(q) Oct 12 02:17:56.430867 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 12 02:17:56.430867 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 12 02:17:56.430867 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 12 02:17:56.430867 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application result.read() Oct 12 02:17:56.430867 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 12 02:17:56.430867 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 12 02:17:56.432006 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 12 02:17:56.432006 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 12 02:17:56.432006 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 12 02:17:56.432006 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 12 02:17:56.432006 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 12 02:17:56.432006 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 12 02:17:56.432006 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Oct 12 02:17:56.432006 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 12 02:17:56.432006 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application [parameters: {'id': 'f82c44c7875448f3a427376e1e21f9d4', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Oct 12 02:17:56.432006 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 12 02:17:56.432006 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Oct 12 02:17:56.432006 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 12 02:17:56.432006 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Oct 12 02:17:56.432006 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 02:17:56.432006 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Oct 12 02:17:56.433061 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Oct 12 02:17:56.433061 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 12 02:17:56.433061 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 12 02:17:56.433061 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Oct 12 02:17:56.433061 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Oct 12 02:17:56.433061 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 12 02:17:56.433061 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Oct 12 02:17:56.433061 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 02:17:56.433061 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 02:17:56.433061 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 02:17:56.433061 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 02:17:56.433061 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 02:17:56.433061 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 02:17:56.433061 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 02:17:56.433061 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 02:17:56.433061 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 02:17:56.433061 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 02:17:56.434193 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 02:17:56.434193 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Oct 12 02:17:56.434193 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Oct 12 02:17:56.434193 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 02:17:56.434193 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 02:17:56.434193 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Oct 12 02:17:56.434193 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application raise exception.Conflict( Oct 12 02:17:56.434193 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id f82c44c7875448f3a427376e1e21f9d4. Oct 12 02:17:56.434193 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Oct 12 02:17:56.434193 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 372/744] 10.222.0.18 () {60 vars in 1140 bytes} [Wed Oct 12 02:17:56 2022] POST /identity/v3/projects => generated 262 bytes in 199 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Oct 12 02:17:56.435939 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbeff34-45df-439e-905d-3d3cd21c2212 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:17:56.455174 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:17:56.542008 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbeff34-45df-439e-905d-3d3cd21c2212 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:17:56.579519 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d2d600-20b4-4ffd-be85-b792ce8b3c7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:17:56.580159 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d2d600-20b4-4ffd-be85-b792ce8b3c7b None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:56.580579 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d2d600-20b4-4ffd-be85-b792ce8b3c7b None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:56.580904 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d2d600-20b4-4ffd-be85-b792ce8b3c7b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:56.585185 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad621fd-a99d-42d8-91bf-fab62db894fe None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:17:56.590212 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d2d600-20b4-4ffd-be85-b792ce8b3c7b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:17:56.591661 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d2d600-20b4-4ffd-be85-b792ce8b3c7b None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:17:56.607483 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-42d2d600-20b4-4ffd-be85-b792ce8b3c7b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 12 02:17:56.607483 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 02:17:56.607483 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 02:17:56.607483 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 02:17:56.607483 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 02:17:56.607483 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 02:17:56.607483 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 02:17:56.607483 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 02:17:56.607483 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 02:17:56.607483 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 02:17:56.607483 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 02:17:56.607483 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 02:17:56.607483 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 12 02:17:56.607483 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 12 02:17:56.607483 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 12 02:17:56.608404 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 12 02:17:56.608404 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 02:17:56.608404 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 02:17:56.608404 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 02:17:56.608404 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 02:17:56.608404 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 02:17:56.608404 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 02:17:56.608404 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 02:17:56.608404 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Oct 12 02:17:56.608404 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 02:17:56.608404 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Oct 12 02:17:56.608404 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 02:17:56.608404 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 02:17:56.608404 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 02:17:56.608404 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Oct 12 02:17:56.608404 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 02:17:56.608404 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Oct 12 02:17:56.609325 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 12 02:17:56.609325 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 12 02:17:56.609325 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 12 02:17:56.609325 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 12 02:17:56.609325 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 12 02:17:56.609325 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 12 02:17:56.609325 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 12 02:17:56.609325 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Oct 12 02:17:56.609325 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 373/745] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Oct 12 02:17:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 02:17:56.616191 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d2d600-20b4-4ffd-be85-b792ce8b3c7b None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:17:56.683417 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:17:56.716923 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad621fd-a99d-42d8-91bf-fab62db894fe None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:17:56.720683 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:17:56.753602 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d2d600-20b4-4ffd-be85-b792ce8b3c7b None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:17:56.764087 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6e6049-45eb-47f8-b41e-cda420523080 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:17:56.764920 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6e6049-45eb-47f8-b41e-cda420523080 None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:56.765962 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6e6049-45eb-47f8-b41e-cda420523080 None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:56.766350 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6e6049-45eb-47f8-b41e-cda420523080 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:56.767059 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6e6049-45eb-47f8-b41e-cda420523080 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:17:56.769956 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6e6049-45eb-47f8-b41e-cda420523080 None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:17:56.781962 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application [None req-3c6e6049-45eb-47f8-b41e-cda420523080 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Oct 12 02:17:56.781962 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 02:17:56.781962 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 12 02:17:56.781962 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 12 02:17:56.781962 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 12 02:17:56.781962 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 12 02:17:56.781962 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 12 02:17:56.781962 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 12 02:17:56.781962 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 12 02:17:56.781962 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Oct 12 02:17:56.781962 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 12 02:17:56.781962 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Oct 12 02:17:56.781962 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 02:17:56.781962 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 02:17:56.781962 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 02:17:56.781962 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 02:17:56.781962 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 02:17:56.783189 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 02:17:56.783189 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 02:17:56.783189 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 02:17:56.783189 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 02:17:56.783189 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 02:17:56.783189 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 02:17:56.783189 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 12 02:17:56.783189 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 12 02:17:56.783189 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 12 02:17:56.783189 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 12 02:17:56.783189 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 02:17:56.783189 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 02:17:56.783189 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 02:17:56.783189 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 02:17:56.783189 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 02:17:56.783189 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 02:17:56.788856 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 02:17:56.788856 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application with Lock( Oct 12 02:17:56.788856 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 02:17:56.788856 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._enter() Oct 12 02:17:56.788856 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 02:17:56.788856 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 02:17:56.788856 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 02:17:56.788856 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.creator() Oct 12 02:17:56.788856 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 02:17:56.788856 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application created_value = creator( Oct 12 02:17:56.788856 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 12 02:17:56.788856 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 12 02:17:56.788856 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 12 02:17:56.788856 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Oct 12 02:17:56.788856 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 373/746] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Oct 12 02:17:56 2022] GET /identity/v3/services/compute => generated 88 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 02:17:56.791804 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6e6049-45eb-47f8-b41e-cda420523080 None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:17:56.805034 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9300e8f-8a24-4484-8437-fe2c304ae9f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:17:56.805901 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9300e8f-8a24-4484-8437-fe2c304ae9f2 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:56.806014 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9300e8f-8a24-4484-8437-fe2c304ae9f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:56.806267 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9300e8f-8a24-4484-8437-fe2c304ae9f2 None admin] PATH_INFO: `/v3/projects` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:56.806931 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9300e8f-8a24-4484-8437-fe2c304ae9f2 None admin] RBAC: Adding query filter params (name=service) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 02:17:56.807229 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9300e8f-8a24-4484-8437-fe2c304ae9f2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:17:56.808781 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9300e8f-8a24-4484-8437-fe2c304ae9f2 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:17:56.832708 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 374/747] 10.222.0.18 () {56 vars in 1112 bytes} [Wed Oct 12 02:17:56 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 02:17:56.864158 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135a0045-64c2-4e14-9ed0-bd553c76e56a None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:56.864741 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135a0045-64c2-4e14-9ed0-bd553c76e56a None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:56.865171 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135a0045-64c2-4e14-9ed0-bd553c76e56a None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:56.866514 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 375/748] 10.222.0.18 () {54 vars in 927 bytes} [Wed Oct 12 02:17:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 02:17:56.872833 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3330fa39-916f-4cfb-80ec-08799b03aaa6 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:56.873141 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3330fa39-916f-4cfb-80ec-08799b03aaa6 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:56.873391 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3330fa39-916f-4cfb-80ec-08799b03aaa6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:56.895169 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-3330fa39-916f-4cfb-80ec-08799b03aaa6 None None] MFA Rules not processed for user `a326a5bb7364479382f528a592371656`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:17:56.897232 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-3330fa39-916f-4cfb-80ec-08799b03aaa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:17:56.915369 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6e6049-45eb-47f8-b41e-cda420523080 None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:17:56.954424 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43242f7f-841e-46e9-9428-796193ee8491 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:17:56.955043 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43242f7f-841e-46e9-9428-796193ee8491 None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:56.955322 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43242f7f-841e-46e9-9428-796193ee8491 None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:56.956294 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43242f7f-841e-46e9-9428-796193ee8491 None admin] PATH_INFO: `/v3/services` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:56.956974 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43242f7f-841e-46e9-9428-796193ee8491 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 02:17:56.957278 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43242f7f-841e-46e9-9428-796193ee8491 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:17:56.958788 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43242f7f-841e-46e9-9428-796193ee8491 None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:17:56.967727 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 374/749] 10.222.0.18 () {56 vars in 1112 bytes} [Wed Oct 12 02:17:56 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 02:17:56.973421 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43242f7f-841e-46e9-9428-796193ee8491 None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:17:56.976613 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:17:57.004662 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 376/750] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Oct 12 02:17:56 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 12 02:17:57.091695 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43242f7f-841e-46e9-9428-796193ee8491 None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:17:57.125866 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1ef10b-7a2a-47e4-b077-c66c9311acd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:17:57.126472 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1ef10b-7a2a-47e4-b077-c66c9311acd9 None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:57.126749 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1ef10b-7a2a-47e4-b077-c66c9311acd9 None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:57.127083 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1ef10b-7a2a-47e4-b077-c66c9311acd9 None admin] PATH_INFO: `/v3/services` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:57.128312 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1ef10b-7a2a-47e4-b077-c66c9311acd9 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 02:17:57.128645 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1ef10b-7a2a-47e4-b077-c66c9311acd9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:17:57.130002 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1ef10b-7a2a-47e4-b077-c66c9311acd9 None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:17:57.135235 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 375/751] 10.222.0.18 () {56 vars in 1112 bytes} [Wed Oct 12 02:17:56 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 02:17:57.141189 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3330fa39-916f-4cfb-80ec-08799b03aaa6 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:17:57.210199 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:17:57.248325 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3330fa39-916f-4cfb-80ec-08799b03aaa6 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:17:57.273125 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1ef10b-7a2a-47e4-b077-c66c9311acd9 None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:17:57.291440 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fda2397-4e60-4078-b61b-7b444accec43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:17:57.292058 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fda2397-4e60-4078-b61b-7b444accec43 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:57.292339 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fda2397-4e60-4078-b61b-7b444accec43 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:57.292657 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fda2397-4e60-4078-b61b-7b444accec43 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:57.293464 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fda2397-4e60-4078-b61b-7b444accec43 None admin] RBAC: Adding query filter params (interface=public, service_id=96b6d76ba21f4a4e8f8a3e1d565e39d1, region_id=RegionOne) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 02:17:57.293780 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fda2397-4e60-4078-b61b-7b444accec43 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:17:57.295250 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fda2397-4e60-4078-b61b-7b444accec43 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:17:57.303512 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 377/752] 10.222.0.18 () {56 vars in 1251 bytes} [Wed Oct 12 02:17:57 2022] GET /identity/v3/endpoints?service_id=96b6d76ba21f4a4e8f8a3e1d565e39d1&interface=public®ion_id=RegionOne => generated 194 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 02:17:57.310061 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fda2397-4e60-4078-b61b-7b444accec43 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:17:57.367312 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:17:57.414230 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1ef10b-7a2a-47e4-b077-c66c9311acd9 None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:17:57.438543 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fda2397-4e60-4078-b61b-7b444accec43 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:17:57.459758 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061cbb60-0856-489f-9cd1-8c3c68f45ee7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:17:57.460803 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061cbb60-0856-489f-9cd1-8c3c68f45ee7 None admin] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:57.461082 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061cbb60-0856-489f-9cd1-8c3c68f45ee7 None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:57.461505 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061cbb60-0856-489f-9cd1-8c3c68f45ee7 None admin] PATH_INFO: `/v3/services` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:57.462183 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061cbb60-0856-489f-9cd1-8c3c68f45ee7 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:17:57.464144 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061cbb60-0856-489f-9cd1-8c3c68f45ee7 None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:17:57.474096 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:17:57.482450 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b70819f-7fab-460d-bf48-cd06e7200a1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:17:57.483200 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b70819f-7fab-460d-bf48-cd06e7200a1c None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:57.483614 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b70819f-7fab-460d-bf48-cd06e7200a1c None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:57.483991 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b70819f-7fab-460d-bf48-cd06e7200a1c None admin] PATH_INFO: `/v3/services` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:57.484747 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b70819f-7fab-460d-bf48-cd06e7200a1c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:17:57.485851 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 376/753] 10.222.0.18 () {60 vars in 1141 bytes} [Wed Oct 12 02:17:57 2022] POST /identity/v3/services => generated 242 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 02:17:57.488954 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b70819f-7fab-460d-bf48-cd06e7200a1c None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:17:57.497313 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 378/754] 10.222.0.18 () {56 vars in 1087 bytes} [Wed Oct 12 02:17:57 2022] GET /identity/v3/services => generated 1957 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 12 02:17:57.855591 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04989faf-dc50-4c43-bf9c-4594be811f21 None None] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:57.855963 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04989faf-dc50-4c43-bf9c-4594be811f21 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:57.856067 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04989faf-dc50-4c43-bf9c-4594be811f21 None None] PATH_INFO: `/` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:57.857640 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 377/755] 10.222.0.18 () {54 vars in 927 bytes} [Wed Oct 12 02:17:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 02:17:57.863306 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889ff2ca-91ce-49b9-971e-4fc4b92aa6d7 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:57.863593 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889ff2ca-91ce-49b9-971e-4fc4b92aa6d7 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:57.863874 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889ff2ca-91ce-49b9-971e-4fc4b92aa6d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:57.885375 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-889ff2ca-91ce-49b9-971e-4fc4b92aa6d7 None None] MFA Rules not processed for user `a326a5bb7364479382f528a592371656`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:17:57.886617 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-889ff2ca-91ce-49b9-971e-4fc4b92aa6d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:17:57.965635 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 379/756] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Oct 12 02:17:57 2022] POST /identity/v3/auth/tokens => generated 1666 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 12 02:17:58.234387 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04989faf-dc50-4c43-bf9c-4594be811f21 None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:17:58.345393 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04989faf-dc50-4c43-bf9c-4594be811f21 None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:17:58.376901 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:17:58.383334 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01181f67-53c2-4693-b30b-a14c8d65f5ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:17:58.383969 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01181f67-53c2-4693-b30b-a14c8d65f5ae None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:58.384247 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01181f67-53c2-4693-b30b-a14c8d65f5ae None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:58.384553 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01181f67-53c2-4693-b30b-a14c8d65f5ae None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:58.385181 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01181f67-53c2-4693-b30b-a14c8d65f5ae None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:17:58.386595 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01181f67-53c2-4693-b30b-a14c8d65f5ae None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:17:58.398029 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application [None req-01181f67-53c2-4693-b30b-a14c8d65f5ae None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 12 02:17:58.398029 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 02:17:58.398029 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 12 02:17:58.398029 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 12 02:17:58.398029 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 12 02:17:58.398029 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 12 02:17:58.398029 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 12 02:17:58.398029 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 12 02:17:58.398029 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 12 02:17:58.398029 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Oct 12 02:17:58.398029 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 12 02:17:58.398029 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Oct 12 02:17:58.398029 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 02:17:58.398029 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 02:17:58.398029 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 02:17:58.398029 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 02:17:58.398029 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 02:17:58.399219 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 02:17:58.399219 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 02:17:58.399219 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 02:17:58.399219 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 02:17:58.399219 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 02:17:58.399219 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 02:17:58.399219 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 12 02:17:58.399219 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 12 02:17:58.399219 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 12 02:17:58.399219 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 12 02:17:58.399219 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 02:17:58.399219 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 02:17:58.399219 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 02:17:58.399219 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 02:17:58.399219 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 02:17:58.399219 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 02:17:58.400275 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 02:17:58.400275 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application with Lock( Oct 12 02:17:58.400275 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 02:17:58.400275 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._enter() Oct 12 02:17:58.400275 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 02:17:58.400275 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 02:17:58.400275 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 02:17:58.400275 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.creator() Oct 12 02:17:58.400275 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 02:17:58.400275 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application created_value = creator( Oct 12 02:17:58.400275 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 12 02:17:58.400275 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 12 02:17:58.400275 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 12 02:17:58.400275 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Oct 12 02:17:58.402933 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 378/757] 10.222.0.18 () {56 vars in 1126 bytes} [Wed Oct 12 02:17:58 2022] GET /identity/v3/services/object-store => generated 93 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 02:17:58.410004 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889ff2ca-91ce-49b9-971e-4fc4b92aa6d7 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:17:58.532569 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889ff2ca-91ce-49b9-971e-4fc4b92aa6d7 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:17:58.549961 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:17:58.565932 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c1e682-e245-4823-a250-e367f3c7b5ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:17:58.566551 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c1e682-e245-4823-a250-e367f3c7b5ba None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:58.566829 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c1e682-e245-4823-a250-e367f3c7b5ba None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:58.567100 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c1e682-e245-4823-a250-e367f3c7b5ba None admin] PATH_INFO: `/v3/services` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:58.567780 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c1e682-e245-4823-a250-e367f3c7b5ba None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 02:17:58.568082 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c1e682-e245-4823-a250-e367f3c7b5ba None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:17:58.569657 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c1e682-e245-4823-a250-e367f3c7b5ba None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:17:58.574869 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 380/758] 10.222.0.18 () {56 vars in 1122 bytes} [Wed Oct 12 02:17:58 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 02:17:58.580553 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01181f67-53c2-4693-b30b-a14c8d65f5ae None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:17:58.691981 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01181f67-53c2-4693-b30b-a14c8d65f5ae None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:17:58.727440 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cee56dd-84f2-4354-8a5b-7b5b37befc8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:17:58.728046 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cee56dd-84f2-4354-8a5b-7b5b37befc8e None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:58.728325 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cee56dd-84f2-4354-8a5b-7b5b37befc8e None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:58.728633 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cee56dd-84f2-4354-8a5b-7b5b37befc8e None admin] PATH_INFO: `/v3/services` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:58.729266 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cee56dd-84f2-4354-8a5b-7b5b37befc8e None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 02:17:58.729569 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cee56dd-84f2-4354-8a5b-7b5b37befc8e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:17:58.731111 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cee56dd-84f2-4354-8a5b-7b5b37befc8e None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:17:58.736386 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 379/759] 10.222.0.18 () {56 vars in 1122 bytes} [Wed Oct 12 02:17:58 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 02:17:58.742767 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c1e682-e245-4823-a250-e367f3c7b5ba None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:17:58.852279 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c1e682-e245-4823-a250-e367f3c7b5ba None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:17:58.888184 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916d730e-4763-440a-8fcc-1fec758061e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:17:58.888820 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916d730e-4763-440a-8fcc-1fec758061e3 None admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:58.889096 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916d730e-4763-440a-8fcc-1fec758061e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:58.889371 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916d730e-4763-440a-8fcc-1fec758061e3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:58.890043 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916d730e-4763-440a-8fcc-1fec758061e3 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:17:58.891416 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916d730e-4763-440a-8fcc-1fec758061e3 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:17:58.913181 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 381/760] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Oct 12 02:17:58 2022] POST /identity/v3/endpoints => generated 325 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 02:17:59.170135 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e662c90f-f9e8-43a5-8e87-afb5b6406a91 None None] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:59.170520 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e662c90f-f9e8-43a5-8e87-afb5b6406a91 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:59.170698 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e662c90f-f9e8-43a5-8e87-afb5b6406a91 None None] PATH_INFO: `/` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:59.172192 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 380/761] 10.222.0.18 () {54 vars in 927 bytes} [Wed Oct 12 02:17:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 02:17:59.178306 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6b805f-efe0-4362-9b62-f6fb03173271 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:59.178860 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6b805f-efe0-4362-9b62-f6fb03173271 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:59.179331 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6b805f-efe0-4362-9b62-f6fb03173271 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:59.197884 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-ad6b805f-efe0-4362-9b62-f6fb03173271 None None] MFA Rules not processed for user `a326a5bb7364479382f528a592371656`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:17:59.199375 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-ad6b805f-efe0-4362-9b62-f6fb03173271 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:17:59.246039 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:17:59.282108 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 382/762] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Oct 12 02:17:59 2022] POST /identity/v3/auth/tokens => generated 1813 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 12 02:17:59.550852 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e662c90f-f9e8-43a5-8e87-afb5b6406a91 None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:17:59.608063 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:17:59.658073 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e662c90f-f9e8-43a5-8e87-afb5b6406a91 None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:17:59.700664 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604ef240-d9b9-4777-bb04-7c8d4b5f493e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:17:59.701303 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604ef240-d9b9-4777-bb04-7c8d4b5f493e None admin] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:59.701584 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604ef240-d9b9-4777-bb04-7c8d4b5f493e None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:59.701859 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604ef240-d9b9-4777-bb04-7c8d4b5f493e None admin] PATH_INFO: `/v3/users` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:59.702535 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604ef240-d9b9-4777-bb04-7c8d4b5f493e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:17:59.704027 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604ef240-d9b9-4777-bb04-7c8d4b5f493e None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:17:59.720851 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.sql.core [None req-604ef240-d9b9-4777-bb04-7c8d4b5f493e None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Oct 12 02:17:59.720851 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Oct 12 02:17:59.720851 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [parameters: {'user_id': 'a052bd142ec04c4e8c4eb2c8266d6f35', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Oct 12 02:17:59.720851 dv-cinder-849143-14-smb devstack@keystone.service[81361]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81361) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 12 02:17:59.728491 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application [None req-604ef240-d9b9-4777-bb04-7c8d4b5f493e None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Oct 12 02:17:59.728491 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 02:17:59.728491 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 12 02:17:59.728491 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 12 02:17:59.728491 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 12 02:17:59.728491 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 12 02:17:59.728491 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 12 02:17:59.728491 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application result = self._query(query) Oct 12 02:17:59.728491 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 12 02:17:59.728491 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application conn.query(q) Oct 12 02:17:59.728491 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 12 02:17:59.728491 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 12 02:17:59.728491 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 12 02:17:59.728491 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application result.read() Oct 12 02:17:59.728491 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 12 02:17:59.729435 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 12 02:17:59.729435 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 12 02:17:59.729435 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 12 02:17:59.729435 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 12 02:17:59.729435 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 12 02:17:59.729435 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 12 02:17:59.729435 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 12 02:17:59.729435 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Oct 12 02:17:59.729435 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Oct 12 02:17:59.729435 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 12 02:17:59.729435 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Oct 12 02:17:59.729435 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 02:17:59.729435 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 12 02:17:59.729435 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 12 02:17:59.729435 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Oct 12 02:17:59.729435 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Oct 12 02:17:59.729435 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 12 02:17:59.729435 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application next(self.gen) Oct 12 02:17:59.730399 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Oct 12 02:17:59.730399 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application yield resource Oct 12 02:17:59.730399 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 12 02:17:59.730399 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application next(self.gen) Oct 12 02:17:59.730399 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Oct 12 02:17:59.730399 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application self.session.rollback() Oct 12 02:17:59.730399 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 12 02:17:59.730399 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application self.force_reraise() Oct 12 02:17:59.730399 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 12 02:17:59.730399 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application raise self.value Oct 12 02:17:59.730399 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Oct 12 02:17:59.730399 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 12 02:17:59.730399 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Oct 12 02:17:59.730399 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application session.commit() Oct 12 02:17:59.730399 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 12 02:17:59.730399 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 12 02:17:59.730399 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 12 02:17:59.731281 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application self._prepare_impl() Oct 12 02:17:59.731281 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 12 02:17:59.731281 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application self.session.flush() Oct 12 02:17:59.731281 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 12 02:17:59.731281 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application self._flush(objects) Oct 12 02:17:59.731281 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 12 02:17:59.731281 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 12 02:17:59.731281 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 12 02:17:59.731281 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application compat.raise_( Oct 12 02:17:59.731281 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 12 02:17:59.731281 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application raise exception Oct 12 02:17:59.731281 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 12 02:17:59.731281 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application flush_context.execute() Oct 12 02:17:59.731281 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 12 02:17:59.731281 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application rec.execute(self) Oct 12 02:17:59.731281 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 12 02:17:59.731281 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 12 02:17:59.732179 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 12 02:17:59.732179 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 12 02:17:59.732179 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Oct 12 02:17:59.732179 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application result = connection._execute_20( Oct 12 02:17:59.732179 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 12 02:17:59.732179 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 12 02:17:59.732179 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 12 02:17:59.732179 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 12 02:17:59.732179 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 12 02:17:59.732179 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 12 02:17:59.732179 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 12 02:17:59.732179 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 12 02:17:59.732179 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 12 02:17:59.732179 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 12 02:17:59.732179 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 12 02:17:59.732179 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application raise exception Oct 12 02:17:59.733075 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 12 02:17:59.733075 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 12 02:17:59.733075 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 12 02:17:59.733075 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 12 02:17:59.733075 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 12 02:17:59.733075 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application result = self._query(query) Oct 12 02:17:59.733075 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 12 02:17:59.733075 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application conn.query(q) Oct 12 02:17:59.733075 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 12 02:17:59.733075 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 12 02:17:59.733075 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 12 02:17:59.733075 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application result.read() Oct 12 02:17:59.733075 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 12 02:17:59.733075 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 12 02:17:59.733075 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 12 02:17:59.733075 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 12 02:17:59.733892 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 12 02:17:59.733892 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 12 02:17:59.733892 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 12 02:17:59.733892 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 12 02:17:59.733892 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Oct 12 02:17:59.733892 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Oct 12 02:17:59.733892 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application [parameters: {'user_id': 'a052bd142ec04c4e8c4eb2c8266d6f35', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Oct 12 02:17:59.733892 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 12 02:17:59.733892 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Oct 12 02:17:59.733892 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 12 02:17:59.733892 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Oct 12 02:17:59.733892 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 02:17:59.733892 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 02:17:59.733892 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 02:17:59.733892 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 02:17:59.734683 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 02:17:59.734683 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 02:17:59.734683 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 02:17:59.734683 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 02:17:59.734683 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 02:17:59.734683 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 02:17:59.734683 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 02:17:59.734683 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Oct 12 02:17:59.734683 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Oct 12 02:17:59.734683 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 02:17:59.734683 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 02:17:59.734683 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 12 02:17:59.734683 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 12 02:17:59.734683 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 12 02:17:59.734683 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 12 02:17:59.734683 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Oct 12 02:17:59.734683 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Oct 12 02:17:59.735598 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Oct 12 02:17:59.735598 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Oct 12 02:17:59.735598 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 12 02:17:59.735598 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 12 02:17:59.735598 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Oct 12 02:17:59.735598 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Oct 12 02:17:59.735598 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 381/763] 10.222.0.18 () {60 vars in 1131 bytes} [Wed Oct 12 02:17:59 2022] POST /identity/v3/users => generated 160 bytes in 179 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Oct 12 02:17:59.735984 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6b805f-efe0-4362-9b62-f6fb03173271 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:17:59.805802 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f07fee-08cf-48a6-85e0-82f4a5145133 None None] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:59.805973 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f07fee-08cf-48a6-85e0-82f4a5145133 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:59.806252 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f07fee-08cf-48a6-85e0-82f4a5145133 None None] PATH_INFO: `/` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:59.814731 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 382/764] 10.222.0.18 () {54 vars in 927 bytes} [Wed Oct 12 02:17:59 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 12 02:17:59.816024 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f167979f-c89a-4ee1-a648-ff868d66c326 None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:59.816413 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f167979f-c89a-4ee1-a648-ff868d66c326 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:59.816731 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f167979f-c89a-4ee1-a648-ff868d66c326 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:59.837170 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-f167979f-c89a-4ee1-a648-ff868d66c326 None None] MFA Rules not processed for user `a326a5bb7364479382f528a592371656`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:17:59.839024 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-f167979f-c89a-4ee1-a648-ff868d66c326 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:17:59.848772 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6b805f-efe0-4362-9b62-f6fb03173271 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:17:59.887407 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cba6886-d201-450b-938a-75b9889006bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:17:59.888039 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cba6886-d201-450b-938a-75b9889006bf None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:59.888319 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cba6886-d201-450b-938a-75b9889006bf None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:59.888654 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cba6886-d201-450b-938a-75b9889006bf None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:59.896948 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cba6886-d201-450b-938a-75b9889006bf None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:17:59.898386 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cba6886-d201-450b-938a-75b9889006bf None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:17:59.910012 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-4cba6886-d201-450b-938a-75b9889006bf None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Oct 12 02:17:59.910012 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 02:17:59.910012 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 02:17:59.910012 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 02:17:59.910012 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 02:17:59.910012 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 02:17:59.910012 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 02:17:59.910012 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 02:17:59.910012 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 02:17:59.910012 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 02:17:59.910012 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 02:17:59.910012 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 02:17:59.910012 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 12 02:17:59.910012 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 12 02:17:59.910012 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 12 02:17:59.910012 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 12 02:17:59.910957 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 02:17:59.910957 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 02:17:59.910957 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 12 02:17:59.910957 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 12 02:17:59.910957 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 12 02:17:59.910957 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 12 02:17:59.910957 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 02:17:59.910957 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 02:17:59.910957 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 02:17:59.910957 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 02:17:59.910957 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 02:17:59.910957 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Oct 12 02:17:59.910957 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 02:17:59.910957 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Oct 12 02:17:59.910957 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 02:17:59.910957 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 02:17:59.910957 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 02:17:59.910957 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Oct 12 02:17:59.911947 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 02:17:59.911947 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Oct 12 02:17:59.911947 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 12 02:17:59.911947 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 12 02:17:59.911947 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 12 02:17:59.911947 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 12 02:17:59.911947 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 12 02:17:59.911947 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 12 02:17:59.911947 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Oct 12 02:17:59.911947 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Oct 12 02:17:59.911947 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 383/765] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Oct 12 02:17:59 2022] GET /identity/v3/users/cinder => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 02:17:59.912575 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee731793-9020-49b8-9bce-9878ec5e10fb None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:59.912575 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee731793-9020-49b8-9bce-9878ec5e10fb None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:59.913281 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee731793-9020-49b8-9bce-9878ec5e10fb None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:59.916513 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 384/766] 10.222.0.18 () {54 vars in 927 bytes} [Wed Oct 12 02:17:59 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 02:17:59.920500 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 383/767] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Oct 12 02:17:59 2022] POST /identity/v3/auth/tokens => generated 1813 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 12 02:17:59.921603 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee731793-9020-49b8-9bce-9878ec5e10fb None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:17:59.923048 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f900e5d0-e83f-4bfc-a688-bf56992f956e None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:17:59.923458 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f900e5d0-e83f-4bfc-a688-bf56992f956e None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:17:59.923808 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f900e5d0-e83f-4bfc-a688-bf56992f956e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:17:59.948092 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-f900e5d0-e83f-4bfc-a688-bf56992f956e None None] MFA Rules not processed for user `a326a5bb7364479382f528a592371656`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:17:59.950070 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-f900e5d0-e83f-4bfc-a688-bf56992f956e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:17:59.955032 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:18:00.005178 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:18:00.034549 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 384/768] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Oct 12 02:17:59 2022] POST /identity/v3/auth/tokens => generated 1813 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 12 02:18:00.051917 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee731793-9020-49b8-9bce-9878ec5e10fb None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:18:00.086893 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca7f101-0305-405a-a053-2812391aaa27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:18:00.087759 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca7f101-0305-405a-a053-2812391aaa27 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:18:00.088211 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca7f101-0305-405a-a053-2812391aaa27 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:18:00.088682 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca7f101-0305-405a-a053-2812391aaa27 None admin] PATH_INFO: `/v3/users` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:18:00.089546 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca7f101-0305-405a-a053-2812391aaa27 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 02:18:00.090041 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca7f101-0305-405a-a053-2812391aaa27 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:18:00.091680 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca7f101-0305-405a-a053-2812391aaa27 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:18:00.135254 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 385/769] 10.222.0.18 () {56 vars in 1101 bytes} [Wed Oct 12 02:17:59 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 02:18:00.197214 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f900e5d0-e83f-4bfc-a688-bf56992f956e None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:18:00.312155 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f900e5d0-e83f-4bfc-a688-bf56992f956e None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:18:00.339999 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca7f101-0305-405a-a053-2812391aaa27 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:18:00.351089 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b006a8-8355-4321-838d-c821db7d6416 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:18:00.352183 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b006a8-8355-4321-838d-c821db7d6416 None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:18:00.352691 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b006a8-8355-4321-838d-c821db7d6416 None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:18:00.353162 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b006a8-8355-4321-838d-c821db7d6416 None admin] PATH_INFO: `/v3/services/image` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:18:00.353965 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b006a8-8355-4321-838d-c821db7d6416 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:18:00.355659 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b006a8-8355-4321-838d-c821db7d6416 None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:18:00.366903 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application [None req-58b006a8-8355-4321-838d-c821db7d6416 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Oct 12 02:18:00.366903 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 02:18:00.366903 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 12 02:18:00.366903 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 12 02:18:00.366903 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 12 02:18:00.366903 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 12 02:18:00.366903 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 12 02:18:00.366903 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 12 02:18:00.366903 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 12 02:18:00.366903 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Oct 12 02:18:00.366903 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 12 02:18:00.366903 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Oct 12 02:18:00.366903 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 02:18:00.366903 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 02:18:00.366903 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 02:18:00.366903 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 02:18:00.366903 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 02:18:00.368003 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 02:18:00.368003 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 02:18:00.368003 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 02:18:00.368003 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 02:18:00.368003 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 02:18:00.368003 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 02:18:00.368003 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 12 02:18:00.368003 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 12 02:18:00.368003 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 12 02:18:00.368003 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 12 02:18:00.368003 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 02:18:00.368003 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 02:18:00.368003 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 02:18:00.368003 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 02:18:00.368003 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 02:18:00.368003 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 02:18:00.368946 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 02:18:00.368946 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application with Lock( Oct 12 02:18:00.368946 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 02:18:00.368946 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._enter() Oct 12 02:18:00.368946 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 02:18:00.368946 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 02:18:00.368946 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 02:18:00.368946 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.creator() Oct 12 02:18:00.368946 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 02:18:00.368946 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application created_value = creator( Oct 12 02:18:00.368946 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 12 02:18:00.368946 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 12 02:18:00.368946 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 12 02:18:00.368946 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Oct 12 02:18:00.368946 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 385/770] 10.222.0.18 () {56 vars in 1105 bytes} [Wed Oct 12 02:18:00 2022] GET /identity/v3/services/image => generated 86 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 02:18:00.373790 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b006a8-8355-4321-838d-c821db7d6416 None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:18:00.422682 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:18:00.464340 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:18:00.479024 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca7f101-0305-405a-a053-2812391aaa27 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:18:00.492235 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b006a8-8355-4321-838d-c821db7d6416 None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:18:00.514812 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13387b1c-2452-457e-ae63-60763123ba94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:18:00.515470 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13387b1c-2452-457e-ae63-60763123ba94 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:18:00.515743 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13387b1c-2452-457e-ae63-60763123ba94 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:18:00.516011 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13387b1c-2452-457e-ae63-60763123ba94 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:18:00.516647 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13387b1c-2452-457e-ae63-60763123ba94 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:18:00.518605 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13387b1c-2452-457e-ae63-60763123ba94 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:18:00.531001 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-13387b1c-2452-457e-ae63-60763123ba94 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Oct 12 02:18:00.531001 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 02:18:00.531001 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 12 02:18:00.531001 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 12 02:18:00.531001 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 12 02:18:00.531001 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 12 02:18:00.531001 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 12 02:18:00.531001 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 12 02:18:00.531001 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 12 02:18:00.531001 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Oct 12 02:18:00.531001 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 12 02:18:00.531001 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Oct 12 02:18:00.531001 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 02:18:00.531001 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 02:18:00.531001 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 02:18:00.531001 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 02:18:00.531001 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 02:18:00.532068 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 02:18:00.532068 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 02:18:00.532068 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 02:18:00.532068 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 02:18:00.532068 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 02:18:00.532068 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 02:18:00.532068 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 12 02:18:00.532068 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 12 02:18:00.532068 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 12 02:18:00.532068 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 12 02:18:00.532068 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 02:18:00.532068 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 02:18:00.532068 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 02:18:00.532068 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 02:18:00.532068 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 02:18:00.532068 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 02:18:00.538480 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 02:18:00.538480 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Oct 12 02:18:00.538480 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 02:18:00.538480 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Oct 12 02:18:00.538480 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 02:18:00.538480 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 02:18:00.538480 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 02:18:00.538480 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Oct 12 02:18:00.538480 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 02:18:00.538480 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Oct 12 02:18:00.538480 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 12 02:18:00.538480 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 12 02:18:00.538480 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 12 02:18:00.538480 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Oct 12 02:18:00.538480 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 386/771] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Oct 12 02:18:00 2022] GET /identity/v3/services/compute => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 12 02:18:00.540951 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13387b1c-2452-457e-ae63-60763123ba94 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:18:00.645700 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b997e1-43bf-4815-9b77-3a6930a6e0c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:18:00.646402 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b997e1-43bf-4815-9b77-3a6930a6e0c6 None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:18:00.646593 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b997e1-43bf-4815-9b77-3a6930a6e0c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:18:00.646858 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b997e1-43bf-4815-9b77-3a6930a6e0c6 None admin] PATH_INFO: `/v3/services` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:18:00.647494 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b997e1-43bf-4815-9b77-3a6930a6e0c6 None admin] RBAC: Adding query filter params (name=image) {{(pid=81361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 02:18:00.647797 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b997e1-43bf-4815-9b77-3a6930a6e0c6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:18:00.649204 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b997e1-43bf-4815-9b77-3a6930a6e0c6 None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:18:00.653773 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13387b1c-2452-457e-ae63-60763123ba94 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:18:00.654293 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 386/772] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Oct 12 02:18:00 2022] GET /identity/v3/services?name=image => generated 122 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 02:18:00.660649 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b997e1-43bf-4815-9b77-3a6930a6e0c6 None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:18:00.692340 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429f323e-e957-4bf5-bb63-a2c3674b5bd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:18:00.692981 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429f323e-e957-4bf5-bb63-a2c3674b5bd8 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:18:00.693262 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429f323e-e957-4bf5-bb63-a2c3674b5bd8 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:18:00.693533 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429f323e-e957-4bf5-bb63-a2c3674b5bd8 None admin] PATH_INFO: `/v3/services` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:18:00.694849 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429f323e-e957-4bf5-bb63-a2c3674b5bd8 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 02:18:00.695175 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429f323e-e957-4bf5-bb63-a2c3674b5bd8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:18:00.696850 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429f323e-e957-4bf5-bb63-a2c3674b5bd8 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:18:00.707760 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 387/773] 10.222.0.18 () {56 vars in 1112 bytes} [Wed Oct 12 02:18:00 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 02:18:00.708612 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429f323e-e957-4bf5-bb63-a2c3674b5bd8 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:18:00.729444 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:18:00.772367 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b997e1-43bf-4815-9b77-3a6930a6e0c6 None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:18:00.775745 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:18:00.809708 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f161e36-8dac-45f2-afb7-95ed7a669903 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:18:00.810295 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f161e36-8dac-45f2-afb7-95ed7a669903 None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:18:00.810578 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f161e36-8dac-45f2-afb7-95ed7a669903 None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:18:00.811099 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f161e36-8dac-45f2-afb7-95ed7a669903 None admin] PATH_INFO: `/v3/services` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:18:00.811457 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f161e36-8dac-45f2-afb7-95ed7a669903 None admin] RBAC: Adding query filter params (type=image) {{(pid=81361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 02:18:00.811751 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f161e36-8dac-45f2-afb7-95ed7a669903 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:18:00.813114 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f161e36-8dac-45f2-afb7-95ed7a669903 None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:18:00.819044 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 387/774] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Oct 12 02:18:00 2022] GET /identity/v3/services?type=image => generated 350 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 02:18:00.822542 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429f323e-e957-4bf5-bb63-a2c3674b5bd8 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:18:00.824826 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f161e36-8dac-45f2-afb7-95ed7a669903 None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:18:00.861135 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ff4083-d1c0-479d-982c-b1943cdf6533 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:18:00.861800 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ff4083-d1c0-479d-982c-b1943cdf6533 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:18:00.862079 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ff4083-d1c0-479d-982c-b1943cdf6533 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:18:00.862351 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ff4083-d1c0-479d-982c-b1943cdf6533 None admin] PATH_INFO: `/v3/services` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:18:00.863069 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ff4083-d1c0-479d-982c-b1943cdf6533 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 02:18:00.863371 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ff4083-d1c0-479d-982c-b1943cdf6533 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:18:00.865057 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ff4083-d1c0-479d-982c-b1943cdf6533 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:18:00.870021 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 388/775] 10.222.0.18 () {56 vars in 1112 bytes} [Wed Oct 12 02:18:00 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 02:18:00.875524 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ff4083-d1c0-479d-982c-b1943cdf6533 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:18:00.939325 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f161e36-8dac-45f2-afb7-95ed7a669903 None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:18:00.963840 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:18:00.975830 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f68244-e01c-44ff-a97c-4a7b9b463be5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:18:00.976342 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f68244-e01c-44ff-a97c-4a7b9b463be5 None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:18:00.976649 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f68244-e01c-44ff-a97c-4a7b9b463be5 None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:18:00.976918 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f68244-e01c-44ff-a97c-4a7b9b463be5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:18:00.977719 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f68244-e01c-44ff-a97c-4a7b9b463be5 None admin] RBAC: Adding query filter params (interface=public, service_id=beded0d1bc234e6ab35fafc57789789b, region_id=RegionOne) {{(pid=81361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 02:18:00.977912 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f68244-e01c-44ff-a97c-4a7b9b463be5 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:18:00.979250 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f68244-e01c-44ff-a97c-4a7b9b463be5 None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:18:00.984279 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 388/776] 10.222.0.18 () {56 vars in 1251 bytes} [Wed Oct 12 02:18:00 2022] GET /identity/v3/endpoints?service_id=beded0d1bc234e6ab35fafc57789789b&interface=public®ion_id=RegionOne => generated 194 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 02:18:00.987245 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ff4083-d1c0-479d-982c-b1943cdf6533 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:18:00.990748 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f68244-e01c-44ff-a97c-4a7b9b463be5 None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:18:01.024804 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:18:01.025204 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b08d71-ef77-4ebd-9403-eabd7fc2dc3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:18:01.025980 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b08d71-ef77-4ebd-9403-eabd7fc2dc3a None admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:18:01.026490 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b08d71-ef77-4ebd-9403-eabd7fc2dc3a None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:18:01.026803 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b08d71-ef77-4ebd-9403-eabd7fc2dc3a None admin] PATH_INFO: `/v3/endpoints` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:18:01.027602 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b08d71-ef77-4ebd-9403-eabd7fc2dc3a None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:18:01.029089 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b08d71-ef77-4ebd-9403-eabd7fc2dc3a None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:18:01.052357 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 389/777] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Oct 12 02:18:00 2022] POST /identity/v3/endpoints => generated 334 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 02:18:01.120439 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f68244-e01c-44ff-a97c-4a7b9b463be5 None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:18:01.159677 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3ba510-13bf-4806-a159-3aa508961a48 None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:18:01.160019 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3ba510-13bf-4806-a159-3aa508961a48 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:18:01.160203 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3ba510-13bf-4806-a159-3aa508961a48 None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:18:01.163228 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 390/778] 10.222.0.18 () {54 vars in 927 bytes} [Wed Oct 12 02:18:01 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 12 02:18:01.167516 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298d2a78-42f8-4225-948d-73b9518ec769 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:18:01.168196 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298d2a78-42f8-4225-948d-73b9518ec769 None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:18:01.168492 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298d2a78-42f8-4225-948d-73b9518ec769 None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:18:01.168735 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cdf33d-04b9-4bc6-a5ab-0d4f619f96b7 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:18:01.168838 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298d2a78-42f8-4225-948d-73b9518ec769 None admin] PATH_INFO: `/v3/services` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:18:01.169018 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cdf33d-04b9-4bc6-a5ab-0d4f619f96b7 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:18:01.169293 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cdf33d-04b9-4bc6-a5ab-0d4f619f96b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:18:01.169387 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298d2a78-42f8-4225-948d-73b9518ec769 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:18:01.170735 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298d2a78-42f8-4225-948d-73b9518ec769 None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:18:01.184506 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 389/779] 10.222.0.18 () {56 vars in 1087 bytes} [Wed Oct 12 02:18:00 2022] GET /identity/v3/services => generated 1957 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 02:18:01.189234 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-a8cdf33d-04b9-4bc6-a5ab-0d4f619f96b7 None None] MFA Rules not processed for user `a326a5bb7364479382f528a592371656`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:18:01.191002 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-a8cdf33d-04b9-4bc6-a5ab-0d4f619f96b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:18:01.272823 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 391/780] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Oct 12 02:18:01 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 12 02:18:01.540385 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298d2a78-42f8-4225-948d-73b9518ec769 None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:18:01.632616 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:18:01.644491 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298d2a78-42f8-4225-948d-73b9518ec769 None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:18:01.678980 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5335a590-5a18-4b20-945d-3aef33953fff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:18:01.680420 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5335a590-5a18-4b20-945d-3aef33953fff None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:18:01.680866 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5335a590-5a18-4b20-945d-3aef33953fff None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:18:01.681299 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5335a590-5a18-4b20-945d-3aef33953fff None admin] PATH_INFO: `/v3/domains/default` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:18:01.682549 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5335a590-5a18-4b20-945d-3aef33953fff None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:18:01.684226 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5335a590-5a18-4b20-945d-3aef33953fff None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:18:01.685973 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 390/781] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Oct 12 02:18:01 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 02:18:01.692586 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cdf33d-04b9-4bc6-a5ab-0d4f619f96b7 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:18:01.758844 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:18:01.795355 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cdf33d-04b9-4bc6-a5ab-0d4f619f96b7 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:18:01.829489 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44697870-0973-45f9-86a9-6d95868642dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:18:01.830156 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44697870-0973-45f9-86a9-6d95868642dc None admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:18:01.830413 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44697870-0973-45f9-86a9-6d95868642dc None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:18:01.830763 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44697870-0973-45f9-86a9-6d95868642dc None admin] PATH_INFO: `/v3/projects` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:18:01.831425 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44697870-0973-45f9-86a9-6d95868642dc None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:18:01.832864 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44697870-0973-45f9-86a9-6d95868642dc None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:18:01.862047 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 392/782] 10.222.0.18 () {60 vars in 1141 bytes} [Wed Oct 12 02:18:01 2022] POST /identity/v3/projects => generated 311 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 02:18:03.331496 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287b48ab-d319-4882-8b22-f6c34f9c73e8 None None] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:18:03.332033 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287b48ab-d319-4882-8b22-f6c34f9c73e8 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:18:03.332033 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287b48ab-d319-4882-8b22-f6c34f9c73e8 None None] PATH_INFO: `/` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:18:03.333708 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 391/783] 10.222.0.18 () {54 vars in 927 bytes} [Wed Oct 12 02:18:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 02:18:03.334420 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c8fecc-7f82-408d-b1fe-b6fcacf12979 None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:18:03.334795 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c8fecc-7f82-408d-b1fe-b6fcacf12979 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:18:03.335026 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c8fecc-7f82-408d-b1fe-b6fcacf12979 None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:18:03.336447 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 393/784] 10.222.0.18 () {54 vars in 927 bytes} [Wed Oct 12 02:18:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 12 02:18:03.338536 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594e1828-8ed2-48d3-a0b4-f24c325bf9f8 None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:18:03.338823 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594e1828-8ed2-48d3-a0b4-f24c325bf9f8 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:18:03.339094 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594e1828-8ed2-48d3-a0b4-f24c325bf9f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:18:03.341232 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10503e8a-59ad-40a8-9463-588418befe40 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:18:03.341514 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10503e8a-59ad-40a8-9463-588418befe40 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:18:03.341788 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10503e8a-59ad-40a8-9463-588418befe40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:18:03.358002 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-594e1828-8ed2-48d3-a0b4-f24c325bf9f8 None None] MFA Rules not processed for user `a326a5bb7364479382f528a592371656`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:18:03.359189 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-594e1828-8ed2-48d3-a0b4-f24c325bf9f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:18:03.359624 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-10503e8a-59ad-40a8-9463-588418befe40 None None] MFA Rules not processed for user `a326a5bb7364479382f528a592371656`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:18:03.360790 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-10503e8a-59ad-40a8-9463-588418befe40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:18:03.431916 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 392/785] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Oct 12 02:18:03 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 12 02:18:03.437842 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 394/786] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Oct 12 02:18:03 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 12 02:18:03.697667 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594e1828-8ed2-48d3-a0b4-f24c325bf9f8 None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:18:03.710727 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10503e8a-59ad-40a8-9463-588418befe40 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:18:03.764229 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:18:03.793807 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:18:03.805179 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594e1828-8ed2-48d3-a0b4-f24c325bf9f8 None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:18:03.821011 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10503e8a-59ad-40a8-9463-588418befe40 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:18:03.843437 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4851e247-4a00-464d-a9a7-4494c9358f86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:18:03.844068 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4851e247-4a00-464d-a9a7-4494c9358f86 None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:18:03.844346 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4851e247-4a00-464d-a9a7-4494c9358f86 None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:18:03.844660 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4851e247-4a00-464d-a9a7-4494c9358f86 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:18:03.855287 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4851e247-4a00-464d-a9a7-4494c9358f86 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 02:18:03.857669 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d393b5-05ad-4868-9a5f-2a13f4cf7527 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:18:03.858472 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d393b5-05ad-4868-9a5f-2a13f4cf7527 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:18:03.858898 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d393b5-05ad-4868-9a5f-2a13f4cf7527 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:18:03.859340 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d393b5-05ad-4868-9a5f-2a13f4cf7527 None admin] PATH_INFO: `/v3/services/image` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:18:03.860072 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d393b5-05ad-4868-9a5f-2a13f4cf7527 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:18:03.860191 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application [None req-4851e247-4a00-464d-a9a7-4494c9358f86 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 12 02:18:03.860191 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 02:18:03.860191 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 02:18:03.860191 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 02:18:03.860191 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 02:18:03.860191 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 02:18:03.860191 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 02:18:03.860191 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 02:18:03.860191 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 02:18:03.860191 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 02:18:03.860191 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 02:18:03.860191 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 02:18:03.860191 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 12 02:18:03.860191 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 12 02:18:03.860191 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 12 02:18:03.860191 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 12 02:18:03.861384 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 12 02:18:03.861384 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 12 02:18:03.861384 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 12 02:18:03.861384 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 12 02:18:03.861384 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 02:18:03.861384 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 02:18:03.861384 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 02:18:03.861384 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 02:18:03.861384 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 02:18:03.861384 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 02:18:03.861384 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 02:18:03.861384 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application with Lock( Oct 12 02:18:03.861384 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 02:18:03.861384 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._enter() Oct 12 02:18:03.861384 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 02:18:03.861384 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 02:18:03.862365 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 02:18:03.862365 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.creator() Oct 12 02:18:03.862365 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 02:18:03.862365 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application created_value = creator( Oct 12 02:18:03.862365 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 12 02:18:03.862365 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 12 02:18:03.862365 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 12 02:18:03.862365 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 12 02:18:03.862365 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 12 02:18:03.862365 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 12 02:18:03.862365 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 12 02:18:03.862365 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Oct 12 02:18:03.862365 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 393/787] 10.222.0.18 () {56 vars in 1120 bytes} [Wed Oct 12 02:18:03 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 02:18:03.864801 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d393b5-05ad-4868-9a5f-2a13f4cf7527 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:18:03.869602 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4851e247-4a00-464d-a9a7-4494c9358f86 None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:18:03.875341 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-17d393b5-05ad-4868-9a5f-2a13f4cf7527 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Oct 12 02:18:03.875341 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 02:18:03.875341 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 12 02:18:03.875341 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 12 02:18:03.875341 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 12 02:18:03.875341 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 12 02:18:03.875341 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 12 02:18:03.875341 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 12 02:18:03.875341 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 12 02:18:03.875341 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Oct 12 02:18:03.875341 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 12 02:18:03.875341 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Oct 12 02:18:03.875341 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 02:18:03.875341 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 02:18:03.875341 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 02:18:03.875341 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 02:18:03.875341 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 02:18:03.876346 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 02:18:03.876346 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 02:18:03.876346 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 02:18:03.876346 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 02:18:03.876346 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 02:18:03.876346 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 02:18:03.876346 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 12 02:18:03.876346 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 12 02:18:03.876346 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 12 02:18:03.876346 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 12 02:18:03.876346 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 02:18:03.876346 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 02:18:03.876346 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 02:18:03.876346 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 02:18:03.876346 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 02:18:03.876346 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 02:18:03.881358 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 02:18:03.881358 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Oct 12 02:18:03.881358 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 02:18:03.881358 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Oct 12 02:18:03.881358 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 02:18:03.881358 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 02:18:03.881358 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 02:18:03.881358 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Oct 12 02:18:03.881358 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 02:18:03.881358 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Oct 12 02:18:03.881358 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 12 02:18:03.881358 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 12 02:18:03.881358 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 12 02:18:03.881358 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Oct 12 02:18:03.881358 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 395/788] 10.222.0.18 () {56 vars in 1105 bytes} [Wed Oct 12 02:18:03 2022] GET /identity/v3/services/image => generated 86 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 02:18:03.882909 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d393b5-05ad-4868-9a5f-2a13f4cf7527 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:18:03.984491 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4851e247-4a00-464d-a9a7-4494c9358f86 None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:18:03.994172 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d393b5-05ad-4868-9a5f-2a13f4cf7527 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:18:04.008126 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:18:04.026433 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce762133-3181-4d8c-8e35-984092c7f5c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:18:04.027039 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce762133-3181-4d8c-8e35-984092c7f5c7 None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:18:04.027323 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce762133-3181-4d8c-8e35-984092c7f5c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:18:04.027595 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce762133-3181-4d8c-8e35-984092c7f5c7 None admin] PATH_INFO: `/v3/roles` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:18:04.028257 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce762133-3181-4d8c-8e35-984092c7f5c7 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 02:18:04.028584 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce762133-3181-4d8c-8e35-984092c7f5c7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:18:04.029951 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce762133-3181-4d8c-8e35-984092c7f5c7 None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:18:04.031746 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00b6e63-f010-4726-a275-12b3ed8de28e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:18:04.032522 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00b6e63-f010-4726-a275-12b3ed8de28e None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:18:04.032977 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00b6e63-f010-4726-a275-12b3ed8de28e None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:18:04.033948 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00b6e63-f010-4726-a275-12b3ed8de28e None admin] PATH_INFO: `/v3/services` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:18:04.034714 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00b6e63-f010-4726-a275-12b3ed8de28e None admin] RBAC: Adding query filter params (name=image) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 02:18:04.035153 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00b6e63-f010-4726-a275-12b3ed8de28e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:18:04.036668 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00b6e63-f010-4726-a275-12b3ed8de28e None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:18:04.039464 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 394/789] 10.222.0.18 () {56 vars in 1115 bytes} [Wed Oct 12 02:18:03 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 02:18:04.042354 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 396/790] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Oct 12 02:18:03 2022] GET /identity/v3/services?name=image => generated 122 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 02:18:04.042609 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a29d51a-1840-444c-a7de-4883dd5aa72c None None] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:18:04.042896 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a29d51a-1840-444c-a7de-4883dd5aa72c None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:18:04.043174 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a29d51a-1840-444c-a7de-4883dd5aa72c None None] PATH_INFO: `/` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:18:04.044407 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 395/791] 10.222.0.18 () {54 vars in 927 bytes} [Wed Oct 12 02:18:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 12 02:18:04.049807 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a29d51a-1840-444c-a7de-4883dd5aa72c None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:18:04.049948 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00b6e63-f010-4726-a275-12b3ed8de28e None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:18:04.065137 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:18:04.150896 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00b6e63-f010-4726-a275-12b3ed8de28e None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:18:04.155048 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a29d51a-1840-444c-a7de-4883dd5aa72c None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:18:04.184221 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a0f1d3-d60b-469a-aac5-f9b6c5f9b1cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:18:04.184868 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a0f1d3-d60b-469a-aac5-f9b6c5f9b1cc None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:18:04.185144 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a0f1d3-d60b-469a-aac5-f9b6c5f9b1cc None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:18:04.185418 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a0f1d3-d60b-469a-aac5-f9b6c5f9b1cc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:18:04.190274 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955564c6-3152-4e3a-97fb-6e5510fa13f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:18:04.190860 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955564c6-3152-4e3a-97fb-6e5510fa13f1 None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:18:04.191132 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955564c6-3152-4e3a-97fb-6e5510fa13f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:18:04.191396 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955564c6-3152-4e3a-97fb-6e5510fa13f1 None admin] PATH_INFO: `/v3/services` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:18:04.192012 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955564c6-3152-4e3a-97fb-6e5510fa13f1 None admin] RBAC: Adding query filter params (type=image) {{(pid=81361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 02:18:04.192305 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955564c6-3152-4e3a-97fb-6e5510fa13f1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:18:04.193685 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955564c6-3152-4e3a-97fb-6e5510fa13f1 None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:18:04.196206 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a0f1d3-d60b-469a-aac5-f9b6c5f9b1cc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:18:04.197642 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a0f1d3-d60b-469a-aac5-f9b6c5f9b1cc None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:18:04.198293 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 396/792] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Oct 12 02:18:04 2022] GET /identity/v3/services?type=image => generated 350 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 02:18:04.199623 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c8d0b2-ef34-45ab-bce0-07a1ca262a13 None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:18:04.200197 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c8d0b2-ef34-45ab-bce0-07a1ca262a13 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:18:04.200492 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c8d0b2-ef34-45ab-bce0-07a1ca262a13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:18:04.212353 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-03a0f1d3-d60b-469a-aac5-f9b6c5f9b1cc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 02:18:04.212353 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 02:18:04.212353 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 02:18:04.212353 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 02:18:04.212353 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 02:18:04.212353 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 02:18:04.212353 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 02:18:04.212353 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 02:18:04.212353 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 02:18:04.212353 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 02:18:04.212353 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 02:18:04.212353 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 02:18:04.212353 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 12 02:18:04.212353 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 12 02:18:04.212353 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 12 02:18:04.212353 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 12 02:18:04.213442 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 02:18:04.213442 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 02:18:04.213442 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 02:18:04.213442 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 02:18:04.213442 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 02:18:04.213442 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 02:18:04.213442 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 02:18:04.213442 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Oct 12 02:18:04.213442 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 02:18:04.213442 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Oct 12 02:18:04.213442 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 02:18:04.213442 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 02:18:04.213442 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 02:18:04.213442 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Oct 12 02:18:04.213442 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 02:18:04.213442 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Oct 12 02:18:04.213442 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 12 02:18:04.214570 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 12 02:18:04.214570 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 02:18:04.214570 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Oct 12 02:18:04.214570 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 397/793] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Oct 12 02:18:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 02:18:04.214570 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a0f1d3-d60b-469a-aac5-f9b6c5f9b1cc None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:18:04.222045 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-c5c8d0b2-ef34-45ab-bce0-07a1ca262a13 None None] MFA Rules not processed for user `a326a5bb7364479382f528a592371656`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:18:04.223273 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-c5c8d0b2-ef34-45ab-bce0-07a1ca262a13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:18:04.242938 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:18:04.288618 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 397/794] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Oct 12 02:18:04 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 12 02:18:04.289454 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c8d0b2-ef34-45ab-bce0-07a1ca262a13 None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:18:04.297199 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:18:04.319933 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a0f1d3-d60b-469a-aac5-f9b6c5f9b1cc None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:18:04.356567 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aab8812-5aa1-4af4-bd48-bd8447b47b80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:18:04.358428 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aab8812-5aa1-4af4-bd48-bd8447b47b80 None admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:18:04.359000 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aab8812-5aa1-4af4-bd48-bd8447b47b80 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:18:04.359545 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aab8812-5aa1-4af4-bd48-bd8447b47b80 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:18:04.360353 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aab8812-5aa1-4af4-bd48-bd8447b47b80 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:18:04.362612 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aab8812-5aa1-4af4-bd48-bd8447b47b80 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:18:04.388534 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 398/795] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Oct 12 02:18:04 2022] POST /identity/v3/endpoints => generated 327 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 02:18:04.407732 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c8d0b2-ef34-45ab-bce0-07a1ca262a13 None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:18:04.454136 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c1831b-679f-4a68-8c4a-3c80c6a0dd8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:18:04.454851 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c1831b-679f-4a68-8c4a-3c80c6a0dd8f None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:18:04.455134 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c1831b-679f-4a68-8c4a-3c80c6a0dd8f None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:18:04.455401 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c1831b-679f-4a68-8c4a-3c80c6a0dd8f None admin] PATH_INFO: `/v3/domains` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:18:04.456061 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c1831b-679f-4a68-8c4a-3c80c6a0dd8f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 02:18:04.456356 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c1831b-679f-4a68-8c4a-3c80c6a0dd8f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:18:04.457952 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c1831b-679f-4a68-8c4a-3c80c6a0dd8f None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:18:04.475973 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 398/796] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Oct 12 02:18:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 02:18:04.477560 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aab8812-5aa1-4af4-bd48-bd8447b47b80 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:18:04.562586 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c1831b-679f-4a68-8c4a-3c80c6a0dd8f None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:18:04.577949 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:18:04.599784 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aab8812-5aa1-4af4-bd48-bd8447b47b80 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:18:04.634148 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:18:04.637988 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10f9b06-3170-4873-8e93-26dfeb4752fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:18:04.638717 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10f9b06-3170-4873-8e93-26dfeb4752fc None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:18:04.638920 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10f9b06-3170-4873-8e93-26dfeb4752fc None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:18:04.639181 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10f9b06-3170-4873-8e93-26dfeb4752fc None admin] PATH_INFO: `/v3/users/nova` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:18:04.649442 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10f9b06-3170-4873-8e93-26dfeb4752fc None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:18:04.651261 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10f9b06-3170-4873-8e93-26dfeb4752fc None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:18:04.665580 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-b10f9b06-3170-4873-8e93-26dfeb4752fc None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 12 02:18:04.665580 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 02:18:04.665580 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 02:18:04.665580 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 02:18:04.665580 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 02:18:04.665580 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 02:18:04.665580 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 02:18:04.665580 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 02:18:04.665580 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 02:18:04.665580 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 02:18:04.665580 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 02:18:04.665580 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 02:18:04.665580 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 12 02:18:04.665580 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 12 02:18:04.665580 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 12 02:18:04.665580 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 12 02:18:04.666558 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 02:18:04.666558 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 02:18:04.666558 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 12 02:18:04.666558 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 12 02:18:04.666558 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 12 02:18:04.666558 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 12 02:18:04.666558 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 02:18:04.666558 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 02:18:04.666558 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 02:18:04.666558 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 02:18:04.666558 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 02:18:04.666558 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Oct 12 02:18:04.666558 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 02:18:04.666558 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Oct 12 02:18:04.666558 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 02:18:04.666558 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 02:18:04.666558 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 02:18:04.666558 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Oct 12 02:18:04.667537 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 02:18:04.667537 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Oct 12 02:18:04.667537 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 12 02:18:04.667537 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 12 02:18:04.667537 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 12 02:18:04.667537 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 12 02:18:04.667537 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 12 02:18:04.667537 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 12 02:18:04.667537 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 12 02:18:04.667537 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Oct 12 02:18:04.667537 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 399/797] 10.222.0.18 () {56 vars in 1093 bytes} [Wed Oct 12 02:18:04 2022] GET /identity/v3/users/nova => generated 82 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 02:18:04.672257 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10f9b06-3170-4873-8e93-26dfeb4752fc None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:18:04.679127 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c1831b-679f-4a68-8c4a-3c80c6a0dd8f None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:18:04.714874 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19d0c8e-f7c0-4e55-bfb3-bcc1e41f9985 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:18:04.715506 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19d0c8e-f7c0-4e55-bfb3-bcc1e41f9985 None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:18:04.715786 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19d0c8e-f7c0-4e55-bfb3-bcc1e41f9985 None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:18:04.716062 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19d0c8e-f7c0-4e55-bfb3-bcc1e41f9985 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:18:04.717181 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19d0c8e-f7c0-4e55-bfb3-bcc1e41f9985 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:18:04.718614 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19d0c8e-f7c0-4e55-bfb3-bcc1e41f9985 None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:18:04.720952 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 399/798] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Oct 12 02:18:04 2022] GET /identity/v3/domains/default => generated 199 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 02:18:04.727134 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19d0c8e-f7c0-4e55-bfb3-bcc1e41f9985 None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:18:04.789535 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10f9b06-3170-4873-8e93-26dfeb4752fc None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:18:04.825475 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42b5c5e-743d-4efa-97a3-f801356742b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:18:04.826075 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42b5c5e-743d-4efa-97a3-f801356742b9 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:18:04.826350 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42b5c5e-743d-4efa-97a3-f801356742b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:18:04.826625 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42b5c5e-743d-4efa-97a3-f801356742b9 None admin] PATH_INFO: `/v3/users` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:18:04.827338 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42b5c5e-743d-4efa-97a3-f801356742b9 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 02:18:04.827646 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42b5c5e-743d-4efa-97a3-f801356742b9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:18:04.829092 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42b5c5e-743d-4efa-97a3-f801356742b9 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:18:04.834233 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19d0c8e-f7c0-4e55-bfb3-bcc1e41f9985 None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:18:04.851803 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 400/799] 10.222.0.18 () {56 vars in 1133 bytes} [Wed Oct 12 02:18:04 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 02:18:04.852952 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42b5c5e-743d-4efa-97a3-f801356742b9 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:18:04.856179 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:18:04.869211 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:18:04.875579 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba9a51b-1154-4fa9-a96d-930cea0eacc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:18:04.876407 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba9a51b-1154-4fa9-a96d-930cea0eacc9 None admin] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:18:04.876562 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba9a51b-1154-4fa9-a96d-930cea0eacc9 None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:18:04.876815 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba9a51b-1154-4fa9-a96d-930cea0eacc9 None admin] PATH_INFO: `/v3/users` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:18:04.877531 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba9a51b-1154-4fa9-a96d-930cea0eacc9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:18:04.879020 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba9a51b-1154-4fa9-a96d-930cea0eacc9 None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:18:04.901657 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 400/800] 10.222.0.18 () {60 vars in 1132 bytes} [Wed Oct 12 02:18:04 2022] POST /identity/v3/users => generated 285 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 02:18:04.978267 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42b5c5e-743d-4efa-97a3-f801356742b9 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:18:05.016053 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8e29ca-1894-494d-977d-db7937b3495b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:18:05.016735 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8e29ca-1894-494d-977d-db7937b3495b None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:18:05.017016 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8e29ca-1894-494d-977d-db7937b3495b None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:18:05.017853 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8e29ca-1894-494d-977d-db7937b3495b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:18:05.029479 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8e29ca-1894-494d-977d-db7937b3495b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:18:05.031029 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8e29ca-1894-494d-977d-db7937b3495b None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:18:05.047916 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-db8e29ca-1894-494d-977d-db7937b3495b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 02:18:05.047916 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 02:18:05.047916 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 02:18:05.047916 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 02:18:05.047916 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 02:18:05.047916 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 02:18:05.047916 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 02:18:05.047916 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 02:18:05.047916 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 02:18:05.047916 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 02:18:05.047916 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 02:18:05.047916 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 02:18:05.047916 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 12 02:18:05.047916 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 12 02:18:05.047916 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 12 02:18:05.047916 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 12 02:18:05.049042 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 02:18:05.049042 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 02:18:05.049042 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 02:18:05.049042 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 02:18:05.049042 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 02:18:05.049042 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 02:18:05.049042 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 02:18:05.049042 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Oct 12 02:18:05.049042 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 02:18:05.049042 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Oct 12 02:18:05.049042 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 02:18:05.049042 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 02:18:05.049042 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 02:18:05.049042 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Oct 12 02:18:05.049042 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 02:18:05.049042 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Oct 12 02:18:05.049042 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 12 02:18:05.049942 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 12 02:18:05.049942 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 02:18:05.049942 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Oct 12 02:18:05.049942 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 401/801] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Oct 12 02:18:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 02:18:05.057880 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba9a51b-1154-4fa9-a96d-930cea0eacc9 None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:18:05.166142 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba9a51b-1154-4fa9-a96d-930cea0eacc9 None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:18:05.200853 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed67d9f-e479-4aa3-8a60-111a21555ab6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:18:05.201798 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed67d9f-e479-4aa3-8a60-111a21555ab6 None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:18:05.202253 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed67d9f-e479-4aa3-8a60-111a21555ab6 None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:18:05.202695 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed67d9f-e479-4aa3-8a60-111a21555ab6 None admin] PATH_INFO: `/v3/domains` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:18:05.203555 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed67d9f-e479-4aa3-8a60-111a21555ab6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 02:18:05.204073 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed67d9f-e479-4aa3-8a60-111a21555ab6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:18:05.206235 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed67d9f-e479-4aa3-8a60-111a21555ab6 None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:18:05.224520 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 401/802] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Oct 12 02:18:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 02:18:05.226060 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8e29ca-1894-494d-977d-db7937b3495b None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:18:05.282777 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:18:05.331635 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8e29ca-1894-494d-977d-db7937b3495b None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:18:05.366374 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37747784-2e9a-4c1c-9ed7-88a22ffc1885 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:18:05.367706 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37747784-2e9a-4c1c-9ed7-88a22ffc1885 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:18:05.368160 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37747784-2e9a-4c1c-9ed7-88a22ffc1885 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:18:05.368629 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37747784-2e9a-4c1c-9ed7-88a22ffc1885 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:18:05.375534 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37747784-2e9a-4c1c-9ed7-88a22ffc1885 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:18:05.377397 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37747784-2e9a-4c1c-9ed7-88a22ffc1885 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:18:05.388697 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-37747784-2e9a-4c1c-9ed7-88a22ffc1885 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 12 02:18:05.388697 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 02:18:05.388697 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 02:18:05.388697 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 02:18:05.388697 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 02:18:05.388697 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 02:18:05.388697 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 02:18:05.388697 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 02:18:05.388697 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 02:18:05.388697 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 02:18:05.388697 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 02:18:05.388697 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 02:18:05.388697 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 12 02:18:05.388697 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 12 02:18:05.388697 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 12 02:18:05.389563 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 12 02:18:05.389563 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 02:18:05.389563 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 02:18:05.389563 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 02:18:05.389563 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 02:18:05.389563 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 02:18:05.389563 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 02:18:05.389563 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 02:18:05.389563 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Oct 12 02:18:05.389563 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 02:18:05.389563 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Oct 12 02:18:05.389563 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 02:18:05.389563 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 02:18:05.389563 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 02:18:05.389563 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Oct 12 02:18:05.389563 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 02:18:05.389563 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Oct 12 02:18:05.390488 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 12 02:18:05.390488 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 12 02:18:05.390488 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 12 02:18:05.390488 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 12 02:18:05.390488 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 12 02:18:05.390488 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 12 02:18:05.390488 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 12 02:18:05.390488 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Oct 12 02:18:05.392147 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 402/803] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Oct 12 02:18:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 02:18:05.398202 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed67d9f-e479-4aa3-8a60-111a21555ab6 None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:18:05.447494 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:18:05.503597 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed67d9f-e479-4aa3-8a60-111a21555ab6 None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:18:05.544084 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8820dd9c-d2e7-4f18-9527-fee4f14a0a78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:18:05.544722 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8820dd9c-d2e7-4f18-9527-fee4f14a0a78 None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:18:05.545004 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8820dd9c-d2e7-4f18-9527-fee4f14a0a78 None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:18:05.545273 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8820dd9c-d2e7-4f18-9527-fee4f14a0a78 None admin] PATH_INFO: `/v3/projects` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:18:05.545962 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8820dd9c-d2e7-4f18-9527-fee4f14a0a78 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 02:18:05.546267 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8820dd9c-d2e7-4f18-9527-fee4f14a0a78 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:18:05.547720 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8820dd9c-d2e7-4f18-9527-fee4f14a0a78 None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:18:05.560060 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 402/804] 10.222.0.18 () {56 vars in 1148 bytes} [Wed Oct 12 02:18:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 02:18:05.565862 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37747784-2e9a-4c1c-9ed7-88a22ffc1885 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:18:05.670220 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37747784-2e9a-4c1c-9ed7-88a22ffc1885 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:18:05.684512 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:18:05.707061 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d5e4d7-a9fd-49dd-9fb8-2b5fa2d77096 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:18:05.707725 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d5e4d7-a9fd-49dd-9fb8-2b5fa2d77096 None admin] REQUEST_METHOD: `PUT` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:18:05.708001 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d5e4d7-a9fd-49dd-9fb8-2b5fa2d77096 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:18:05.708271 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d5e4d7-a9fd-49dd-9fb8-2b5fa2d77096 None admin] PATH_INFO: `/v3/projects/beb6def6fcad45959e56425bb8bff4d1/users/f2fca96c111b45b795fb757f77908ff1/roles/b4f35c03154b4810bf6a5fafd0f5f978` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:18:05.710424 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d5e4d7-a9fd-49dd-9fb8-2b5fa2d77096 None admin] RBAC: Authorizing `identity:create_grant(project_id=beb6def6fcad45959e56425bb8bff4d1, user_id=f2fca96c111b45b795fb757f77908ff1, role_id=b4f35c03154b4810bf6a5fafd0f5f978)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:18:05.711857 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d5e4d7-a9fd-49dd-9fb8-2b5fa2d77096 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:18:05.725977 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 403/805] 10.222.0.18 () {58 vars in 1439 bytes} [Wed Oct 12 02:18:05 2022] PUT /identity/v3/projects/beb6def6fcad45959e56425bb8bff4d1/users/f2fca96c111b45b795fb757f77908ff1/roles/b4f35c03154b4810bf6a5fafd0f5f978 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 02:18:06.570639 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44039c51-8c58-44ef-a8a0-d1aec8221a19 None None] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:18:06.571255 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44039c51-8c58-44ef-a8a0-d1aec8221a19 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:18:06.571255 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44039c51-8c58-44ef-a8a0-d1aec8221a19 None None] PATH_INFO: `/` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:18:06.572661 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 403/806] 10.222.0.18 () {54 vars in 927 bytes} [Wed Oct 12 02:18:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 02:18:06.577818 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8a1737-66e7-490a-a4d8-e47dfaf4f48f None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:18:06.578203 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8a1737-66e7-490a-a4d8-e47dfaf4f48f None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:18:06.578380 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8a1737-66e7-490a-a4d8-e47dfaf4f48f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:18:06.599298 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-7f8a1737-66e7-490a-a4d8-e47dfaf4f48f None None] MFA Rules not processed for user `a326a5bb7364479382f528a592371656`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:18:06.600525 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-7f8a1737-66e7-490a-a4d8-e47dfaf4f48f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:18:06.669810 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 404/807] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Oct 12 02:18:06 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 12 02:18:06.938805 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44039c51-8c58-44ef-a8a0-d1aec8221a19 None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:18:07.046133 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44039c51-8c58-44ef-a8a0-d1aec8221a19 None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:18:07.053228 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:18:07.081314 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09aedf40-ed8b-4b3c-b2c3-abf0fdb415ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:18:07.081916 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09aedf40-ed8b-4b3c-b2c3-abf0fdb415ec None admin] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:18:07.082191 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09aedf40-ed8b-4b3c-b2c3-abf0fdb415ec None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:18:07.082458 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09aedf40-ed8b-4b3c-b2c3-abf0fdb415ec None admin] PATH_INFO: `/v3/domains` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:18:07.083119 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09aedf40-ed8b-4b3c-b2c3-abf0fdb415ec None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:18:07.084485 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09aedf40-ed8b-4b3c-b2c3-abf0fdb415ec None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:18:07.092335 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.sql.core [None req-09aedf40-ed8b-4b3c-b2c3-abf0fdb415ec None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Oct 12 02:18:07.092335 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 12 02:18:07.092335 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [parameters: {'id': '7be3e6ab72554681ac176f9d91aecc1b', 'name': 'Default', 'domain_id': '<>', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': None, 'is_domain': 1}] Oct 12 02:18:07.092335 dv-cinder-849143-14-smb devstack@keystone.service[81361]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81361) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 12 02:18:07.099988 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bd8f83-1602-4817-adc1-2975701ae9cf None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:18:07.100280 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bd8f83-1602-4817-adc1-2975701ae9cf None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:18:07.100378 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application [None req-09aedf40-ed8b-4b3c-b2c3-abf0fdb415ec None admin] Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default. Oct 12 02:18:07.100378 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 02:18:07.100378 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 12 02:18:07.100378 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 12 02:18:07.100378 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 12 02:18:07.100378 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 12 02:18:07.100378 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 12 02:18:07.100378 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application result = self._query(query) Oct 12 02:18:07.100378 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 12 02:18:07.100378 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application conn.query(q) Oct 12 02:18:07.100378 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 12 02:18:07.100378 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 12 02:18:07.100378 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 12 02:18:07.100378 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application result.read() Oct 12 02:18:07.101186 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 12 02:18:07.101186 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 12 02:18:07.101186 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 12 02:18:07.101186 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 12 02:18:07.101186 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 12 02:18:07.101186 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 12 02:18:07.101186 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 12 02:18:07.101186 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 12 02:18:07.101186 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Oct 12 02:18:07.101186 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Oct 12 02:18:07.101186 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 12 02:18:07.101186 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Oct 12 02:18:07.101186 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 02:18:07.101186 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 12 02:18:07.101186 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 12 02:18:07.101186 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Oct 12 02:18:07.101186 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return project_ref.to_dict() Oct 12 02:18:07.101186 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 12 02:18:07.105299 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application next(self.gen) Oct 12 02:18:07.105299 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Oct 12 02:18:07.105299 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application yield resource Oct 12 02:18:07.105299 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 12 02:18:07.105299 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application next(self.gen) Oct 12 02:18:07.105299 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Oct 12 02:18:07.105299 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application self.session.rollback() Oct 12 02:18:07.105299 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 12 02:18:07.105299 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application self.force_reraise() Oct 12 02:18:07.105299 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 12 02:18:07.105299 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application raise self.value Oct 12 02:18:07.105299 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Oct 12 02:18:07.105299 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 12 02:18:07.105299 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Oct 12 02:18:07.105299 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application session.commit() Oct 12 02:18:07.105299 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 12 02:18:07.105299 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 12 02:18:07.106198 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 12 02:18:07.106198 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application self._prepare_impl() Oct 12 02:18:07.106198 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 12 02:18:07.106198 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application self.session.flush() Oct 12 02:18:07.106198 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 12 02:18:07.106198 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application self._flush(objects) Oct 12 02:18:07.106198 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 12 02:18:07.106198 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 12 02:18:07.106198 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 12 02:18:07.106198 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application compat.raise_( Oct 12 02:18:07.106198 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 12 02:18:07.106198 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application raise exception Oct 12 02:18:07.106198 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 12 02:18:07.106198 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application flush_context.execute() Oct 12 02:18:07.106198 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 12 02:18:07.106198 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application rec.execute(self) Oct 12 02:18:07.106198 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 12 02:18:07.107102 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 12 02:18:07.107102 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 12 02:18:07.107102 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 12 02:18:07.107102 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Oct 12 02:18:07.107102 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application c = connection._execute_20( Oct 12 02:18:07.107102 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 12 02:18:07.107102 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 12 02:18:07.107102 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 12 02:18:07.107102 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 12 02:18:07.107102 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 12 02:18:07.107102 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 12 02:18:07.107102 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 12 02:18:07.107102 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 12 02:18:07.107102 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 12 02:18:07.107102 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 12 02:18:07.107886 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 12 02:18:07.107886 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application raise exception Oct 12 02:18:07.107886 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 12 02:18:07.107886 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 12 02:18:07.107886 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 12 02:18:07.107886 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 12 02:18:07.107886 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 12 02:18:07.107886 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application result = self._query(query) Oct 12 02:18:07.107886 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 12 02:18:07.107886 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application conn.query(q) Oct 12 02:18:07.107886 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 12 02:18:07.107886 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 12 02:18:07.107886 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 12 02:18:07.107886 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application result.read() Oct 12 02:18:07.107886 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 12 02:18:07.107886 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 12 02:18:07.107886 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 12 02:18:07.108879 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 12 02:18:07.108879 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 12 02:18:07.108879 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 12 02:18:07.108879 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 12 02:18:07.108879 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 12 02:18:07.108879 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Oct 12 02:18:07.108879 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 12 02:18:07.108879 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application [parameters: {'id': '7be3e6ab72554681ac176f9d91aecc1b', 'name': 'Default', 'domain_id': '<>', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': None, 'is_domain': 1}] Oct 12 02:18:07.108879 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 12 02:18:07.108879 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Oct 12 02:18:07.108879 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 12 02:18:07.108879 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Oct 12 02:18:07.108879 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 02:18:07.108879 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Oct 12 02:18:07.108879 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Oct 12 02:18:07.110022 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 12 02:18:07.110022 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 12 02:18:07.110022 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name Default. Oct 12 02:18:07.110022 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Oct 12 02:18:07.110022 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 12 02:18:07.110022 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Oct 12 02:18:07.110022 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 02:18:07.110022 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 02:18:07.110022 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 02:18:07.110022 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 02:18:07.110022 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 02:18:07.110022 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 02:18:07.110022 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 02:18:07.110022 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 02:18:07.110022 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 02:18:07.110022 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 02:18:07.110022 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 02:18:07.112353 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 128, in post Oct 12 02:18:07.112353 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_domain( Oct 12 02:18:07.112353 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 02:18:07.112353 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 02:18:07.112353 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 765, in create_domain Oct 12 02:18:07.112353 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application is_domain_project = self.create_project( Oct 12 02:18:07.112353 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 02:18:07.112353 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 02:18:07.112353 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Oct 12 02:18:07.112353 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application raise exception.Conflict( Oct 12 02:18:07.112353 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default. Oct 12 02:18:07.112353 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Oct 12 02:18:07.113192 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bd8f83-1602-4817-adc1-2975701ae9cf None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:18:07.113279 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 404/808] 10.222.0.18 () {60 vars in 1137 bytes} [Wed Oct 12 02:18:06 2022] POST /identity/v3/domains => generated 190 bytes in 163 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Oct 12 02:18:07.113355 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 405/809] 10.222.0.18 () {54 vars in 927 bytes} [Wed Oct 12 02:18:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 12 02:18:07.113465 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3739a38f-d885-45a9-a5a9-33af4d297bcc None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:18:07.113465 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3739a38f-d885-45a9-a5a9-33af4d297bcc None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:18:07.113465 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3739a38f-d885-45a9-a5a9-33af4d297bcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:18:07.114598 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bd8f83-1602-4817-adc1-2975701ae9cf None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:18:07.133088 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-3739a38f-d885-45a9-a5a9-33af4d297bcc None None] MFA Rules not processed for user `a326a5bb7364479382f528a592371656`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:18:07.134605 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-3739a38f-d885-45a9-a5a9-33af4d297bcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:18:07.216874 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 405/810] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Oct 12 02:18:07 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 12 02:18:07.218977 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bd8f83-1602-4817-adc1-2975701ae9cf None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:18:07.221762 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:18:07.255739 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adfbce4-fcab-4d6b-a8b7-b6b4b6d022bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:18:07.256366 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adfbce4-fcab-4d6b-a8b7-b6b4b6d022bf None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:18:07.256693 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adfbce4-fcab-4d6b-a8b7-b6b4b6d022bf None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:18:07.256965 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adfbce4-fcab-4d6b-a8b7-b6b4b6d022bf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:18:07.267013 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4adfbce4-fcab-4d6b-a8b7-b6b4b6d022bf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:18:07.269300 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4adfbce4-fcab-4d6b-a8b7-b6b4b6d022bf None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:18:07.284252 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-4adfbce4-fcab-4d6b-a8b7-b6b4b6d022bf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 02:18:07.284252 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 02:18:07.284252 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 02:18:07.284252 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 02:18:07.284252 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 02:18:07.284252 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 02:18:07.284252 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 02:18:07.284252 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 02:18:07.284252 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 02:18:07.284252 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 02:18:07.284252 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 02:18:07.284252 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 02:18:07.284252 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 12 02:18:07.284252 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 12 02:18:07.284252 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 12 02:18:07.284252 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 12 02:18:07.285393 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 02:18:07.285393 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 02:18:07.285393 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 02:18:07.285393 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 02:18:07.285393 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 02:18:07.285393 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 02:18:07.285393 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 02:18:07.285393 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Oct 12 02:18:07.285393 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 02:18:07.285393 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Oct 12 02:18:07.285393 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 02:18:07.285393 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 02:18:07.285393 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 02:18:07.285393 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Oct 12 02:18:07.285393 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 02:18:07.285393 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Oct 12 02:18:07.285393 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 12 02:18:07.286290 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 12 02:18:07.286290 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 02:18:07.286290 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Oct 12 02:18:07.288781 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 406/811] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Oct 12 02:18:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 02:18:07.291447 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3739a38f-d885-45a9-a5a9-33af4d297bcc None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:18:07.391044 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:18:07.395595 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3739a38f-d885-45a9-a5a9-33af4d297bcc None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:18:07.431190 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61368780-6e0d-4e30-a7b4-8f804648c323 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:18:07.431792 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61368780-6e0d-4e30-a7b4-8f804648c323 None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:18:07.432066 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61368780-6e0d-4e30-a7b4-8f804648c323 None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:18:07.432335 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61368780-6e0d-4e30-a7b4-8f804648c323 None admin] PATH_INFO: `/v3/domains` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:18:07.432995 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61368780-6e0d-4e30-a7b4-8f804648c323 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 02:18:07.433291 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61368780-6e0d-4e30-a7b4-8f804648c323 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:18:07.434657 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61368780-6e0d-4e30-a7b4-8f804648c323 None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:18:07.460744 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 406/812] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Oct 12 02:18:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 02:18:07.475139 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adfbce4-fcab-4d6b-a8b7-b6b4b6d022bf None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:18:07.584531 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adfbce4-fcab-4d6b-a8b7-b6b4b6d022bf None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:18:07.622422 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a5d9d2-ebf9-4845-8258-754c59b8ad93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:18:07.623061 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a5d9d2-ebf9-4845-8258-754c59b8ad93 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:18:07.623342 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a5d9d2-ebf9-4845-8258-754c59b8ad93 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:18:07.623609 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a5d9d2-ebf9-4845-8258-754c59b8ad93 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:18:07.635780 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a5d9d2-ebf9-4845-8258-754c59b8ad93 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 02:18:07.640210 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-17a5d9d2-ebf9-4845-8258-754c59b8ad93 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 12 02:18:07.640210 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 02:18:07.640210 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 02:18:07.640210 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 02:18:07.640210 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 02:18:07.640210 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 02:18:07.640210 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 02:18:07.640210 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 02:18:07.640210 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 02:18:07.640210 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 02:18:07.640210 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 02:18:07.640210 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 02:18:07.640210 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 12 02:18:07.640210 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 12 02:18:07.640210 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 12 02:18:07.640210 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 12 02:18:07.641413 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 12 02:18:07.641413 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 12 02:18:07.641413 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 12 02:18:07.641413 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 12 02:18:07.641413 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 02:18:07.641413 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 02:18:07.641413 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 02:18:07.641413 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 02:18:07.641413 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 02:18:07.641413 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 02:18:07.641413 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 02:18:07.641413 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Oct 12 02:18:07.641413 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 02:18:07.641413 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Oct 12 02:18:07.641413 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 02:18:07.641413 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 02:18:07.642590 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 02:18:07.642590 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Oct 12 02:18:07.642590 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 02:18:07.642590 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Oct 12 02:18:07.642590 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 12 02:18:07.642590 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 12 02:18:07.642590 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 12 02:18:07.642590 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 12 02:18:07.642590 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 12 02:18:07.642590 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 12 02:18:07.642590 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 12 02:18:07.642590 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Oct 12 02:18:07.642590 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 407/813] 10.222.0.18 () {56 vars in 1096 bytes} [Wed Oct 12 02:18:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 02:18:07.647583 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61368780-6e0d-4e30-a7b4-8f804648c323 None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:18:07.754616 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61368780-6e0d-4e30-a7b4-8f804648c323 None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:18:07.792043 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef55f59-5ac7-43d4-98b4-c8fd96081fce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:18:07.792697 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef55f59-5ac7-43d4-98b4-c8fd96081fce None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:18:07.792973 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef55f59-5ac7-43d4-98b4-c8fd96081fce None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:18:07.793241 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef55f59-5ac7-43d4-98b4-c8fd96081fce None admin] PATH_INFO: `/v3/roles` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:18:07.793919 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef55f59-5ac7-43d4-98b4-c8fd96081fce None admin] RBAC: Adding query filter params (name=admin) {{(pid=81361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 02:18:07.794218 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef55f59-5ac7-43d4-98b4-c8fd96081fce None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:18:07.795629 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef55f59-5ac7-43d4-98b4-c8fd96081fce None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:18:07.805856 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 407/814] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Oct 12 02:18:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 02:18:07.811632 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a5d9d2-ebf9-4845-8258-754c59b8ad93 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:18:07.830109 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:18:07.891900 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e4e0a3-6592-4e89-a25a-01ae8d3f7c45 None None] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:18:07.892909 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e4e0a3-6592-4e89-a25a-01ae8d3f7c45 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:18:07.893272 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e4e0a3-6592-4e89-a25a-01ae8d3f7c45 None None] PATH_INFO: `/` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:18:07.895021 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 408/815] 10.222.0.18 () {54 vars in 927 bytes} [Wed Oct 12 02:18:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 12 02:18:07.899831 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b081f93c-f72a-476b-bf93-5fc71e9a2b82 None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:18:07.900111 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b081f93c-f72a-476b-bf93-5fc71e9a2b82 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:18:07.900382 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b081f93c-f72a-476b-bf93-5fc71e9a2b82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:18:07.913181 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a5d9d2-ebf9-4845-8258-754c59b8ad93 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:18:07.917930 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-b081f93c-f72a-476b-bf93-5fc71e9a2b82 None None] MFA Rules not processed for user `a326a5bb7364479382f528a592371656`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:18:07.919099 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-b081f93c-f72a-476b-bf93-5fc71e9a2b82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:18:07.935973 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:18:07.947806 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad80758-f8cb-4150-a7c2-5873784b435e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:18:07.948438 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad80758-f8cb-4150-a7c2-5873784b435e None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:18:07.948744 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad80758-f8cb-4150-a7c2-5873784b435e None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:18:07.949020 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad80758-f8cb-4150-a7c2-5873784b435e None admin] PATH_INFO: `/v3/users/6f25c0f1c2ef4d839782478caf7082c4` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:18:07.962372 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad80758-f8cb-4150-a7c2-5873784b435e None admin] RBAC: Authorizing `identity:get_user(user_id=6f25c0f1c2ef4d839782478caf7082c4)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:18:07.963797 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad80758-f8cb-4150-a7c2-5873784b435e None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:18:07.965439 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 408/816] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Oct 12 02:18:07 2022] GET /identity/v3/users/6f25c0f1c2ef4d839782478caf7082c4 => generated 285 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 02:18:07.971144 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad80758-f8cb-4150-a7c2-5873784b435e None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:18:07.989117 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 409/817] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Oct 12 02:18:07 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 12 02:18:08.042427 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:18:08.067300 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad80758-f8cb-4150-a7c2-5873784b435e None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:18:08.100751 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf4b26a-a840-4be8-816e-8b17bfdafbed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:18:08.101388 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf4b26a-a840-4be8-816e-8b17bfdafbed None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:18:08.101665 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf4b26a-a840-4be8-816e-8b17bfdafbed None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:18:08.101935 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf4b26a-a840-4be8-816e-8b17bfdafbed None admin] PATH_INFO: `/v3/projects/d2f9f95b1b5148089cdce2bd71e5c58a` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:18:08.103033 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf4b26a-a840-4be8-816e-8b17bfdafbed None admin] RBAC: Authorizing `identity:get_project(project_id=d2f9f95b1b5148089cdce2bd71e5c58a)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:18:08.104447 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf4b26a-a840-4be8-816e-8b17bfdafbed None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:18:08.106074 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 409/818] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Oct 12 02:18:07 2022] GET /identity/v3/projects/d2f9f95b1b5148089cdce2bd71e5c58a => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 02:18:08.112770 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b081f93c-f72a-476b-bf93-5fc71e9a2b82 None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:18:08.209236 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b081f93c-f72a-476b-bf93-5fc71e9a2b82 None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:18:08.242178 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1addf251-d397-4894-a03f-a18cf6c28458 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:18:08.242826 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1addf251-d397-4894-a03f-a18cf6c28458 None admin] REQUEST_METHOD: `PUT` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:18:08.243106 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1addf251-d397-4894-a03f-a18cf6c28458 None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:18:08.243378 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1addf251-d397-4894-a03f-a18cf6c28458 None admin] PATH_INFO: `/v3/projects/d2f9f95b1b5148089cdce2bd71e5c58a/users/6f25c0f1c2ef4d839782478caf7082c4/roles/39b1e8108dff402383def3c559f48189` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:18:08.245264 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1addf251-d397-4894-a03f-a18cf6c28458 None admin] RBAC: Authorizing `identity:create_grant(project_id=d2f9f95b1b5148089cdce2bd71e5c58a, user_id=6f25c0f1c2ef4d839782478caf7082c4, role_id=39b1e8108dff402383def3c559f48189)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:18:08.246690 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1addf251-d397-4894-a03f-a18cf6c28458 None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:18:08.254515 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf4b26a-a840-4be8-816e-8b17bfdafbed None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:18:08.261078 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 410/819] 10.222.0.18 () {58 vars in 1439 bytes} [Wed Oct 12 02:18:08 2022] PUT /identity/v3/projects/d2f9f95b1b5148089cdce2bd71e5c58a/users/6f25c0f1c2ef4d839782478caf7082c4/roles/39b1e8108dff402383def3c559f48189 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 02:18:08.478802 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf4b26a-a840-4be8-816e-8b17bfdafbed None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:18:08.512120 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6441932a-d672-4c52-9d62-e292161f3ff8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:18:08.512774 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6441932a-d672-4c52-9d62-e292161f3ff8 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:18:08.513054 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6441932a-d672-4c52-9d62-e292161f3ff8 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:18:08.513325 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6441932a-d672-4c52-9d62-e292161f3ff8 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:18:08.523617 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6441932a-d672-4c52-9d62-e292161f3ff8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 02:18:08.528359 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-6441932a-d672-4c52-9d62-e292161f3ff8 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 12 02:18:08.528359 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 02:18:08.528359 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 02:18:08.528359 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 02:18:08.528359 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 02:18:08.528359 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 02:18:08.528359 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 02:18:08.528359 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 02:18:08.528359 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 02:18:08.528359 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 02:18:08.528359 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 02:18:08.528359 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 02:18:08.528359 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 12 02:18:08.528359 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 12 02:18:08.528359 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 12 02:18:08.528359 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 12 02:18:08.529515 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 12 02:18:08.529515 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 12 02:18:08.529515 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 12 02:18:08.529515 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 12 02:18:08.529515 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 02:18:08.529515 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 02:18:08.529515 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 02:18:08.529515 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 02:18:08.529515 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 02:18:08.529515 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 02:18:08.529515 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 02:18:08.529515 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Oct 12 02:18:08.529515 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 02:18:08.529515 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Oct 12 02:18:08.529515 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 02:18:08.529515 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 02:18:08.530548 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 02:18:08.530548 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Oct 12 02:18:08.530548 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 02:18:08.530548 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Oct 12 02:18:08.530548 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 12 02:18:08.530548 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 12 02:18:08.530548 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 12 02:18:08.530548 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 12 02:18:08.530548 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 12 02:18:08.530548 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 12 02:18:08.530548 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 12 02:18:08.530548 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Oct 12 02:18:08.530548 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 410/820] 10.222.0.18 () {56 vars in 1120 bytes} [Wed Oct 12 02:18:08 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 12 02:18:08.538441 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1addf251-d397-4894-a03f-a18cf6c28458 None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:18:08.553810 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:18:08.640617 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1addf251-d397-4894-a03f-a18cf6c28458 None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:18:08.675191 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf7865d-020d-44cc-9f9f-df2d64c8e520 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:18:08.675814 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf7865d-020d-44cc-9f9f-df2d64c8e520 None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:18:08.676048 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf7865d-020d-44cc-9f9f-df2d64c8e520 None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:18:08.676315 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf7865d-020d-44cc-9f9f-df2d64c8e520 None admin] PATH_INFO: `/v3/roles` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:18:08.676996 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf7865d-020d-44cc-9f9f-df2d64c8e520 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 02:18:08.677293 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf7865d-020d-44cc-9f9f-df2d64c8e520 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:18:08.678638 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf7865d-020d-44cc-9f9f-df2d64c8e520 None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:18:08.686601 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 411/821] 10.222.0.18 () {56 vars in 1115 bytes} [Wed Oct 12 02:18:08 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 02:18:08.693385 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6441932a-d672-4c52-9d62-e292161f3ff8 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:18:08.696235 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:18:08.794499 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6441932a-d672-4c52-9d62-e292161f3ff8 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:18:08.826780 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc1bc75-4428-45af-87fd-3ec505d106d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:18:08.827406 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc1bc75-4428-45af-87fd-3ec505d106d6 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:18:08.827685 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc1bc75-4428-45af-87fd-3ec505d106d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:18:08.827956 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc1bc75-4428-45af-87fd-3ec505d106d6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:18:08.838590 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc1bc75-4428-45af-87fd-3ec505d106d6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:18:08.840011 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc1bc75-4428-45af-87fd-3ec505d106d6 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:18:08.854185 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-5cc1bc75-4428-45af-87fd-3ec505d106d6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 02:18:08.854185 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 02:18:08.854185 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 02:18:08.854185 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 02:18:08.854185 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 02:18:08.854185 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 02:18:08.854185 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 02:18:08.854185 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 02:18:08.854185 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 02:18:08.854185 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 02:18:08.854185 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 02:18:08.854185 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 02:18:08.854185 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 12 02:18:08.854185 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 12 02:18:08.854185 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 12 02:18:08.854185 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 12 02:18:08.855159 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 02:18:08.855159 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 02:18:08.855159 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 02:18:08.855159 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 02:18:08.855159 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 02:18:08.855159 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 02:18:08.855159 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 02:18:08.855159 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Oct 12 02:18:08.855159 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 02:18:08.855159 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Oct 12 02:18:08.855159 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 02:18:08.855159 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 02:18:08.855159 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 02:18:08.855159 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Oct 12 02:18:08.855159 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 02:18:08.855159 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Oct 12 02:18:08.855159 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 12 02:18:08.856049 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 12 02:18:08.856049 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 02:18:08.856049 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Oct 12 02:18:08.856784 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 411/822] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Oct 12 02:18:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 02:18:08.861388 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf7865d-020d-44cc-9f9f-df2d64c8e520 None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:18:08.933944 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:18:08.958942 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf7865d-020d-44cc-9f9f-df2d64c8e520 None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:18:08.992859 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d09938-9038-42c7-a825-22cf54f68ce2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:18:08.993570 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d09938-9038-42c7-a825-22cf54f68ce2 None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:18:08.993847 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d09938-9038-42c7-a825-22cf54f68ce2 None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:18:08.994111 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d09938-9038-42c7-a825-22cf54f68ce2 None admin] PATH_INFO: `/v3/domains` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:18:08.994739 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d09938-9038-42c7-a825-22cf54f68ce2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 02:18:08.995032 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d09938-9038-42c7-a825-22cf54f68ce2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:18:08.996374 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d09938-9038-42c7-a825-22cf54f68ce2 None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:18:09.008414 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 412/823] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Oct 12 02:18:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 02:18:09.013976 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc1bc75-4428-45af-87fd-3ec505d106d6 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:18:09.067608 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:18:09.112100 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc1bc75-4428-45af-87fd-3ec505d106d6 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:18:09.147546 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c752b6b-d7f9-42b5-bad4-2f0bd5fe5fa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:18:09.148168 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c752b6b-d7f9-42b5-bad4-2f0bd5fe5fa9 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:18:09.148442 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c752b6b-d7f9-42b5-bad4-2f0bd5fe5fa9 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:18:09.148737 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c752b6b-d7f9-42b5-bad4-2f0bd5fe5fa9 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:18:09.156160 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c752b6b-d7f9-42b5-bad4-2f0bd5fe5fa9 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:18:09.157649 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c752b6b-d7f9-42b5-bad4-2f0bd5fe5fa9 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:18:09.168508 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-6c752b6b-d7f9-42b5-bad4-2f0bd5fe5fa9 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 12 02:18:09.168508 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 02:18:09.168508 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 02:18:09.168508 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 02:18:09.168508 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 02:18:09.168508 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 02:18:09.168508 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 02:18:09.168508 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 02:18:09.168508 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 02:18:09.168508 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 02:18:09.168508 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 02:18:09.168508 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 02:18:09.168508 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 12 02:18:09.168508 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 12 02:18:09.168508 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 12 02:18:09.168508 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 12 02:18:09.169517 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 02:18:09.169517 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 02:18:09.169517 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 12 02:18:09.169517 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 12 02:18:09.169517 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 12 02:18:09.169517 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 12 02:18:09.169517 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 02:18:09.169517 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 02:18:09.169517 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 02:18:09.169517 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 02:18:09.169517 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 02:18:09.169517 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Oct 12 02:18:09.169517 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 02:18:09.169517 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Oct 12 02:18:09.169517 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 02:18:09.169517 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 02:18:09.169517 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 02:18:09.169517 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Oct 12 02:18:09.170975 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 02:18:09.170975 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Oct 12 02:18:09.170975 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 12 02:18:09.170975 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 12 02:18:09.170975 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 12 02:18:09.170975 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 12 02:18:09.170975 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 12 02:18:09.170975 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 12 02:18:09.170975 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 12 02:18:09.170975 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Oct 12 02:18:09.170975 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 412/824] 10.222.0.18 () {56 vars in 1093 bytes} [Wed Oct 12 02:18:09 2022] GET /identity/v3/users/nova => generated 82 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 02:18:09.175460 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d09938-9038-42c7-a825-22cf54f68ce2 None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:18:09.271599 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d09938-9038-42c7-a825-22cf54f68ce2 None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:18:09.303906 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf62a4e5-3641-43d2-a68b-91b762535dbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:18:09.304502 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf62a4e5-3641-43d2-a68b-91b762535dbe None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:18:09.304781 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf62a4e5-3641-43d2-a68b-91b762535dbe None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:18:09.305049 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf62a4e5-3641-43d2-a68b-91b762535dbe None admin] PATH_INFO: `/v3/users` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:18:09.305775 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf62a4e5-3641-43d2-a68b-91b762535dbe None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 02:18:09.306075 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf62a4e5-3641-43d2-a68b-91b762535dbe None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:18:09.307500 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf62a4e5-3641-43d2-a68b-91b762535dbe None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:18:09.309181 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:18:09.326441 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 413/825] 10.222.0.18 () {56 vars in 1133 bytes} [Wed Oct 12 02:18:09 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 02:18:09.332888 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c752b6b-d7f9-42b5-bad4-2f0bd5fe5fa9 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:18:09.430604 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c752b6b-d7f9-42b5-bad4-2f0bd5fe5fa9 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:18:09.444559 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:18:09.464762 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b79def-96b2-4d11-a357-a0a9d8ff97cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:18:09.465363 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b79def-96b2-4d11-a357-a0a9d8ff97cf None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:18:09.465645 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b79def-96b2-4d11-a357-a0a9d8ff97cf None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:18:09.465919 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b79def-96b2-4d11-a357-a0a9d8ff97cf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:18:09.535013 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b79def-96b2-4d11-a357-a0a9d8ff97cf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:18:09.536453 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b79def-96b2-4d11-a357-a0a9d8ff97cf None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:18:09.632853 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 413/826] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Oct 12 02:18:09 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Oct 12 02:18:09.638605 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf62a4e5-3641-43d2-a68b-91b762535dbe None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:18:09.735571 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf62a4e5-3641-43d2-a68b-91b762535dbe None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:18:09.769187 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1321dc7-6c01-49df-b199-540a95c3d233 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:18:09.769800 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1321dc7-6c01-49df-b199-540a95c3d233 None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:18:09.770071 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1321dc7-6c01-49df-b199-540a95c3d233 None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:18:09.770336 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1321dc7-6c01-49df-b199-540a95c3d233 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:18:09.779856 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1321dc7-6c01-49df-b199-540a95c3d233 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:18:09.781327 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1321dc7-6c01-49df-b199-540a95c3d233 None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:18:09.796514 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application [None req-f1321dc7-6c01-49df-b199-540a95c3d233 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 02:18:09.796514 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 02:18:09.796514 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 02:18:09.796514 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 02:18:09.796514 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 02:18:09.796514 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 02:18:09.796514 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 02:18:09.796514 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 02:18:09.796514 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 02:18:09.796514 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 02:18:09.796514 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 02:18:09.796514 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 02:18:09.796514 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 12 02:18:09.796514 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 12 02:18:09.796514 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 12 02:18:09.796514 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 12 02:18:09.797514 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 02:18:09.797514 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 02:18:09.797514 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 02:18:09.797514 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 02:18:09.797514 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 02:18:09.797514 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 02:18:09.797514 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 02:18:09.797514 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application with Lock( Oct 12 02:18:09.797514 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 02:18:09.797514 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._enter() Oct 12 02:18:09.797514 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 02:18:09.797514 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 02:18:09.797514 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 02:18:09.797514 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.creator() Oct 12 02:18:09.797514 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 02:18:09.797514 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application created_value = creator( Oct 12 02:18:09.797514 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 12 02:18:09.798987 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 12 02:18:09.798987 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 02:18:09.798987 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Oct 12 02:18:09.798987 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 414/827] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Oct 12 02:18:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 02:18:09.804034 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b79def-96b2-4d11-a357-a0a9d8ff97cf None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:18:09.818619 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:18:09.901534 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b79def-96b2-4d11-a357-a0a9d8ff97cf None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:18:09.935365 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d95bdb-0a45-4d8b-ba46-700b7c1b1833 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:18:09.935963 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d95bdb-0a45-4d8b-ba46-700b7c1b1833 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:18:09.936240 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d95bdb-0a45-4d8b-ba46-700b7c1b1833 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:18:09.936539 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d95bdb-0a45-4d8b-ba46-700b7c1b1833 None admin] PATH_INFO: `/v3/domains` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:18:09.937182 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d95bdb-0a45-4d8b-ba46-700b7c1b1833 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 02:18:09.937482 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d95bdb-0a45-4d8b-ba46-700b7c1b1833 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:18:09.939017 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d95bdb-0a45-4d8b-ba46-700b7c1b1833 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:18:09.949918 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 414/828] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Oct 12 02:18:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 02:18:09.955747 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1321dc7-6c01-49df-b199-540a95c3d233 None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:18:10.002114 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:18:10.056612 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1321dc7-6c01-49df-b199-540a95c3d233 None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:18:10.089200 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7ca5e9-e1d8-4fa5-b6fb-0b33dbd83b3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:18:10.089825 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7ca5e9-e1d8-4fa5-b6fb-0b33dbd83b3a None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:18:10.090105 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7ca5e9-e1d8-4fa5-b6fb-0b33dbd83b3a None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:18:10.090377 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7ca5e9-e1d8-4fa5-b6fb-0b33dbd83b3a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:18:10.097522 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7ca5e9-e1d8-4fa5-b6fb-0b33dbd83b3a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:18:10.098955 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7ca5e9-e1d8-4fa5-b6fb-0b33dbd83b3a None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:18:10.110061 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application [None req-fd7ca5e9-e1d8-4fa5-b6fb-0b33dbd83b3a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 12 02:18:10.110061 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 02:18:10.110061 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 02:18:10.110061 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 02:18:10.110061 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 02:18:10.110061 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 02:18:10.110061 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 02:18:10.110061 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 02:18:10.110061 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 02:18:10.110061 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 02:18:10.110061 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 02:18:10.110061 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 02:18:10.110061 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 12 02:18:10.110061 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 12 02:18:10.110061 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 12 02:18:10.117189 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 12 02:18:10.117189 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 02:18:10.117189 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 02:18:10.117189 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 02:18:10.117189 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 02:18:10.117189 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 02:18:10.117189 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 02:18:10.117189 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 02:18:10.117189 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application with Lock( Oct 12 02:18:10.117189 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 02:18:10.117189 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._enter() Oct 12 02:18:10.117189 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 02:18:10.117189 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 02:18:10.117189 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 02:18:10.117189 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.creator() Oct 12 02:18:10.117189 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 02:18:10.117189 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application created_value = creator( Oct 12 02:18:10.118315 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 12 02:18:10.118315 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 12 02:18:10.118315 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 12 02:18:10.118315 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 12 02:18:10.118315 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 12 02:18:10.118315 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 12 02:18:10.118315 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 12 02:18:10.118315 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Oct 12 02:18:10.118315 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 415/829] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Oct 12 02:18:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 02:18:10.120449 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d95bdb-0a45-4d8b-ba46-700b7c1b1833 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:18:10.194830 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:18:10.219688 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d95bdb-0a45-4d8b-ba46-700b7c1b1833 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:18:10.253069 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc66278-9d3a-4354-b0e5-916a12b2a7d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:18:10.253665 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc66278-9d3a-4354-b0e5-916a12b2a7d0 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:18:10.253943 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc66278-9d3a-4354-b0e5-916a12b2a7d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:18:10.254214 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc66278-9d3a-4354-b0e5-916a12b2a7d0 None admin] PATH_INFO: `/v3/projects` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:18:10.254903 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc66278-9d3a-4354-b0e5-916a12b2a7d0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 02:18:10.255206 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc66278-9d3a-4354-b0e5-916a12b2a7d0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:18:10.256674 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc66278-9d3a-4354-b0e5-916a12b2a7d0 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:18:10.268934 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 415/830] 10.222.0.18 () {56 vars in 1148 bytes} [Wed Oct 12 02:18:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 02:18:10.274923 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7ca5e9-e1d8-4fa5-b6fb-0b33dbd83b3a None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:18:10.377157 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7ca5e9-e1d8-4fa5-b6fb-0b33dbd83b3a None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:18:10.379444 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:18:10.403545 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be80089d-5ebf-496f-bbd7-f98312792b0f None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:18:10.403828 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be80089d-5ebf-496f-bbd7-f98312792b0f None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:18:10.404103 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be80089d-5ebf-496f-bbd7-f98312792b0f None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:18:10.405446 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 416/831] 10.222.0.18 () {54 vars in 927 bytes} [Wed Oct 12 02:18:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 12 02:18:10.411533 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddace6a1-3688-469c-b23e-d2c321363709 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:18:10.411914 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddace6a1-3688-469c-b23e-d2c321363709 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:18:10.412187 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddace6a1-3688-469c-b23e-d2c321363709 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:18:10.412330 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdc422a-2916-4163-a02a-30092a06752d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:18:10.412960 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdc422a-2916-4163-a02a-30092a06752d None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:18:10.413239 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdc422a-2916-4163-a02a-30092a06752d None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:18:10.413513 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdc422a-2916-4163-a02a-30092a06752d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:18:10.414240 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcdc422a-2916-4163-a02a-30092a06752d None admin] RBAC: Adding query filter params (role.id=b4f35c03154b4810bf6a5fafd0f5f978, scope.project.id=beb6def6fcad45959e56425bb8bff4d1, user.id=f2fca96c111b45b795fb757f77908ff1) {{(pid=81361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 02:18:10.414548 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcdc422a-2916-4163-a02a-30092a06752d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:18:10.415972 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcdc422a-2916-4163-a02a-30092a06752d None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:18:10.421992 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 416/832] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Oct 12 02:18:10 2022] GET /identity/v3/role_assignments?user.id=f2fca96c111b45b795fb757f77908ff1&scope.project.id=beb6def6fcad45959e56425bb8bff4d1&role.id=b4f35c03154b4810bf6a5fafd0f5f978 => generated 608 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 02:18:10.433248 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-ddace6a1-3688-469c-b23e-d2c321363709 None None] MFA Rules not processed for user `a326a5bb7364479382f528a592371656`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:18:10.434488 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-ddace6a1-3688-469c-b23e-d2c321363709 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:18:10.507309 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 417/833] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Oct 12 02:18:10 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 12 02:18:10.774333 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdc422a-2916-4163-a02a-30092a06752d None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:18:10.875455 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdc422a-2916-4163-a02a-30092a06752d None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:18:10.910157 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12d0fc6-e145-4b0f-b7e5-dba8f341d2ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:18:10.910786 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12d0fc6-e145-4b0f-b7e5-dba8f341d2ca None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:18:10.911069 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12d0fc6-e145-4b0f-b7e5-dba8f341d2ca None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:18:10.911344 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12d0fc6-e145-4b0f-b7e5-dba8f341d2ca None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:18:10.922378 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12d0fc6-e145-4b0f-b7e5-dba8f341d2ca None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 02:18:10.927205 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application [None req-f12d0fc6-e145-4b0f-b7e5-dba8f341d2ca None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 12 02:18:10.927205 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 02:18:10.927205 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 02:18:10.927205 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 02:18:10.927205 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 02:18:10.927205 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 02:18:10.927205 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 02:18:10.927205 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 02:18:10.927205 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 02:18:10.927205 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 02:18:10.927205 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 02:18:10.927205 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 02:18:10.927205 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 12 02:18:10.927205 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 12 02:18:10.927205 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 12 02:18:10.927205 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 12 02:18:10.928197 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 12 02:18:10.928197 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 12 02:18:10.928197 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 12 02:18:10.928197 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 12 02:18:10.928197 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 02:18:10.928197 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 02:18:10.928197 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 02:18:10.928197 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 02:18:10.928197 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 02:18:10.928197 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 02:18:10.928197 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 02:18:10.928197 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application with Lock( Oct 12 02:18:10.928197 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 02:18:10.928197 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._enter() Oct 12 02:18:10.928197 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 02:18:10.928197 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 02:18:10.929275 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 02:18:10.929275 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.creator() Oct 12 02:18:10.929275 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 02:18:10.929275 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application created_value = creator( Oct 12 02:18:10.929275 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 12 02:18:10.929275 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 12 02:18:10.929275 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 12 02:18:10.929275 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 12 02:18:10.929275 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 12 02:18:10.929275 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 12 02:18:10.929275 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 12 02:18:10.929275 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Oct 12 02:18:10.929275 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 417/834] 10.222.0.18 () {56 vars in 1096 bytes} [Wed Oct 12 02:18:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 02:18:10.934411 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddace6a1-3688-469c-b23e-d2c321363709 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:18:10.998393 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:18:11.041413 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddace6a1-3688-469c-b23e-d2c321363709 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:18:11.075969 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f083ae-67dc-441c-842e-0eb8a4bc39ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:18:11.076643 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f083ae-67dc-441c-842e-0eb8a4bc39ee None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:18:11.076928 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f083ae-67dc-441c-842e-0eb8a4bc39ee None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:18:11.077200 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f083ae-67dc-441c-842e-0eb8a4bc39ee None admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:18:11.077864 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f083ae-67dc-441c-842e-0eb8a4bc39ee None admin] RBAC: Adding query filter params (name=admin) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 02:18:11.078164 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f083ae-67dc-441c-842e-0eb8a4bc39ee None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:18:11.080030 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f083ae-67dc-441c-842e-0eb8a4bc39ee None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:18:11.088243 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 418/835] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Oct 12 02:18:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 02:18:11.094323 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12d0fc6-e145-4b0f-b7e5-dba8f341d2ca None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:18:11.125929 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:18:11.199764 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12d0fc6-e145-4b0f-b7e5-dba8f341d2ca None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:18:11.233383 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21e3639-775d-496b-8e13-c08b623637a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:18:11.234004 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21e3639-775d-496b-8e13-c08b623637a1 None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:18:11.234274 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21e3639-775d-496b-8e13-c08b623637a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:18:11.234538 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21e3639-775d-496b-8e13-c08b623637a1 None admin] PATH_INFO: `/v3/users/6f25c0f1c2ef4d839782478caf7082c4` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:18:11.235657 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21e3639-775d-496b-8e13-c08b623637a1 None admin] RBAC: Authorizing `identity:get_user(user_id=6f25c0f1c2ef4d839782478caf7082c4)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:18:11.237121 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21e3639-775d-496b-8e13-c08b623637a1 None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:18:11.238919 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 418/836] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Oct 12 02:18:11 2022] GET /identity/v3/users/6f25c0f1c2ef4d839782478caf7082c4 => generated 285 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 02:18:11.244719 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f083ae-67dc-441c-842e-0eb8a4bc39ee None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:18:11.344268 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f083ae-67dc-441c-842e-0eb8a4bc39ee None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:18:11.368174 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:18:11.377731 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59eb913-7529-4773-8d80-af65082d1683 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:18:11.378322 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59eb913-7529-4773-8d80-af65082d1683 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:18:11.378595 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59eb913-7529-4773-8d80-af65082d1683 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:18:11.378860 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59eb913-7529-4773-8d80-af65082d1683 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:18:11.442987 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59eb913-7529-4773-8d80-af65082d1683 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:18:11.444408 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59eb913-7529-4773-8d80-af65082d1683 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:18:11.538676 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 419/837] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Oct 12 02:18:11 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 12 02:18:11.544185 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21e3639-775d-496b-8e13-c08b623637a1 None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:18:11.634824 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:18:11.640942 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21e3639-775d-496b-8e13-c08b623637a1 None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:18:11.672595 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a303e2-7a9f-4dff-9c35-7fd801b86f8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:18:11.673746 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a303e2-7a9f-4dff-9c35-7fd801b86f8d None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:18:11.674150 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a303e2-7a9f-4dff-9c35-7fd801b86f8d None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:18:11.674419 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a303e2-7a9f-4dff-9c35-7fd801b86f8d None admin] PATH_INFO: `/v3/projects/d2f9f95b1b5148089cdce2bd71e5c58a` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:18:11.675504 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a303e2-7a9f-4dff-9c35-7fd801b86f8d None admin] RBAC: Authorizing `identity:get_project(project_id=d2f9f95b1b5148089cdce2bd71e5c58a)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:18:11.676950 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a303e2-7a9f-4dff-9c35-7fd801b86f8d None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:18:11.678562 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 419/838] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Oct 12 02:18:11 2022] GET /identity/v3/projects/d2f9f95b1b5148089cdce2bd71e5c58a => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 02:18:11.684555 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59eb913-7529-4773-8d80-af65082d1683 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:18:11.711265 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:18:11.781227 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59eb913-7529-4773-8d80-af65082d1683 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:18:11.814681 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6768c2f-916a-4f7e-a3f9-b0fd4c8b5925 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:18:11.815265 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6768c2f-916a-4f7e-a3f9-b0fd4c8b5925 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:18:11.815540 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6768c2f-916a-4f7e-a3f9-b0fd4c8b5925 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:18:11.815810 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6768c2f-916a-4f7e-a3f9-b0fd4c8b5925 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:18:11.816561 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6768c2f-916a-4f7e-a3f9-b0fd4c8b5925 None admin] RBAC: Adding query filter params (role.id=39b1e8108dff402383def3c559f48189, scope.project.id=d2f9f95b1b5148089cdce2bd71e5c58a, user.id=6f25c0f1c2ef4d839782478caf7082c4) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 02:18:11.816869 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6768c2f-916a-4f7e-a3f9-b0fd4c8b5925 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:18:11.818272 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6768c2f-916a-4f7e-a3f9-b0fd4c8b5925 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:18:11.823759 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 420/839] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Oct 12 02:18:11 2022] GET /identity/v3/role_assignments?user.id=6f25c0f1c2ef4d839782478caf7082c4&scope.project.id=d2f9f95b1b5148089cdce2bd71e5c58a&role.id=39b1e8108dff402383def3c559f48189 => generated 608 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 02:18:13.946662 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f975bbf-4605-4770-9db3-58945f6da786 None None] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:18:13.947209 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f975bbf-4605-4770-9db3-58945f6da786 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:18:13.947209 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f975bbf-4605-4770-9db3-58945f6da786 None None] PATH_INFO: `/` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:18:13.948585 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 420/840] 10.222.0.18 () {54 vars in 927 bytes} [Wed Oct 12 02:18:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 02:18:13.953614 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9811f0-ba7d-4853-a5ad-ebbe4564d147 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:18:13.954016 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9811f0-ba7d-4853-a5ad-ebbe4564d147 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:18:13.954663 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9811f0-ba7d-4853-a5ad-ebbe4564d147 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:18:13.973112 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-3e9811f0-ba7d-4853-a5ad-ebbe4564d147 None None] MFA Rules not processed for user `a326a5bb7364479382f528a592371656`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:18:13.974288 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-3e9811f0-ba7d-4853-a5ad-ebbe4564d147 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:18:14.038491 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 421/841] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Oct 12 02:18:13 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 12 02:18:14.307752 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f975bbf-4605-4770-9db3-58945f6da786 None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:18:14.405986 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f975bbf-4605-4770-9db3-58945f6da786 None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:18:14.439067 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923b6e15-33ab-4eb4-aa8f-fa3870978411 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:18:14.439806 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923b6e15-33ab-4eb4-aa8f-fa3870978411 None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:18:14.440079 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923b6e15-33ab-4eb4-aa8f-fa3870978411 None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:18:14.440342 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923b6e15-33ab-4eb4-aa8f-fa3870978411 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:18:14.441450 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923b6e15-33ab-4eb4-aa8f-fa3870978411 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:18:14.442863 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923b6e15-33ab-4eb4-aa8f-fa3870978411 None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:18:14.444403 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 421/842] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Oct 12 02:18:14 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 02:18:14.450207 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9811f0-ba7d-4853-a5ad-ebbe4564d147 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:18:14.471301 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:18:14.549233 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9811f0-ba7d-4853-a5ad-ebbe4564d147 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:18:14.582049 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2bc1d8-c609-4fa5-85a1-bc707c41045b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:18:14.582589 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2bc1d8-c609-4fa5-85a1-bc707c41045b None admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:18:14.582859 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2bc1d8-c609-4fa5-85a1-bc707c41045b None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:18:14.583124 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2bc1d8-c609-4fa5-85a1-bc707c41045b None admin] PATH_INFO: `/v3/users` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:18:14.583756 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2bc1d8-c609-4fa5-85a1-bc707c41045b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:18:14.585173 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2bc1d8-c609-4fa5-85a1-bc707c41045b None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:18:14.605448 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 422/843] 10.222.0.18 () {60 vars in 1132 bytes} [Wed Oct 12 02:18:14 2022] POST /identity/v3/users => generated 286 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 02:18:16.743416 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db1c31c-4e30-44a1-b252-869e1bc5978a None None] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:18:16.743971 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db1c31c-4e30-44a1-b252-869e1bc5978a None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:18:16.743971 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db1c31c-4e30-44a1-b252-869e1bc5978a None None] PATH_INFO: `/` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:18:16.745331 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 422/844] 10.222.0.18 () {54 vars in 927 bytes} [Wed Oct 12 02:18:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 02:18:16.750500 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815b89e1-9058-43ae-85bc-07202541fdf1 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:18:16.751392 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815b89e1-9058-43ae-85bc-07202541fdf1 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:18:16.751804 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815b89e1-9058-43ae-85bc-07202541fdf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:18:16.770050 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-815b89e1-9058-43ae-85bc-07202541fdf1 None None] MFA Rules not processed for user `a326a5bb7364479382f528a592371656`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:18:16.771211 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-815b89e1-9058-43ae-85bc-07202541fdf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:18:16.835200 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 423/845] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Oct 12 02:18:16 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 12 02:18:17.102500 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db1c31c-4e30-44a1-b252-869e1bc5978a None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:18:17.134003 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:18:17.202024 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db1c31c-4e30-44a1-b252-869e1bc5978a None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:18:17.234982 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae956ee-b374-4cfd-b1d7-e70a271ed345 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:18:17.235632 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae956ee-b374-4cfd-b1d7-e70a271ed345 None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:18:17.235902 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae956ee-b374-4cfd-b1d7-e70a271ed345 None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:18:17.236177 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae956ee-b374-4cfd-b1d7-e70a271ed345 None admin] PATH_INFO: `/v3/roles/7b67553aa5874cca8c47e5fb5ffa1971` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:18:17.237562 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae956ee-b374-4cfd-b1d7-e70a271ed345 None admin] RBAC: Authorizing `identity:get_role(role_id=7b67553aa5874cca8c47e5fb5ffa1971)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:18:17.239182 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae956ee-b374-4cfd-b1d7-e70a271ed345 None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:18:17.240480 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 423/846] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Oct 12 02:18:17 2022] GET /identity/v3/roles/7b67553aa5874cca8c47e5fb5ffa1971 => generated 223 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 02:18:17.246285 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815b89e1-9058-43ae-85bc-07202541fdf1 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:18:17.254885 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:18:17.344169 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815b89e1-9058-43ae-85bc-07202541fdf1 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:18:17.377465 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc637cfb-00fd-4ea9-9562-cab4a762d114 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:18:17.378033 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc637cfb-00fd-4ea9-9562-cab4a762d114 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:18:17.378309 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc637cfb-00fd-4ea9-9562-cab4a762d114 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:18:17.378578 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc637cfb-00fd-4ea9-9562-cab4a762d114 None admin] PATH_INFO: `/v3/users/3ae4e653ad584b2487f4070210f08328` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:18:17.391181 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc637cfb-00fd-4ea9-9562-cab4a762d114 None admin] RBAC: Authorizing `identity:get_user(user_id=3ae4e653ad584b2487f4070210f08328)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:18:17.392724 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc637cfb-00fd-4ea9-9562-cab4a762d114 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:18:17.394320 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 424/847] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Oct 12 02:18:17 2022] GET /identity/v3/users/3ae4e653ad584b2487f4070210f08328 => generated 286 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 02:18:17.400021 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae956ee-b374-4cfd-b1d7-e70a271ed345 None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:18:17.493668 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:18:17.496731 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae956ee-b374-4cfd-b1d7-e70a271ed345 None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:18:17.529519 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b629a1d8-d7fe-4436-971c-a0b440916bd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:18:17.530138 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b629a1d8-d7fe-4436-971c-a0b440916bd3 None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:18:17.530413 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b629a1d8-d7fe-4436-971c-a0b440916bd3 None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:18:17.530681 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b629a1d8-d7fe-4436-971c-a0b440916bd3 None admin] PATH_INFO: `/v3/projects/d2f9f95b1b5148089cdce2bd71e5c58a` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:18:17.531761 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b629a1d8-d7fe-4436-971c-a0b440916bd3 None admin] RBAC: Authorizing `identity:get_project(project_id=d2f9f95b1b5148089cdce2bd71e5c58a)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:18:17.533994 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b629a1d8-d7fe-4436-971c-a0b440916bd3 None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:18:17.535602 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 424/848] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Oct 12 02:18:17 2022] GET /identity/v3/projects/d2f9f95b1b5148089cdce2bd71e5c58a => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 02:18:17.541465 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc637cfb-00fd-4ea9-9562-cab4a762d114 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:18:17.601361 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:18:17.637816 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc637cfb-00fd-4ea9-9562-cab4a762d114 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:18:17.671127 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a02f280-7905-4dae-aff3-79349059a38b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:18:17.671763 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a02f280-7905-4dae-aff3-79349059a38b None admin] REQUEST_METHOD: `PUT` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:18:17.672047 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a02f280-7905-4dae-aff3-79349059a38b None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:18:17.672320 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a02f280-7905-4dae-aff3-79349059a38b None admin] PATH_INFO: `/v3/projects/d2f9f95b1b5148089cdce2bd71e5c58a/users/3ae4e653ad584b2487f4070210f08328/roles/7b67553aa5874cca8c47e5fb5ffa1971` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:18:17.674422 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a02f280-7905-4dae-aff3-79349059a38b None admin] RBAC: Authorizing `identity:create_grant(project_id=d2f9f95b1b5148089cdce2bd71e5c58a, user_id=3ae4e653ad584b2487f4070210f08328, role_id=7b67553aa5874cca8c47e5fb5ffa1971)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:18:17.675829 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a02f280-7905-4dae-aff3-79349059a38b None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:18:17.688121 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 425/849] 10.222.0.18 () {58 vars in 1439 bytes} [Wed Oct 12 02:18:17 2022] PUT /identity/v3/projects/d2f9f95b1b5148089cdce2bd71e5c58a/users/3ae4e653ad584b2487f4070210f08328/roles/7b67553aa5874cca8c47e5fb5ffa1971 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 02:18:19.830696 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e71a7e-f7d3-453f-8304-ba7f0e8fd3cb None None] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:18:19.831193 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e71a7e-f7d3-453f-8304-ba7f0e8fd3cb None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:18:19.831193 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e71a7e-f7d3-453f-8304-ba7f0e8fd3cb None None] PATH_INFO: `/` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:18:19.832531 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 425/850] 10.222.0.18 () {54 vars in 927 bytes} [Wed Oct 12 02:18:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 02:18:19.837776 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f64d85-2e8c-4166-8fcc-5ec66c83e8fb None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:18:19.838202 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f64d85-2e8c-4166-8fcc-5ec66c83e8fb None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:18:19.838320 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f64d85-2e8c-4166-8fcc-5ec66c83e8fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:18:19.856622 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-77f64d85-2e8c-4166-8fcc-5ec66c83e8fb None None] MFA Rules not processed for user `a326a5bb7364479382f528a592371656`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:18:19.857796 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-77f64d85-2e8c-4166-8fcc-5ec66c83e8fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:18:19.924531 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 426/851] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Oct 12 02:18:19 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 12 02:18:20.229913 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e71a7e-f7d3-453f-8304-ba7f0e8fd3cb None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:18:20.349267 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e71a7e-f7d3-453f-8304-ba7f0e8fd3cb None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:18:20.387206 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845cc6f6-87a0-4007-9721-e74a4a89677a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:18:20.387829 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845cc6f6-87a0-4007-9721-e74a4a89677a None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:18:20.388102 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845cc6f6-87a0-4007-9721-e74a4a89677a None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:18:20.388368 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845cc6f6-87a0-4007-9721-e74a4a89677a None admin] PATH_INFO: `/v3/roles/7b67553aa5874cca8c47e5fb5ffa1971` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:18:20.389779 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845cc6f6-87a0-4007-9721-e74a4a89677a None admin] RBAC: Authorizing `identity:get_role(role_id=7b67553aa5874cca8c47e5fb5ffa1971)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:18:20.392129 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845cc6f6-87a0-4007-9721-e74a4a89677a None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:18:20.393668 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 426/852] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Oct 12 02:18:20 2022] GET /identity/v3/roles/7b67553aa5874cca8c47e5fb5ffa1971 => generated 223 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 02:18:20.400619 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f64d85-2e8c-4166-8fcc-5ec66c83e8fb None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:18:20.462207 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:18:20.515604 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f64d85-2e8c-4166-8fcc-5ec66c83e8fb None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:18:20.555144 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daece87a-9c39-4279-aef5-b48e8f8eae86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:18:20.555773 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daece87a-9c39-4279-aef5-b48e8f8eae86 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:18:20.556050 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daece87a-9c39-4279-aef5-b48e8f8eae86 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:18:20.556320 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daece87a-9c39-4279-aef5-b48e8f8eae86 None admin] PATH_INFO: `/v3/users/3ae4e653ad584b2487f4070210f08328` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:18:20.557884 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daece87a-9c39-4279-aef5-b48e8f8eae86 None admin] RBAC: Authorizing `identity:get_user(user_id=3ae4e653ad584b2487f4070210f08328)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:18:20.558880 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daece87a-9c39-4279-aef5-b48e8f8eae86 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:18:20.560456 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 427/853] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Oct 12 02:18:20 2022] GET /identity/v3/users/3ae4e653ad584b2487f4070210f08328 => generated 286 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 02:18:20.566860 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845cc6f6-87a0-4007-9721-e74a4a89677a None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:18:20.605742 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:18:20.670465 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845cc6f6-87a0-4007-9721-e74a4a89677a None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:18:20.704492 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d4d7e7-510d-4e61-a208-cbb7abe27376 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:18:20.705092 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d4d7e7-510d-4e61-a208-cbb7abe27376 None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:18:20.705370 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d4d7e7-510d-4e61-a208-cbb7abe27376 None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:18:20.705640 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d4d7e7-510d-4e61-a208-cbb7abe27376 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:18:20.772092 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d4d7e7-510d-4e61-a208-cbb7abe27376 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:18:20.773490 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d4d7e7-510d-4e61-a208-cbb7abe27376 None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:18:20.805633 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:18:20.869093 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 427/854] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Oct 12 02:18:20 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 12 02:18:20.875029 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daece87a-9c39-4279-aef5-b48e8f8eae86 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:18:20.974226 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daece87a-9c39-4279-aef5-b48e8f8eae86 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:18:20.996849 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:18:21.009167 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c129238-6e5b-4c98-948e-61f7670dfe90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:18:21.009793 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c129238-6e5b-4c98-948e-61f7670dfe90 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:18:21.010072 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c129238-6e5b-4c98-948e-61f7670dfe90 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:18:21.010345 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c129238-6e5b-4c98-948e-61f7670dfe90 None admin] PATH_INFO: `/v3/projects/d2f9f95b1b5148089cdce2bd71e5c58a` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:18:21.011449 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c129238-6e5b-4c98-948e-61f7670dfe90 None admin] RBAC: Authorizing `identity:get_project(project_id=d2f9f95b1b5148089cdce2bd71e5c58a)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:18:21.012901 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c129238-6e5b-4c98-948e-61f7670dfe90 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:18:21.014521 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 428/855] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Oct 12 02:18:20 2022] GET /identity/v3/projects/d2f9f95b1b5148089cdce2bd71e5c58a => generated 311 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 02:18:21.021450 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d4d7e7-510d-4e61-a208-cbb7abe27376 None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:18:21.116627 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d4d7e7-510d-4e61-a208-cbb7abe27376 None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:18:21.150286 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3e6fcf-e885-4359-8bf0-a3e8109e3677 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:18:21.150877 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3e6fcf-e885-4359-8bf0-a3e8109e3677 None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:18:21.151156 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3e6fcf-e885-4359-8bf0-a3e8109e3677 None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:18:21.151429 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3e6fcf-e885-4359-8bf0-a3e8109e3677 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:18:21.152146 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3e6fcf-e885-4359-8bf0-a3e8109e3677 None admin] RBAC: Adding query filter params (role.id=7b67553aa5874cca8c47e5fb5ffa1971, scope.project.id=d2f9f95b1b5148089cdce2bd71e5c58a, user.id=3ae4e653ad584b2487f4070210f08328) {{(pid=81361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 02:18:21.152451 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3e6fcf-e885-4359-8bf0-a3e8109e3677 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:18:21.153896 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3e6fcf-e885-4359-8bf0-a3e8109e3677 None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:18:21.156633 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:18:21.160007 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 428/856] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Oct 12 02:18:21 2022] GET /identity/v3/role_assignments?user.id=3ae4e653ad584b2487f4070210f08328&scope.project.id=d2f9f95b1b5148089cdce2bd71e5c58a&role.id=7b67553aa5874cca8c47e5fb5ffa1971 => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 02:18:23.270802 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dffd85d-ef0d-47c2-8bb3-e96c23dd86bc None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:18:23.271337 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dffd85d-ef0d-47c2-8bb3-e96c23dd86bc None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:18:23.271337 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dffd85d-ef0d-47c2-8bb3-e96c23dd86bc None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:18:23.272711 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 429/857] 10.222.0.18 () {54 vars in 927 bytes} [Wed Oct 12 02:18:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 02:18:23.278115 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90856755-aa82-4834-9079-c4957cdbb418 None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:18:23.278511 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90856755-aa82-4834-9079-c4957cdbb418 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:18:23.278667 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90856755-aa82-4834-9079-c4957cdbb418 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:18:23.296942 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-90856755-aa82-4834-9079-c4957cdbb418 None None] MFA Rules not processed for user `a326a5bb7364479382f528a592371656`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:18:23.298718 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-90856755-aa82-4834-9079-c4957cdbb418 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:18:23.363700 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 429/858] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Oct 12 02:18:23 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 12 02:18:23.631470 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dffd85d-ef0d-47c2-8bb3-e96c23dd86bc None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:18:23.728959 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dffd85d-ef0d-47c2-8bb3-e96c23dd86bc None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:18:23.761460 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc27d931-2ddf-4a92-8652-b9816941fb15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:18:23.762068 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc27d931-2ddf-4a92-8652-b9816941fb15 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:18:23.762341 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc27d931-2ddf-4a92-8652-b9816941fb15 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:18:23.762604 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc27d931-2ddf-4a92-8652-b9816941fb15 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:18:23.763684 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc27d931-2ddf-4a92-8652-b9816941fb15 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:18:23.765132 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc27d931-2ddf-4a92-8652-b9816941fb15 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:18:23.767301 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 430/859] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Oct 12 02:18:23 2022] GET /identity/v3/domains/default => generated 199 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 02:18:23.773002 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90856755-aa82-4834-9079-c4957cdbb418 None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:18:23.867945 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90856755-aa82-4834-9079-c4957cdbb418 None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:18:23.895984 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:18:23.901881 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f4c073-c32c-41fd-8386-218708459093 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:18:23.902480 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f4c073-c32c-41fd-8386-218708459093 None admin] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:18:23.902759 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f4c073-c32c-41fd-8386-218708459093 None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:18:23.903031 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f4c073-c32c-41fd-8386-218708459093 None admin] PATH_INFO: `/v3/projects` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:18:23.903681 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f4c073-c32c-41fd-8386-218708459093 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:18:23.905133 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f4c073-c32c-41fd-8386-218708459093 None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:18:23.931945 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 430/860] 10.222.0.18 () {60 vars in 1141 bytes} [Wed Oct 12 02:18:23 2022] POST /identity/v3/projects => generated 311 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 02:18:26.084935 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50aa73c1-efeb-4a77-b3bb-a6c6774bc813 None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:18:26.085519 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50aa73c1-efeb-4a77-b3bb-a6c6774bc813 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:18:26.085519 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50aa73c1-efeb-4a77-b3bb-a6c6774bc813 None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:18:26.086794 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 431/861] 10.222.0.18 () {54 vars in 927 bytes} [Wed Oct 12 02:18:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 02:18:26.091937 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056c6c23-65f4-406a-a709-6f871d03ffa8 None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:18:26.092377 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056c6c23-65f4-406a-a709-6f871d03ffa8 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:18:26.092501 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056c6c23-65f4-406a-a709-6f871d03ffa8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:18:26.111015 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-056c6c23-65f4-406a-a709-6f871d03ffa8 None None] MFA Rules not processed for user `a326a5bb7364479382f528a592371656`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:18:26.112182 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-056c6c23-65f4-406a-a709-6f871d03ffa8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:18:26.175685 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 431/862] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Oct 12 02:18:26 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 12 02:18:26.446686 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50aa73c1-efeb-4a77-b3bb-a6c6774bc813 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:18:26.504940 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:18:26.546145 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50aa73c1-efeb-4a77-b3bb-a6c6774bc813 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:18:26.578776 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d175263-c61f-4d30-b57d-f4d65cb9f0c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:18:26.579386 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d175263-c61f-4d30-b57d-f4d65cb9f0c9 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:18:26.579661 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d175263-c61f-4d30-b57d-f4d65cb9f0c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:18:26.579935 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d175263-c61f-4d30-b57d-f4d65cb9f0c9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:18:26.581046 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d175263-c61f-4d30-b57d-f4d65cb9f0c9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:18:26.582452 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d175263-c61f-4d30-b57d-f4d65cb9f0c9 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:18:26.583993 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 432/863] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Oct 12 02:18:26 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 02:18:26.589666 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056c6c23-65f4-406a-a709-6f871d03ffa8 None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:18:26.684207 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056c6c23-65f4-406a-a709-6f871d03ffa8 None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:18:26.696642 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:18:26.718642 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b153e4b7-9952-405f-92e0-5643ff468e94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:18:26.719960 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b153e4b7-9952-405f-92e0-5643ff468e94 None admin] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:18:26.720240 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b153e4b7-9952-405f-92e0-5643ff468e94 None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:18:26.720547 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b153e4b7-9952-405f-92e0-5643ff468e94 None admin] PATH_INFO: `/v3/users` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:18:26.721189 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b153e4b7-9952-405f-92e0-5643ff468e94 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:18:26.722597 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b153e4b7-9952-405f-92e0-5643ff468e94 None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:18:26.742721 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 432/864] 10.222.0.18 () {60 vars in 1132 bytes} [Wed Oct 12 02:18:26 2022] POST /identity/v3/users => generated 286 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 02:18:28.942157 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931a4548-b1e5-4290-a32a-08351a69b45c None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:18:28.942707 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931a4548-b1e5-4290-a32a-08351a69b45c None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:18:28.942707 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931a4548-b1e5-4290-a32a-08351a69b45c None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:18:28.944021 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 433/865] 10.222.0.18 () {54 vars in 927 bytes} [Wed Oct 12 02:18:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 02:18:28.949152 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031822a6-9f69-447b-8614-a5368de1eded None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:18:28.949568 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031822a6-9f69-447b-8614-a5368de1eded None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:18:28.949703 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031822a6-9f69-447b-8614-a5368de1eded None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:18:28.968417 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-031822a6-9f69-447b-8614-a5368de1eded None None] MFA Rules not processed for user `a326a5bb7364479382f528a592371656`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:18:28.970705 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-031822a6-9f69-447b-8614-a5368de1eded None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:18:29.035299 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 433/866] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Oct 12 02:18:28 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 12 02:18:29.308638 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931a4548-b1e5-4290-a32a-08351a69b45c None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:18:29.409365 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931a4548-b1e5-4290-a32a-08351a69b45c None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:18:29.433737 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:18:29.443166 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea999e6-9ed1-4836-bb3f-8e5ae1826642 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:18:29.443774 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea999e6-9ed1-4836-bb3f-8e5ae1826642 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:18:29.444046 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea999e6-9ed1-4836-bb3f-8e5ae1826642 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:18:29.444311 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea999e6-9ed1-4836-bb3f-8e5ae1826642 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:18:29.454743 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea999e6-9ed1-4836-bb3f-8e5ae1826642 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 02:18:29.459429 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-9ea999e6-9ed1-4836-bb3f-8e5ae1826642 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 12 02:18:29.459429 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 02:18:29.459429 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 02:18:29.459429 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 02:18:29.459429 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 02:18:29.459429 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 02:18:29.459429 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 02:18:29.459429 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 02:18:29.459429 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 02:18:29.459429 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 02:18:29.459429 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 02:18:29.459429 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 02:18:29.459429 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 12 02:18:29.459429 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 12 02:18:29.459429 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 12 02:18:29.459429 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 12 02:18:29.460626 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 12 02:18:29.460626 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 12 02:18:29.460626 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 12 02:18:29.460626 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 12 02:18:29.460626 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 02:18:29.460626 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 02:18:29.460626 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 02:18:29.460626 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 02:18:29.460626 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 02:18:29.460626 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 02:18:29.460626 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 02:18:29.460626 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Oct 12 02:18:29.460626 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 02:18:29.460626 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Oct 12 02:18:29.460626 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 02:18:29.460626 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 02:18:29.461782 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 02:18:29.461782 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Oct 12 02:18:29.461782 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 02:18:29.461782 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Oct 12 02:18:29.461782 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 12 02:18:29.461782 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 12 02:18:29.461782 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 12 02:18:29.461782 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 12 02:18:29.461782 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 12 02:18:29.461782 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 12 02:18:29.461782 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 12 02:18:29.461782 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Oct 12 02:18:29.461782 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 434/867] 10.222.0.18 () {56 vars in 1096 bytes} [Wed Oct 12 02:18:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 02:18:29.466556 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031822a6-9f69-447b-8614-a5368de1eded None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:18:29.560208 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:18:29.564896 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031822a6-9f69-447b-8614-a5368de1eded None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:18:29.599432 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf05263-956e-46db-80eb-43bbf1c33f7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:18:29.600024 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf05263-956e-46db-80eb-43bbf1c33f7c None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:18:29.600301 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf05263-956e-46db-80eb-43bbf1c33f7c None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:18:29.600602 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf05263-956e-46db-80eb-43bbf1c33f7c None admin] PATH_INFO: `/v3/roles` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:18:29.601259 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf05263-956e-46db-80eb-43bbf1c33f7c None admin] RBAC: Adding query filter params (name=admin) {{(pid=81361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 02:18:29.601559 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf05263-956e-46db-80eb-43bbf1c33f7c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:18:29.602917 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf05263-956e-46db-80eb-43bbf1c33f7c None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:18:29.611362 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 434/868] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Oct 12 02:18:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 02:18:29.617431 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea999e6-9ed1-4836-bb3f-8e5ae1826642 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:18:29.714488 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea999e6-9ed1-4836-bb3f-8e5ae1826642 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:18:29.748245 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505a4a89-8adf-4969-9eaf-b0777599c741 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:18:29.748887 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505a4a89-8adf-4969-9eaf-b0777599c741 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:18:29.749164 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505a4a89-8adf-4969-9eaf-b0777599c741 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:18:29.749434 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505a4a89-8adf-4969-9eaf-b0777599c741 None admin] PATH_INFO: `/v3/users/c0490b6ac72b4b0eb02370b034c97ce6` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:18:29.762785 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505a4a89-8adf-4969-9eaf-b0777599c741 None admin] RBAC: Authorizing `identity:get_user(user_id=c0490b6ac72b4b0eb02370b034c97ce6)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:18:29.764197 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505a4a89-8adf-4969-9eaf-b0777599c741 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:18:29.766330 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 435/869] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Oct 12 02:18:29 2022] GET /identity/v3/users/c0490b6ac72b4b0eb02370b034c97ce6 => generated 286 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 02:18:29.771940 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf05263-956e-46db-80eb-43bbf1c33f7c None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:18:29.868137 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf05263-956e-46db-80eb-43bbf1c33f7c None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:18:29.900142 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbe7301-8f8e-4a47-aebe-c1d972a8f097 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:18:29.900788 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbe7301-8f8e-4a47-aebe-c1d972a8f097 None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:18:29.901069 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbe7301-8f8e-4a47-aebe-c1d972a8f097 None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:18:29.901342 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbe7301-8f8e-4a47-aebe-c1d972a8f097 None admin] PATH_INFO: `/v3/projects/00a6b66beb294d4289d1177e39fc30ce` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:18:29.902440 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbe7301-8f8e-4a47-aebe-c1d972a8f097 None admin] RBAC: Authorizing `identity:get_project(project_id=00a6b66beb294d4289d1177e39fc30ce)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:18:29.903862 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbe7301-8f8e-4a47-aebe-c1d972a8f097 None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:18:29.905483 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 435/870] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Oct 12 02:18:29 2022] GET /identity/v3/projects/00a6b66beb294d4289d1177e39fc30ce => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 02:18:29.911371 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505a4a89-8adf-4969-9eaf-b0777599c741 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:18:29.956276 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:18:30.009275 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505a4a89-8adf-4969-9eaf-b0777599c741 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:18:30.041678 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4900f4-9cb6-4933-8146-f29ad81c978c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:18:30.042314 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4900f4-9cb6-4933-8146-f29ad81c978c None admin] REQUEST_METHOD: `PUT` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:18:30.042586 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4900f4-9cb6-4933-8146-f29ad81c978c None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:18:30.042853 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4900f4-9cb6-4933-8146-f29ad81c978c None admin] PATH_INFO: `/v3/projects/00a6b66beb294d4289d1177e39fc30ce/users/c0490b6ac72b4b0eb02370b034c97ce6/roles/39b1e8108dff402383def3c559f48189` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:18:30.044715 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4900f4-9cb6-4933-8146-f29ad81c978c None admin] RBAC: Authorizing `identity:create_grant(project_id=00a6b66beb294d4289d1177e39fc30ce, user_id=c0490b6ac72b4b0eb02370b034c97ce6, role_id=39b1e8108dff402383def3c559f48189)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:18:30.046113 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4900f4-9cb6-4933-8146-f29ad81c978c None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:18:30.059183 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 436/871] 10.222.0.18 () {58 vars in 1439 bytes} [Wed Oct 12 02:18:29 2022] PUT /identity/v3/projects/00a6b66beb294d4289d1177e39fc30ce/users/c0490b6ac72b4b0eb02370b034c97ce6/roles/39b1e8108dff402383def3c559f48189 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 02:18:32.211571 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89616dd-48f1-4749-9e7a-59de369e26d1 None None] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:18:32.212129 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89616dd-48f1-4749-9e7a-59de369e26d1 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:18:32.212129 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89616dd-48f1-4749-9e7a-59de369e26d1 None None] PATH_INFO: `/` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:18:32.213542 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 436/872] 10.222.0.18 () {54 vars in 927 bytes} [Wed Oct 12 02:18:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 02:18:32.219257 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bca9da-f914-436d-b761-25ee6ed96e27 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:18:32.219691 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bca9da-f914-436d-b761-25ee6ed96e27 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:18:32.219790 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bca9da-f914-436d-b761-25ee6ed96e27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:18:32.237335 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-57bca9da-f914-436d-b761-25ee6ed96e27 None None] MFA Rules not processed for user `a326a5bb7364479382f528a592371656`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:18:32.238763 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-57bca9da-f914-436d-b761-25ee6ed96e27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:18:32.303259 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 437/873] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Oct 12 02:18:32 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 12 02:18:32.573099 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89616dd-48f1-4749-9e7a-59de369e26d1 None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:18:32.601209 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:18:32.673030 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89616dd-48f1-4749-9e7a-59de369e26d1 None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:18:32.705491 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185ecde5-075f-447b-ad0c-db1638f462fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:18:32.706090 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185ecde5-075f-447b-ad0c-db1638f462fe None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:18:32.706363 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185ecde5-075f-447b-ad0c-db1638f462fe None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:18:32.706628 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185ecde5-075f-447b-ad0c-db1638f462fe None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:18:32.716281 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185ecde5-075f-447b-ad0c-db1638f462fe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 02:18:32.721540 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application [None req-185ecde5-075f-447b-ad0c-db1638f462fe None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 12 02:18:32.721540 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 02:18:32.721540 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 02:18:32.721540 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 02:18:32.721540 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 02:18:32.721540 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 02:18:32.721540 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 02:18:32.721540 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 02:18:32.721540 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 02:18:32.721540 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 02:18:32.721540 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 02:18:32.721540 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 02:18:32.721540 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 12 02:18:32.721540 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 12 02:18:32.721540 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 12 02:18:32.721540 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 12 02:18:32.722659 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 12 02:18:32.722659 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 12 02:18:32.722659 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 12 02:18:32.722659 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 12 02:18:32.722659 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 02:18:32.722659 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 02:18:32.722659 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 02:18:32.722659 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 02:18:32.722659 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 02:18:32.722659 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 02:18:32.722659 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 02:18:32.722659 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application with Lock( Oct 12 02:18:32.722659 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 02:18:32.722659 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._enter() Oct 12 02:18:32.722659 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 02:18:32.722659 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 02:18:32.723866 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 02:18:32.723866 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.creator() Oct 12 02:18:32.723866 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 02:18:32.723866 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application created_value = creator( Oct 12 02:18:32.723866 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 12 02:18:32.723866 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 12 02:18:32.723866 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 12 02:18:32.723866 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 12 02:18:32.723866 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 12 02:18:32.723866 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 12 02:18:32.723866 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 12 02:18:32.723866 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Oct 12 02:18:32.723866 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 437/874] 10.222.0.18 () {56 vars in 1096 bytes} [Wed Oct 12 02:18:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 02:18:32.728581 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bca9da-f914-436d-b761-25ee6ed96e27 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:18:32.760306 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:18:32.823743 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bca9da-f914-436d-b761-25ee6ed96e27 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:18:32.857493 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2312428-1980-4f1e-afaf-9ab4bd406b56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:18:32.858079 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2312428-1980-4f1e-afaf-9ab4bd406b56 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:18:32.858350 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2312428-1980-4f1e-afaf-9ab4bd406b56 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:18:32.858613 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2312428-1980-4f1e-afaf-9ab4bd406b56 None admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:18:32.859287 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2312428-1980-4f1e-afaf-9ab4bd406b56 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 02:18:32.859580 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2312428-1980-4f1e-afaf-9ab4bd406b56 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:18:32.860945 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2312428-1980-4f1e-afaf-9ab4bd406b56 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:18:32.868857 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 438/875] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Oct 12 02:18:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 02:18:32.874673 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185ecde5-075f-447b-ad0c-db1638f462fe None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:18:32.958560 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:18:32.971489 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185ecde5-075f-447b-ad0c-db1638f462fe None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:18:33.005121 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa1744a-782f-42b6-b0c5-5a911d055771 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:18:33.005737 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa1744a-782f-42b6-b0c5-5a911d055771 None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:18:33.006014 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa1744a-782f-42b6-b0c5-5a911d055771 None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:18:33.006284 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa1744a-782f-42b6-b0c5-5a911d055771 None admin] PATH_INFO: `/v3/users/c0490b6ac72b4b0eb02370b034c97ce6` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:18:33.007378 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa1744a-782f-42b6-b0c5-5a911d055771 None admin] RBAC: Authorizing `identity:get_user(user_id=c0490b6ac72b4b0eb02370b034c97ce6)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:18:33.008817 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa1744a-782f-42b6-b0c5-5a911d055771 None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:18:33.010372 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 438/876] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Oct 12 02:18:32 2022] GET /identity/v3/users/c0490b6ac72b4b0eb02370b034c97ce6 => generated 286 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 02:18:33.017179 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2312428-1980-4f1e-afaf-9ab4bd406b56 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:18:33.108510 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:18:33.114917 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2312428-1980-4f1e-afaf-9ab4bd406b56 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:18:33.147961 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50644cd2-9ede-4b9f-969b-782ee6d2b1f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:18:33.148584 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50644cd2-9ede-4b9f-969b-782ee6d2b1f5 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:18:33.148862 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50644cd2-9ede-4b9f-969b-782ee6d2b1f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:18:33.149129 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50644cd2-9ede-4b9f-969b-782ee6d2b1f5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:18:33.212988 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50644cd2-9ede-4b9f-969b-782ee6d2b1f5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:18:33.214410 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50644cd2-9ede-4b9f-969b-782ee6d2b1f5 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:18:33.301557 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:18:33.308177 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 439/877] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Oct 12 02:18:33 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Oct 12 02:18:33.314847 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa1744a-782f-42b6-b0c5-5a911d055771 None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:18:33.411305 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa1744a-782f-42b6-b0c5-5a911d055771 None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:18:33.444668 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0688bb-cbf3-459a-a3d7-7842d67dbe84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:18:33.445280 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0688bb-cbf3-459a-a3d7-7842d67dbe84 None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:18:33.445566 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0688bb-cbf3-459a-a3d7-7842d67dbe84 None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:18:33.445838 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0688bb-cbf3-459a-a3d7-7842d67dbe84 None admin] PATH_INFO: `/v3/projects/00a6b66beb294d4289d1177e39fc30ce` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:18:33.446937 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0688bb-cbf3-459a-a3d7-7842d67dbe84 None admin] RBAC: Authorizing `identity:get_project(project_id=00a6b66beb294d4289d1177e39fc30ce)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:18:33.448362 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0688bb-cbf3-459a-a3d7-7842d67dbe84 None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:18:33.449989 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 439/878] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Oct 12 02:18:33 2022] GET /identity/v3/projects/00a6b66beb294d4289d1177e39fc30ce => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 02:18:33.456170 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50644cd2-9ede-4b9f-969b-782ee6d2b1f5 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:18:33.551902 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50644cd2-9ede-4b9f-969b-782ee6d2b1f5 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:18:33.584769 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c5af2f-c721-4def-96bb-784cb193cb5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:18:33.585368 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c5af2f-c721-4def-96bb-784cb193cb5b None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:18:33.585647 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c5af2f-c721-4def-96bb-784cb193cb5b None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:18:33.585919 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c5af2f-c721-4def-96bb-784cb193cb5b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:18:33.586643 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c5af2f-c721-4def-96bb-784cb193cb5b None admin] RBAC: Adding query filter params (role.id=39b1e8108dff402383def3c559f48189, scope.project.id=00a6b66beb294d4289d1177e39fc30ce, user.id=c0490b6ac72b4b0eb02370b034c97ce6) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 02:18:33.586950 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c5af2f-c721-4def-96bb-784cb193cb5b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:18:33.588368 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c5af2f-c721-4def-96bb-784cb193cb5b None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:18:33.594174 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 440/879] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Oct 12 02:18:33 2022] GET /identity/v3/role_assignments?user.id=c0490b6ac72b4b0eb02370b034c97ce6&scope.project.id=00a6b66beb294d4289d1177e39fc30ce&role.id=39b1e8108dff402383def3c559f48189 => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 02:18:35.720620 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59469f32-b25e-4195-8efb-1b6b10764240 None None] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:18:35.721175 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59469f32-b25e-4195-8efb-1b6b10764240 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:18:35.721175 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59469f32-b25e-4195-8efb-1b6b10764240 None None] PATH_INFO: `/` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:18:35.722485 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 440/880] 10.222.0.18 () {54 vars in 927 bytes} [Wed Oct 12 02:18:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 02:18:35.727760 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fe1816-4a1e-4fbe-8c8d-57a2b8a94507 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:18:35.728180 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fe1816-4a1e-4fbe-8c8d-57a2b8a94507 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:18:35.728284 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fe1816-4a1e-4fbe-8c8d-57a2b8a94507 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:18:35.746843 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-12fe1816-4a1e-4fbe-8c8d-57a2b8a94507 None None] MFA Rules not processed for user `a326a5bb7364479382f528a592371656`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:18:35.748031 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-12fe1816-4a1e-4fbe-8c8d-57a2b8a94507 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:18:35.802270 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:18:35.813919 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 441/881] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Oct 12 02:18:35 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 12 02:18:36.086229 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59469f32-b25e-4195-8efb-1b6b10764240 None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:18:36.112161 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:18:36.187917 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59469f32-b25e-4195-8efb-1b6b10764240 None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:18:36.220462 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45c8f97-e0cf-4002-8b1c-ecb54548c522 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:18:36.221070 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45c8f97-e0cf-4002-8b1c-ecb54548c522 None admin] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:18:36.221346 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45c8f97-e0cf-4002-8b1c-ecb54548c522 None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:18:36.221618 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45c8f97-e0cf-4002-8b1c-ecb54548c522 None admin] PATH_INFO: `/v3/domains` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:18:36.222282 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45c8f97-e0cf-4002-8b1c-ecb54548c522 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:18:36.223628 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45c8f97-e0cf-4002-8b1c-ecb54548c522 None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:18:36.239183 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 441/882] 10.222.0.18 () {60 vars in 1138 bytes} [Wed Oct 12 02:18:36 2022] POST /identity/v3/domains => generated 267 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 02:18:38.396591 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe464634-2dd7-4659-875f-f77887fac893 None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:18:38.397255 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe464634-2dd7-4659-875f-f77887fac893 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:18:38.397255 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe464634-2dd7-4659-875f-f77887fac893 None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:18:38.398453 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 442/883] 10.222.0.18 () {54 vars in 927 bytes} [Wed Oct 12 02:18:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 02:18:38.403600 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea78029-6d71-4419-9795-6bf1206fe57a None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:18:38.404028 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea78029-6d71-4419-9795-6bf1206fe57a None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:18:38.404152 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea78029-6d71-4419-9795-6bf1206fe57a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:18:38.424177 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-8ea78029-6d71-4419-9795-6bf1206fe57a None None] MFA Rules not processed for user `a326a5bb7364479382f528a592371656`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:18:38.425401 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-8ea78029-6d71-4419-9795-6bf1206fe57a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:18:38.489530 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 442/884] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Oct 12 02:18:38 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 12 02:18:38.761069 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe464634-2dd7-4659-875f-f77887fac893 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:18:38.859438 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe464634-2dd7-4659-875f-f77887fac893 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:18:38.891982 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ba8c8e-ff24-4b59-ad4f-8db0d21c1696 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:18:38.892623 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ba8c8e-ff24-4b59-ad4f-8db0d21c1696 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:18:38.892900 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ba8c8e-ff24-4b59-ad4f-8db0d21c1696 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:18:38.893168 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ba8c8e-ff24-4b59-ad4f-8db0d21c1696 None admin] PATH_INFO: `/v3/domains/6a19fb7aaf694bcc9881ac7cfa53a093` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:18:38.904056 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ba8c8e-ff24-4b59-ad4f-8db0d21c1696 None admin] RBAC: Authorizing `identity:get_domain(domain_id=6a19fb7aaf694bcc9881ac7cfa53a093)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:18:38.906114 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ba8c8e-ff24-4b59-ad4f-8db0d21c1696 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:18:38.907658 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 443/885] 10.222.0.18 () {56 vars in 1183 bytes} [Wed Oct 12 02:18:38 2022] GET /identity/v3/domains/6a19fb7aaf694bcc9881ac7cfa53a093 => generated 267 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 02:18:38.913410 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea78029-6d71-4419-9795-6bf1206fe57a None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:18:38.927801 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:18:39.010857 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea78029-6d71-4419-9795-6bf1206fe57a None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:18:39.043522 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d610043b-2270-42d8-a00c-b038615d29e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:18:39.044065 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d610043b-2270-42d8-a00c-b038615d29e1 None admin] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:18:39.044343 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d610043b-2270-42d8-a00c-b038615d29e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:18:39.044646 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d610043b-2270-42d8-a00c-b038615d29e1 None admin] PATH_INFO: `/v3/projects` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:18:39.045289 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d610043b-2270-42d8-a00c-b038615d29e1 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:18:39.047019 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d610043b-2270-42d8-a00c-b038615d29e1 None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:18:39.072592 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 443/886] 10.222.0.18 () {60 vars in 1141 bytes} [Wed Oct 12 02:18:38 2022] POST /identity/v3/projects => generated 361 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 02:18:41.210088 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ac6655-66b9-4ad9-85d6-cf0e5ebf3362 None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:18:41.210644 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ac6655-66b9-4ad9-85d6-cf0e5ebf3362 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:18:41.210644 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ac6655-66b9-4ad9-85d6-cf0e5ebf3362 None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:18:41.211935 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 444/887] 10.222.0.18 () {54 vars in 927 bytes} [Wed Oct 12 02:18:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 02:18:41.217202 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00effec-f7b0-4962-a2f4-b098eb6b7a94 None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:18:41.217579 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00effec-f7b0-4962-a2f4-b098eb6b7a94 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:18:41.217946 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00effec-f7b0-4962-a2f4-b098eb6b7a94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:18:41.236353 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-b00effec-f7b0-4962-a2f4-b098eb6b7a94 None None] MFA Rules not processed for user `a326a5bb7364479382f528a592371656`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:18:41.237811 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-b00effec-f7b0-4962-a2f4-b098eb6b7a94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:18:41.294809 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:18:41.303277 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 444/888] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Oct 12 02:18:41 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 12 02:18:41.573962 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ac6655-66b9-4ad9-85d6-cf0e5ebf3362 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:18:41.623737 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:18:41.672807 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ac6655-66b9-4ad9-85d6-cf0e5ebf3362 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:18:41.704601 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aafcb39-d900-4744-acc1-b04feec5a73b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:18:41.705204 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aafcb39-d900-4744-acc1-b04feec5a73b None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:18:41.705478 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aafcb39-d900-4744-acc1-b04feec5a73b None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:18:41.705745 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aafcb39-d900-4744-acc1-b04feec5a73b None admin] PATH_INFO: `/v3/domains/6a19fb7aaf694bcc9881ac7cfa53a093` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:18:41.706828 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aafcb39-d900-4744-acc1-b04feec5a73b None admin] RBAC: Authorizing `identity:get_domain(domain_id=6a19fb7aaf694bcc9881ac7cfa53a093)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:18:41.708230 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aafcb39-d900-4744-acc1-b04feec5a73b None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:18:41.709774 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 445/889] 10.222.0.18 () {56 vars in 1183 bytes} [Wed Oct 12 02:18:41 2022] GET /identity/v3/domains/6a19fb7aaf694bcc9881ac7cfa53a093 => generated 267 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 02:18:41.715479 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00effec-f7b0-4962-a2f4-b098eb6b7a94 None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:18:41.812809 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00effec-f7b0-4962-a2f4-b098eb6b7a94 None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:18:41.845309 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb05a1c2-7730-4e89-a628-9ec0bf2f54ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:18:41.845899 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb05a1c2-7730-4e89-a628-9ec0bf2f54ed None admin] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:18:41.846178 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb05a1c2-7730-4e89-a628-9ec0bf2f54ed None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:18:41.846450 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb05a1c2-7730-4e89-a628-9ec0bf2f54ed None admin] PATH_INFO: `/v3/users` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:18:41.847100 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb05a1c2-7730-4e89-a628-9ec0bf2f54ed None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:18:41.848544 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb05a1c2-7730-4e89-a628-9ec0bf2f54ed None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:18:41.870403 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 445/890] 10.222.0.18 () {60 vars in 1132 bytes} [Wed Oct 12 02:18:41 2022] POST /identity/v3/users => generated 311 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 02:18:44.045406 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d73e55-aad1-4826-9510-4aca26145f42 None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:18:44.045939 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d73e55-aad1-4826-9510-4aca26145f42 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:18:44.045939 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d73e55-aad1-4826-9510-4aca26145f42 None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:18:44.047389 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 446/891] 10.222.0.18 () {54 vars in 927 bytes} [Wed Oct 12 02:18:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 02:18:44.052445 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a450dd-974a-47f8-a55e-5757e72e0cdf None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:18:44.052877 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a450dd-974a-47f8-a55e-5757e72e0cdf None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:18:44.053023 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a450dd-974a-47f8-a55e-5757e72e0cdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:18:44.070667 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-70a450dd-974a-47f8-a55e-5757e72e0cdf None None] MFA Rules not processed for user `a326a5bb7364479382f528a592371656`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:18:44.071852 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-70a450dd-974a-47f8-a55e-5757e72e0cdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:18:44.117484 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:18:44.137322 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 446/892] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Oct 12 02:18:44 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 12 02:18:44.405340 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d73e55-aad1-4826-9510-4aca26145f42 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:18:44.503769 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d73e55-aad1-4826-9510-4aca26145f42 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:18:44.519878 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:18:44.537383 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e604f5d-05d0-4df2-8322-d3c2a2e28c10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:18:44.538008 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e604f5d-05d0-4df2-8322-d3c2a2e28c10 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:18:44.538281 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e604f5d-05d0-4df2-8322-d3c2a2e28c10 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:18:44.539026 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e604f5d-05d0-4df2-8322-d3c2a2e28c10 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:18:44.549511 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e604f5d-05d0-4df2-8322-d3c2a2e28c10 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 02:18:44.554192 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-4e604f5d-05d0-4df2-8322-d3c2a2e28c10 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 12 02:18:44.554192 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 02:18:44.554192 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 02:18:44.554192 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 02:18:44.554192 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 02:18:44.554192 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 02:18:44.554192 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 02:18:44.554192 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 02:18:44.554192 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 02:18:44.554192 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 02:18:44.554192 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 02:18:44.554192 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 02:18:44.554192 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 12 02:18:44.554192 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 12 02:18:44.554192 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 12 02:18:44.554192 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 12 02:18:44.555355 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 12 02:18:44.555355 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 12 02:18:44.555355 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 12 02:18:44.555355 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 12 02:18:44.555355 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 02:18:44.555355 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 02:18:44.555355 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 02:18:44.555355 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 02:18:44.555355 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 02:18:44.555355 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 02:18:44.555355 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 02:18:44.555355 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Oct 12 02:18:44.555355 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 02:18:44.555355 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Oct 12 02:18:44.555355 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 02:18:44.555355 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 02:18:44.556591 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 02:18:44.556591 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Oct 12 02:18:44.556591 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 02:18:44.556591 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Oct 12 02:18:44.556591 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 12 02:18:44.556591 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 12 02:18:44.556591 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 12 02:18:44.556591 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 12 02:18:44.556591 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 12 02:18:44.556591 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 12 02:18:44.556591 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 12 02:18:44.556591 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Oct 12 02:18:44.556591 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 447/893] 10.222.0.18 () {56 vars in 1096 bytes} [Wed Oct 12 02:18:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 02:18:44.561417 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a450dd-974a-47f8-a55e-5757e72e0cdf None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:18:44.656511 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a450dd-974a-47f8-a55e-5757e72e0cdf None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:18:44.688359 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e59b6e3-fd26-4ad5-8aa9-df5b97986d3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:18:44.688979 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e59b6e3-fd26-4ad5-8aa9-df5b97986d3a None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:18:44.689254 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e59b6e3-fd26-4ad5-8aa9-df5b97986d3a None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:18:44.689522 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e59b6e3-fd26-4ad5-8aa9-df5b97986d3a None admin] PATH_INFO: `/v3/roles` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:18:44.690168 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e59b6e3-fd26-4ad5-8aa9-df5b97986d3a None admin] RBAC: Adding query filter params (name=admin) {{(pid=81361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 02:18:44.690464 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e59b6e3-fd26-4ad5-8aa9-df5b97986d3a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:18:44.691812 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e59b6e3-fd26-4ad5-8aa9-df5b97986d3a None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:18:44.699464 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 447/894] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Oct 12 02:18:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 02:18:44.706345 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e604f5d-05d0-4df2-8322-d3c2a2e28c10 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:18:44.802190 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e604f5d-05d0-4df2-8322-d3c2a2e28c10 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:18:44.834269 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9486765-a8d0-4847-8306-eae86100962f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:18:44.834878 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9486765-a8d0-4847-8306-eae86100962f None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:18:44.835154 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9486765-a8d0-4847-8306-eae86100962f None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:18:44.835422 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9486765-a8d0-4847-8306-eae86100962f None admin] PATH_INFO: `/v3/users/474c8b5c0b064de198cd5277c70c1c4c` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:18:44.848697 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9486765-a8d0-4847-8306-eae86100962f None admin] RBAC: Authorizing `identity:get_user(user_id=474c8b5c0b064de198cd5277c70c1c4c)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:18:44.850106 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9486765-a8d0-4847-8306-eae86100962f None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:18:44.851656 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 448/895] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Oct 12 02:18:44 2022] GET /identity/v3/users/474c8b5c0b064de198cd5277c70c1c4c => generated 311 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 02:18:44.857241 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e59b6e3-fd26-4ad5-8aa9-df5b97986d3a None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:18:44.901450 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:18:44.954434 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e59b6e3-fd26-4ad5-8aa9-df5b97986d3a None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:18:44.986300 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504f06be-d3fe-447f-bc9a-0d5619e8b79e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:18:44.986906 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504f06be-d3fe-447f-bc9a-0d5619e8b79e None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:18:44.987445 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504f06be-d3fe-447f-bc9a-0d5619e8b79e None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:18:44.987715 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504f06be-d3fe-447f-bc9a-0d5619e8b79e None admin] PATH_INFO: `/v3/projects/c9c1e720bd3649058c58a97ffb9a9777` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:18:44.988827 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504f06be-d3fe-447f-bc9a-0d5619e8b79e None admin] RBAC: Authorizing `identity:get_project(project_id=c9c1e720bd3649058c58a97ffb9a9777)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:18:44.990242 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504f06be-d3fe-447f-bc9a-0d5619e8b79e None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:18:44.991818 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 448/896] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Oct 12 02:18:44 2022] GET /identity/v3/projects/c9c1e720bd3649058c58a97ffb9a9777 => generated 361 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 02:18:44.997603 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9486765-a8d0-4847-8306-eae86100962f None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:18:45.032633 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:18:45.095145 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9486765-a8d0-4847-8306-eae86100962f None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:18:45.127943 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf9a772-7801-4919-bc34-e8db89dc54b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:18:45.128618 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf9a772-7801-4919-bc34-e8db89dc54b5 None admin] REQUEST_METHOD: `PUT` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:18:45.128898 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf9a772-7801-4919-bc34-e8db89dc54b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:18:45.129172 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf9a772-7801-4919-bc34-e8db89dc54b5 None admin] PATH_INFO: `/v3/projects/c9c1e720bd3649058c58a97ffb9a9777/users/474c8b5c0b064de198cd5277c70c1c4c/roles/39b1e8108dff402383def3c559f48189` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:18:45.131096 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf9a772-7801-4919-bc34-e8db89dc54b5 None admin] RBAC: Authorizing `identity:create_grant(project_id=c9c1e720bd3649058c58a97ffb9a9777, user_id=474c8b5c0b064de198cd5277c70c1c4c, role_id=39b1e8108dff402383def3c559f48189)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:18:45.132538 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf9a772-7801-4919-bc34-e8db89dc54b5 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:18:45.145175 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 449/897] 10.222.0.18 () {58 vars in 1439 bytes} [Wed Oct 12 02:18:44 2022] PUT /identity/v3/projects/c9c1e720bd3649058c58a97ffb9a9777/users/474c8b5c0b064de198cd5277c70c1c4c/roles/39b1e8108dff402383def3c559f48189 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 02:18:47.259302 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67d365c-6ef2-47a4-bcfe-21d2040f052f None None] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:18:47.259854 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67d365c-6ef2-47a4-bcfe-21d2040f052f None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:18:47.259854 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67d365c-6ef2-47a4-bcfe-21d2040f052f None None] PATH_INFO: `/` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:18:47.261219 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 449/898] 10.222.0.18 () {54 vars in 927 bytes} [Wed Oct 12 02:18:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 02:18:47.266629 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6de04c-8b86-4bd8-9a8a-4ea08587f914 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:18:47.267000 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6de04c-8b86-4bd8-9a8a-4ea08587f914 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:18:47.267171 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6de04c-8b86-4bd8-9a8a-4ea08587f914 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:18:47.286259 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-5c6de04c-8b86-4bd8-9a8a-4ea08587f914 None None] MFA Rules not processed for user `a326a5bb7364479382f528a592371656`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:18:47.287421 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-5c6de04c-8b86-4bd8-9a8a-4ea08587f914 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:18:47.351258 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 450/899] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Oct 12 02:18:47 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 12 02:18:47.617965 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67d365c-6ef2-47a4-bcfe-21d2040f052f None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:18:47.716757 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67d365c-6ef2-47a4-bcfe-21d2040f052f None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:18:47.729992 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:18:47.750956 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678535ac-05ae-4697-b0f8-25d8343d733f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:18:47.751572 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678535ac-05ae-4697-b0f8-25d8343d733f None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:18:47.751848 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678535ac-05ae-4697-b0f8-25d8343d733f None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:18:47.752118 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678535ac-05ae-4697-b0f8-25d8343d733f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:18:47.761800 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678535ac-05ae-4697-b0f8-25d8343d733f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 02:18:47.767135 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application [None req-678535ac-05ae-4697-b0f8-25d8343d733f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 12 02:18:47.767135 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 02:18:47.767135 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 02:18:47.767135 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 02:18:47.767135 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 02:18:47.767135 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 02:18:47.767135 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 02:18:47.767135 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 02:18:47.767135 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 02:18:47.767135 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 02:18:47.767135 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 02:18:47.767135 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 02:18:47.767135 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 12 02:18:47.767135 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 12 02:18:47.767135 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 12 02:18:47.767135 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 12 02:18:47.768273 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 12 02:18:47.768273 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 12 02:18:47.768273 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 12 02:18:47.768273 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 12 02:18:47.768273 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 02:18:47.768273 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 02:18:47.768273 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 02:18:47.768273 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 02:18:47.768273 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 02:18:47.768273 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 02:18:47.768273 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 02:18:47.768273 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application with Lock( Oct 12 02:18:47.768273 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 02:18:47.768273 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._enter() Oct 12 02:18:47.768273 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 02:18:47.768273 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 02:18:47.769189 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 02:18:47.769189 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.creator() Oct 12 02:18:47.769189 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 02:18:47.769189 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application created_value = creator( Oct 12 02:18:47.769189 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 12 02:18:47.769189 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 12 02:18:47.769189 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 12 02:18:47.769189 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 12 02:18:47.769189 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 12 02:18:47.769189 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 12 02:18:47.769189 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 12 02:18:47.769189 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Oct 12 02:18:47.769189 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 450/900] 10.222.0.18 () {56 vars in 1096 bytes} [Wed Oct 12 02:18:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 02:18:47.774289 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6de04c-8b86-4bd8-9a8a-4ea08587f914 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:18:47.800285 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:18:47.870499 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6de04c-8b86-4bd8-9a8a-4ea08587f914 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:18:47.902256 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0fd2c6-6dbf-4599-8d83-4c3eac751a0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:18:47.902845 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0fd2c6-6dbf-4599-8d83-4c3eac751a0e None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:18:47.903135 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0fd2c6-6dbf-4599-8d83-4c3eac751a0e None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:18:47.903383 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0fd2c6-6dbf-4599-8d83-4c3eac751a0e None admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:18:47.904026 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0fd2c6-6dbf-4599-8d83-4c3eac751a0e None admin] RBAC: Adding query filter params (name=admin) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 02:18:47.904324 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0fd2c6-6dbf-4599-8d83-4c3eac751a0e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:18:47.906308 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0fd2c6-6dbf-4599-8d83-4c3eac751a0e None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:18:47.913897 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 451/901] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Oct 12 02:18:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 02:18:47.919661 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678535ac-05ae-4697-b0f8-25d8343d733f None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:18:48.018363 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678535ac-05ae-4697-b0f8-25d8343d733f None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:18:48.050746 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39774f4a-06a0-465b-a6f6-d8b3ff462c9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:18:48.051297 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39774f4a-06a0-465b-a6f6-d8b3ff462c9e None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:18:48.051572 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39774f4a-06a0-465b-a6f6-d8b3ff462c9e None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:18:48.051841 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39774f4a-06a0-465b-a6f6-d8b3ff462c9e None admin] PATH_INFO: `/v3/users/474c8b5c0b064de198cd5277c70c1c4c` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:18:48.053028 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39774f4a-06a0-465b-a6f6-d8b3ff462c9e None admin] RBAC: Authorizing `identity:get_user(user_id=474c8b5c0b064de198cd5277c70c1c4c)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:18:48.054447 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39774f4a-06a0-465b-a6f6-d8b3ff462c9e None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:18:48.055997 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 451/902] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Oct 12 02:18:47 2022] GET /identity/v3/users/474c8b5c0b064de198cd5277c70c1c4c => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 02:18:48.062174 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0fd2c6-6dbf-4599-8d83-4c3eac751a0e None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:18:48.147970 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:18:48.160103 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0fd2c6-6dbf-4599-8d83-4c3eac751a0e None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:18:48.192149 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236ae278-60ff-4453-9bad-84efe7196c31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:18:48.192773 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236ae278-60ff-4453-9bad-84efe7196c31 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:18:48.193049 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236ae278-60ff-4453-9bad-84efe7196c31 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:18:48.193318 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236ae278-60ff-4453-9bad-84efe7196c31 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:18:48.258928 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236ae278-60ff-4453-9bad-84efe7196c31 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:18:48.260354 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236ae278-60ff-4453-9bad-84efe7196c31 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:18:48.343699 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:18:48.356070 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 452/903] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Oct 12 02:18:48 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 12 02:18:48.362863 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39774f4a-06a0-465b-a6f6-d8b3ff462c9e None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:18:48.403695 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:18:48.460364 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39774f4a-06a0-465b-a6f6-d8b3ff462c9e None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:18:48.493590 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e5e6d3-108a-4fe5-9f65-e60dc68f5578 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:18:48.494209 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e5e6d3-108a-4fe5-9f65-e60dc68f5578 None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:18:48.494488 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e5e6d3-108a-4fe5-9f65-e60dc68f5578 None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:18:48.494762 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e5e6d3-108a-4fe5-9f65-e60dc68f5578 None admin] PATH_INFO: `/v3/projects/c9c1e720bd3649058c58a97ffb9a9777` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:18:48.495855 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e5e6d3-108a-4fe5-9f65-e60dc68f5578 None admin] RBAC: Authorizing `identity:get_project(project_id=c9c1e720bd3649058c58a97ffb9a9777)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:18:48.497309 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e5e6d3-108a-4fe5-9f65-e60dc68f5578 None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:18:48.499528 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 452/904] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Oct 12 02:18:48 2022] GET /identity/v3/projects/c9c1e720bd3649058c58a97ffb9a9777 => generated 361 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 02:18:48.505652 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236ae278-60ff-4453-9bad-84efe7196c31 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:18:48.606039 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236ae278-60ff-4453-9bad-84efe7196c31 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:18:48.639866 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14f1539-63f6-4fce-81b5-b7294e078c5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:18:48.640480 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14f1539-63f6-4fce-81b5-b7294e078c5b None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:18:48.640788 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14f1539-63f6-4fce-81b5-b7294e078c5b None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:18:48.641057 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14f1539-63f6-4fce-81b5-b7294e078c5b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:18:48.641773 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14f1539-63f6-4fce-81b5-b7294e078c5b None admin] RBAC: Adding query filter params (role.id=39b1e8108dff402383def3c559f48189, scope.project.id=c9c1e720bd3649058c58a97ffb9a9777, user.id=474c8b5c0b064de198cd5277c70c1c4c) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 02:18:48.642078 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14f1539-63f6-4fce-81b5-b7294e078c5b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:18:48.643491 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14f1539-63f6-4fce-81b5-b7294e078c5b None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:18:48.649109 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 453/905] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Oct 12 02:18:48 2022] GET /identity/v3/role_assignments?user.id=474c8b5c0b064de198cd5277c70c1c4c&scope.project.id=c9c1e720bd3649058c58a97ffb9a9777&role.id=39b1e8108dff402383def3c559f48189 => generated 608 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 02:18:58.489422 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=46 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:18:58.646478 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=74 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:19:43.906232 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30c5745-1af6-475d-b5af-5f6db03107db None None] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:19:43.906845 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30c5745-1af6-475d-b5af-5f6db03107db None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:19:43.906845 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30c5745-1af6-475d-b5af-5f6db03107db None None] PATH_INFO: `/` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:19:43.908315 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 453/906] 10.222.0.18 () {54 vars in 927 bytes} [Wed Oct 12 02:19:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 02:19:43.915498 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b51dba3-ce39-43b8-952b-9bdc5d2d8a3c None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:19:43.916686 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b51dba3-ce39-43b8-952b-9bdc5d2d8a3c None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:19:43.916686 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b51dba3-ce39-43b8-952b-9bdc5d2d8a3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:19:43.939893 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-6b51dba3-ce39-43b8-952b-9bdc5d2d8a3c None None] MFA Rules not processed for user `a326a5bb7364479382f528a592371656`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:19:43.941222 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-6b51dba3-ce39-43b8-952b-9bdc5d2d8a3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:19:44.025925 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 454/907] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Oct 12 02:19:43 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 12 02:19:44.361951 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30c5745-1af6-475d-b5af-5f6db03107db None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:19:44.498161 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30c5745-1af6-475d-b5af-5f6db03107db None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:19:44.545174 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1e338f-74fc-4873-a9c7-8a5694366a1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:19:44.546395 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1e338f-74fc-4873-a9c7-8a5694366a1f None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:19:44.546843 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1e338f-74fc-4873-a9c7-8a5694366a1f None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:19:44.547267 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1e338f-74fc-4873-a9c7-8a5694366a1f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:19:44.560988 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1e338f-74fc-4873-a9c7-8a5694366a1f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:19:44.563020 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1e338f-74fc-4873-a9c7-8a5694366a1f None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:19:44.584439 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application [None req-2e1e338f-74fc-4873-a9c7-8a5694366a1f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 02:19:44.584439 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 02:19:44.584439 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 02:19:44.584439 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 02:19:44.584439 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 02:19:44.584439 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 02:19:44.584439 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 02:19:44.584439 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 02:19:44.584439 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 02:19:44.584439 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 02:19:44.584439 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 02:19:44.584439 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 02:19:44.584439 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 12 02:19:44.584439 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 12 02:19:44.584439 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 12 02:19:44.584439 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 12 02:19:44.585564 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 02:19:44.585564 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 02:19:44.585564 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 02:19:44.585564 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 02:19:44.585564 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 02:19:44.585564 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 02:19:44.585564 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 02:19:44.585564 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application with Lock( Oct 12 02:19:44.585564 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 02:19:44.585564 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._enter() Oct 12 02:19:44.585564 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 02:19:44.585564 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 02:19:44.585564 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 02:19:44.585564 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.creator() Oct 12 02:19:44.585564 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 02:19:44.585564 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application created_value = creator( Oct 12 02:19:44.585564 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 12 02:19:44.586553 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 12 02:19:44.586553 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 02:19:44.586553 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Oct 12 02:19:44.586553 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 454/908] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Oct 12 02:19:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 02:19:44.592998 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b51dba3-ce39-43b8-952b-9bdc5d2d8a3c None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:19:44.719779 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b51dba3-ce39-43b8-952b-9bdc5d2d8a3c None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:19:44.757450 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:19:44.767455 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26daa24-9f28-4be0-99a0-d267d1f7ad6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:19:44.768237 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26daa24-9f28-4be0-99a0-d267d1f7ad6e None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:19:44.768632 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26daa24-9f28-4be0-99a0-d267d1f7ad6e None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:19:44.769001 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26daa24-9f28-4be0-99a0-d267d1f7ad6e None admin] PATH_INFO: `/v3/domains` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:19:44.770291 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26daa24-9f28-4be0-99a0-d267d1f7ad6e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 02:19:44.770617 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26daa24-9f28-4be0-99a0-d267d1f7ad6e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:19:44.772240 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26daa24-9f28-4be0-99a0-d267d1f7ad6e None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:19:44.791824 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 455/909] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Oct 12 02:19:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 02:19:44.795163 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1e338f-74fc-4873-a9c7-8a5694366a1f None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:19:44.873534 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:19:44.938360 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1e338f-74fc-4873-a9c7-8a5694366a1f None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:19:44.995682 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb1f67e-0af9-46fd-9071-64f93356d619 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:19:44.995892 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb1f67e-0af9-46fd-9071-64f93356d619 None admin] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:19:44.996169 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb1f67e-0af9-46fd-9071-64f93356d619 None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:19:44.996438 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb1f67e-0af9-46fd-9071-64f93356d619 None admin] PATH_INFO: `/v3/users` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:19:44.997123 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb1f67e-0af9-46fd-9071-64f93356d619 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:19:44.998549 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb1f67e-0af9-46fd-9071-64f93356d619 None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:19:45.022548 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 455/910] 10.222.0.18 () {60 vars in 1132 bytes} [Wed Oct 12 02:19:44 2022] POST /identity/v3/users => generated 251 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 02:19:47.697950 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6991d79c-f3da-44dc-9590-da63983a2644 None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:19:47.697950 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6991d79c-f3da-44dc-9590-da63983a2644 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:19:47.697950 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6991d79c-f3da-44dc-9590-da63983a2644 None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:19:47.697950 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 456/911] 10.222.0.18 () {54 vars in 927 bytes} [Wed Oct 12 02:19:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 02:19:47.703576 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad9e2e4-0f24-4d9b-bac3-09d10556842b None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:19:47.704114 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad9e2e4-0f24-4d9b-bac3-09d10556842b None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:19:47.706938 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad9e2e4-0f24-4d9b-bac3-09d10556842b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:19:47.726908 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-cad9e2e4-0f24-4d9b-bac3-09d10556842b None None] MFA Rules not processed for user `a326a5bb7364479382f528a592371656`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:19:47.728679 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-cad9e2e4-0f24-4d9b-bac3-09d10556842b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:19:47.828107 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 456/912] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Oct 12 02:19:47 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 12 02:19:48.167329 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6991d79c-f3da-44dc-9590-da63983a2644 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:19:48.286936 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6991d79c-f3da-44dc-9590-da63983a2644 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:19:48.330626 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96d652d-da8e-4407-a0cc-a2c70027abbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:19:48.331253 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96d652d-da8e-4407-a0cc-a2c70027abbd None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:19:48.331532 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96d652d-da8e-4407-a0cc-a2c70027abbd None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:19:48.331796 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96d652d-da8e-4407-a0cc-a2c70027abbd None admin] PATH_INFO: `/v3/roles/service` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:19:48.343131 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96d652d-da8e-4407-a0cc-a2c70027abbd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 02:19:48.347903 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-b96d652d-da8e-4407-a0cc-a2c70027abbd None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 12 02:19:48.347903 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 02:19:48.347903 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 02:19:48.347903 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 02:19:48.347903 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 02:19:48.347903 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 02:19:48.347903 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 02:19:48.347903 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 02:19:48.347903 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 02:19:48.347903 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 02:19:48.347903 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 02:19:48.347903 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 02:19:48.347903 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 12 02:19:48.347903 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 12 02:19:48.347903 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 12 02:19:48.347903 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 12 02:19:48.349092 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 12 02:19:48.349092 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 12 02:19:48.349092 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 12 02:19:48.349092 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 12 02:19:48.349092 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 02:19:48.349092 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 02:19:48.349092 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 02:19:48.349092 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 02:19:48.349092 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 02:19:48.349092 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 02:19:48.349092 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 02:19:48.349092 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Oct 12 02:19:48.349092 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 02:19:48.349092 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Oct 12 02:19:48.349092 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 02:19:48.349092 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 02:19:48.349940 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 02:19:48.349940 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Oct 12 02:19:48.349940 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 02:19:48.349940 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Oct 12 02:19:48.349940 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 12 02:19:48.349940 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 12 02:19:48.349940 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 12 02:19:48.349940 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 12 02:19:48.349940 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 12 02:19:48.349940 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 12 02:19:48.349940 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 12 02:19:48.349940 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Oct 12 02:19:48.349940 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 457/913] 10.222.0.18 () {56 vars in 1102 bytes} [Wed Oct 12 02:19:48 2022] GET /identity/v3/roles/service => generated 85 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 02:19:48.356010 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad9e2e4-0f24-4d9b-bac3-09d10556842b None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:19:48.409053 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:19:48.477421 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad9e2e4-0f24-4d9b-bac3-09d10556842b None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:19:48.513606 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e295afd-231a-4d71-b392-699e8865d23c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:19:48.514706 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e295afd-231a-4d71-b392-699e8865d23c None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:19:48.514706 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e295afd-231a-4d71-b392-699e8865d23c None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:19:48.514969 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e295afd-231a-4d71-b392-699e8865d23c None admin] PATH_INFO: `/v3/roles` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:19:48.515675 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e295afd-231a-4d71-b392-699e8865d23c None admin] RBAC: Adding query filter params (name=service) {{(pid=81361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 02:19:48.516008 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e295afd-231a-4d71-b392-699e8865d23c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:19:48.517483 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e295afd-231a-4d71-b392-699e8865d23c None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:19:48.532145 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 457/914] 10.222.0.18 () {56 vars in 1103 bytes} [Wed Oct 12 02:19:48 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 02:19:48.533578 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96d652d-da8e-4407-a0cc-a2c70027abbd None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:19:48.594769 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:19:48.655605 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96d652d-da8e-4407-a0cc-a2c70027abbd None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:19:48.702245 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a6174e-446a-408e-90d2-a9c40b9236f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:19:48.703130 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a6174e-446a-408e-90d2-a9c40b9236f0 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:19:48.703426 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a6174e-446a-408e-90d2-a9c40b9236f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:19:48.703743 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a6174e-446a-408e-90d2-a9c40b9236f0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:19:48.718704 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a6174e-446a-408e-90d2-a9c40b9236f0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:19:48.718704 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a6174e-446a-408e-90d2-a9c40b9236f0 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:19:48.738901 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-f7a6174e-446a-408e-90d2-a9c40b9236f0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 02:19:48.738901 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 02:19:48.738901 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 02:19:48.738901 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 02:19:48.738901 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 02:19:48.738901 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 02:19:48.738901 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 02:19:48.738901 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 02:19:48.738901 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 02:19:48.738901 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 02:19:48.738901 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 02:19:48.738901 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 02:19:48.738901 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 12 02:19:48.738901 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 12 02:19:48.738901 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 12 02:19:48.738901 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 12 02:19:48.739927 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 02:19:48.739927 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 02:19:48.739927 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 02:19:48.739927 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 02:19:48.739927 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 02:19:48.739927 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 02:19:48.739927 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 02:19:48.739927 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Oct 12 02:19:48.739927 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 02:19:48.739927 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Oct 12 02:19:48.739927 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 02:19:48.739927 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 02:19:48.739927 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 02:19:48.739927 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Oct 12 02:19:48.739927 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 02:19:48.739927 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Oct 12 02:19:48.739927 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 12 02:19:48.740892 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 12 02:19:48.740892 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 02:19:48.740892 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Oct 12 02:19:48.740892 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 458/915] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Oct 12 02:19:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 02:19:48.749161 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e295afd-231a-4d71-b392-699e8865d23c None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:19:48.858874 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:19:48.863010 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e295afd-231a-4d71-b392-699e8865d23c None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:19:48.905187 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5526aab7-dcdb-420d-9432-d02d9c9c3422 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:19:48.905834 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5526aab7-dcdb-420d-9432-d02d9c9c3422 None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:19:48.906149 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5526aab7-dcdb-420d-9432-d02d9c9c3422 None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:19:48.906498 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5526aab7-dcdb-420d-9432-d02d9c9c3422 None admin] PATH_INFO: `/v3/domains` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:19:48.907201 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5526aab7-dcdb-420d-9432-d02d9c9c3422 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 02:19:48.907532 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5526aab7-dcdb-420d-9432-d02d9c9c3422 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:19:48.908941 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5526aab7-dcdb-420d-9432-d02d9c9c3422 None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:19:48.922074 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 458/916] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Oct 12 02:19:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 02:19:48.927812 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a6174e-446a-408e-90d2-a9c40b9236f0 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:19:49.049799 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a6174e-446a-408e-90d2-a9c40b9236f0 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:19:49.051879 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:19:49.095239 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59df4af-4794-486f-b3d2-b2aa6a25914f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:19:49.095903 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59df4af-4794-486f-b3d2-b2aa6a25914f None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:19:49.096222 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59df4af-4794-486f-b3d2-b2aa6a25914f None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:19:49.096544 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59df4af-4794-486f-b3d2-b2aa6a25914f None admin] PATH_INFO: `/v3/users/placement` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:19:49.106999 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59df4af-4794-486f-b3d2-b2aa6a25914f None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:19:49.108437 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59df4af-4794-486f-b3d2-b2aa6a25914f None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:19:49.121880 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-a59df4af-4794-486f-b3d2-b2aa6a25914f None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 12 02:19:49.121880 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 02:19:49.121880 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 02:19:49.121880 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 02:19:49.121880 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 02:19:49.121880 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 02:19:49.121880 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 02:19:49.121880 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 02:19:49.121880 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 02:19:49.121880 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 02:19:49.121880 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 02:19:49.121880 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 02:19:49.121880 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 12 02:19:49.121880 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 12 02:19:49.121880 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 12 02:19:49.121880 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 12 02:19:49.122960 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 02:19:49.122960 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 02:19:49.122960 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 12 02:19:49.122960 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 12 02:19:49.122960 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 12 02:19:49.122960 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 12 02:19:49.122960 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 02:19:49.122960 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 02:19:49.122960 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 02:19:49.122960 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 02:19:49.122960 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 02:19:49.122960 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Oct 12 02:19:49.122960 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 02:19:49.122960 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Oct 12 02:19:49.122960 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 02:19:49.122960 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 02:19:49.122960 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 02:19:49.122960 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Oct 12 02:19:49.130414 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 02:19:49.130414 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Oct 12 02:19:49.130414 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 12 02:19:49.130414 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 12 02:19:49.130414 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 12 02:19:49.130414 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 12 02:19:49.130414 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 12 02:19:49.130414 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 12 02:19:49.130414 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 12 02:19:49.130414 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Oct 12 02:19:49.130414 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 459/917] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Oct 12 02:19:48 2022] GET /identity/v3/users/placement => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 12 02:19:49.131052 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5526aab7-dcdb-420d-9432-d02d9c9c3422 None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:19:49.258359 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5526aab7-dcdb-420d-9432-d02d9c9c3422 None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:19:49.299602 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f2296f-fccc-4c6a-8961-9583140ffa2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:19:49.300337 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f2296f-fccc-4c6a-8961-9583140ffa2b None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:19:49.300686 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f2296f-fccc-4c6a-8961-9583140ffa2b None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:19:49.300898 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f2296f-fccc-4c6a-8961-9583140ffa2b None admin] PATH_INFO: `/v3/users` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:19:49.301691 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f2296f-fccc-4c6a-8961-9583140ffa2b None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 02:19:49.302055 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f2296f-fccc-4c6a-8961-9583140ffa2b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:19:49.304395 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f2296f-fccc-4c6a-8961-9583140ffa2b None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:19:49.323014 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 459/918] 10.222.0.18 () {56 vars in 1143 bytes} [Wed Oct 12 02:19:49 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 02:19:49.328624 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59df4af-4794-486f-b3d2-b2aa6a25914f None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:19:49.439236 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59df4af-4794-486f-b3d2-b2aa6a25914f None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:19:49.485850 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e159983-b0f5-4647-ac9b-8e02bc918650 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:19:49.487257 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e159983-b0f5-4647-ac9b-8e02bc918650 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:19:49.487721 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e159983-b0f5-4647-ac9b-8e02bc918650 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:19:49.487991 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e159983-b0f5-4647-ac9b-8e02bc918650 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:19:49.501506 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e159983-b0f5-4647-ac9b-8e02bc918650 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:19:49.502930 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e159983-b0f5-4647-ac9b-8e02bc918650 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:19:49.520020 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-0e159983-b0f5-4647-ac9b-8e02bc918650 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 02:19:49.520020 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 02:19:49.520020 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 02:19:49.520020 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 02:19:49.520020 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 02:19:49.520020 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 02:19:49.520020 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 02:19:49.520020 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 02:19:49.520020 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 02:19:49.520020 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 02:19:49.520020 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 02:19:49.520020 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 02:19:49.520020 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 12 02:19:49.520020 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 12 02:19:49.520020 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 12 02:19:49.520020 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 12 02:19:49.521061 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 02:19:49.521061 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 02:19:49.521061 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 02:19:49.521061 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 02:19:49.521061 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 02:19:49.521061 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 02:19:49.521061 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 02:19:49.521061 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Oct 12 02:19:49.521061 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 02:19:49.521061 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Oct 12 02:19:49.521061 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 02:19:49.521061 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 02:19:49.521061 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 02:19:49.521061 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Oct 12 02:19:49.521061 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 02:19:49.521061 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Oct 12 02:19:49.521061 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 12 02:19:49.521955 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 12 02:19:49.521955 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 02:19:49.521955 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Oct 12 02:19:49.521955 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 460/919] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Oct 12 02:19:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 02:19:49.528139 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f2296f-fccc-4c6a-8961-9583140ffa2b None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:19:49.549855 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:19:49.652846 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f2296f-fccc-4c6a-8961-9583140ffa2b None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:19:49.692822 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21a8ec4-e247-4bb8-b63b-6fee66295372 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:19:49.693440 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21a8ec4-e247-4bb8-b63b-6fee66295372 None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:19:49.693724 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21a8ec4-e247-4bb8-b63b-6fee66295372 None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:19:49.694001 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21a8ec4-e247-4bb8-b63b-6fee66295372 None admin] PATH_INFO: `/v3/domains` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:19:49.694656 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21a8ec4-e247-4bb8-b63b-6fee66295372 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 02:19:49.694960 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21a8ec4-e247-4bb8-b63b-6fee66295372 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:19:49.696362 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21a8ec4-e247-4bb8-b63b-6fee66295372 None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:19:49.710160 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 460/920] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Oct 12 02:19:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 02:19:49.716423 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e159983-b0f5-4647-ac9b-8e02bc918650 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:19:49.734906 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:19:49.832337 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e159983-b0f5-4647-ac9b-8e02bc918650 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:19:49.872300 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e61ab9e-c0e6-4f29-bf57-9bcf79847b6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:19:49.872965 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e61ab9e-c0e6-4f29-bf57-9bcf79847b6e None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:19:49.873244 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e61ab9e-c0e6-4f29-bf57-9bcf79847b6e None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:19:49.873507 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e61ab9e-c0e6-4f29-bf57-9bcf79847b6e None admin] PATH_INFO: `/v3/projects/service` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:19:49.881607 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e61ab9e-c0e6-4f29-bf57-9bcf79847b6e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:19:49.883044 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e61ab9e-c0e6-4f29-bf57-9bcf79847b6e None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:19:49.896644 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-9e61ab9e-c0e6-4f29-bf57-9bcf79847b6e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 12 02:19:49.896644 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 02:19:49.896644 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 02:19:49.896644 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 02:19:49.896644 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 02:19:49.896644 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 02:19:49.896644 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 02:19:49.896644 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 02:19:49.896644 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 02:19:49.896644 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 02:19:49.896644 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 02:19:49.896644 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 02:19:49.896644 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 12 02:19:49.896644 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 12 02:19:49.896644 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 12 02:19:49.897626 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 12 02:19:49.897626 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 02:19:49.897626 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 02:19:49.897626 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 02:19:49.897626 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 02:19:49.897626 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 02:19:49.897626 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 02:19:49.897626 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 02:19:49.897626 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Oct 12 02:19:49.897626 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 02:19:49.897626 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Oct 12 02:19:49.897626 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 02:19:49.897626 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 02:19:49.897626 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 02:19:49.897626 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Oct 12 02:19:49.897626 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 02:19:49.897626 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Oct 12 02:19:49.898562 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 12 02:19:49.898562 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 12 02:19:49.898562 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 12 02:19:49.898562 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 12 02:19:49.898562 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 12 02:19:49.898562 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 12 02:19:49.898562 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 12 02:19:49.898562 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Oct 12 02:19:49.904697 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21a8ec4-e247-4bb8-b63b-6fee66295372 None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:19:49.905168 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 461/921] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Oct 12 02:19:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 02:19:49.996177 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:19:50.020828 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21a8ec4-e247-4bb8-b63b-6fee66295372 None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:19:50.061853 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3193a235-d81c-4339-aa4a-3667d75e3a90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:19:50.062527 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3193a235-d81c-4339-aa4a-3667d75e3a90 None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:19:50.062858 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3193a235-d81c-4339-aa4a-3667d75e3a90 None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:19:50.063132 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3193a235-d81c-4339-aa4a-3667d75e3a90 None admin] PATH_INFO: `/v3/projects` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:19:50.063823 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3193a235-d81c-4339-aa4a-3667d75e3a90 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 02:19:50.064179 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3193a235-d81c-4339-aa4a-3667d75e3a90 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:19:50.067117 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3193a235-d81c-4339-aa4a-3667d75e3a90 None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:19:50.081913 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 461/922] 10.222.0.18 () {56 vars in 1148 bytes} [Wed Oct 12 02:19:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 02:19:50.088599 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e61ab9e-c0e6-4f29-bf57-9bcf79847b6e None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:19:50.193639 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:19:50.223734 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e61ab9e-c0e6-4f29-bf57-9bcf79847b6e None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:19:50.261819 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cfb377-1961-4055-adb6-2a4537ad24cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:19:50.262484 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cfb377-1961-4055-adb6-2a4537ad24cb None admin] REQUEST_METHOD: `PUT` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:19:50.262764 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cfb377-1961-4055-adb6-2a4537ad24cb None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:19:50.263039 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cfb377-1961-4055-adb6-2a4537ad24cb None admin] PATH_INFO: `/v3/projects/beb6def6fcad45959e56425bb8bff4d1/users/a58b9e0467c040638c3d43e3ac9c0495/roles/91634b0ac542413bb04e5ce92e66459d` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:19:50.278769 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9cfb377-1961-4055-adb6-2a4537ad24cb None admin] RBAC: Authorizing `identity:create_grant(project_id=beb6def6fcad45959e56425bb8bff4d1, user_id=a58b9e0467c040638c3d43e3ac9c0495, role_id=91634b0ac542413bb04e5ce92e66459d)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:19:50.280309 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9cfb377-1961-4055-adb6-2a4537ad24cb None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:19:50.293756 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 462/923] 10.222.0.18 () {58 vars in 1439 bytes} [Wed Oct 12 02:19:50 2022] PUT /identity/v3/projects/beb6def6fcad45959e56425bb8bff4d1/users/a58b9e0467c040638c3d43e3ac9c0495/roles/91634b0ac542413bb04e5ce92e66459d => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 02:19:52.497185 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776c2db7-9b09-4efd-b0c8-5cb7e5fe3f3e None None] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:19:52.497812 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776c2db7-9b09-4efd-b0c8-5cb7e5fe3f3e None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:19:52.497812 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776c2db7-9b09-4efd-b0c8-5cb7e5fe3f3e None None] PATH_INFO: `/` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:19:52.499131 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 462/924] 10.222.0.18 () {54 vars in 927 bytes} [Wed Oct 12 02:19:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 02:19:52.504334 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c66994-a21a-41ca-b0bb-e8a53ba7312a None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:19:52.504783 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c66994-a21a-41ca-b0bb-e8a53ba7312a None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:19:52.504947 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c66994-a21a-41ca-b0bb-e8a53ba7312a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:19:52.525452 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-d2c66994-a21a-41ca-b0bb-e8a53ba7312a None None] MFA Rules not processed for user `a326a5bb7364479382f528a592371656`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:19:52.526919 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-d2c66994-a21a-41ca-b0bb-e8a53ba7312a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:19:52.604351 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 463/925] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Oct 12 02:19:52 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 12 02:19:52.910841 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776c2db7-9b09-4efd-b0c8-5cb7e5fe3f3e None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:19:53.023893 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776c2db7-9b09-4efd-b0c8-5cb7e5fe3f3e None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:19:53.062332 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85da5d56-6b9c-4f72-b559-006527336cdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:19:53.062958 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85da5d56-6b9c-4f72-b559-006527336cdc None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:19:53.063238 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85da5d56-6b9c-4f72-b559-006527336cdc None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:19:53.063511 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85da5d56-6b9c-4f72-b559-006527336cdc None admin] PATH_INFO: `/v3/roles/service` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:19:53.071057 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:19:53.076108 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85da5d56-6b9c-4f72-b559-006527336cdc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 02:19:53.082216 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application [None req-85da5d56-6b9c-4f72-b559-006527336cdc None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 12 02:19:53.082216 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 02:19:53.082216 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 02:19:53.082216 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 02:19:53.082216 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 02:19:53.082216 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 02:19:53.082216 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 02:19:53.082216 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 02:19:53.082216 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 02:19:53.082216 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 02:19:53.082216 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 02:19:53.082216 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 02:19:53.082216 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 12 02:19:53.082216 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 12 02:19:53.082216 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 12 02:19:53.082216 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 12 02:19:53.083456 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 12 02:19:53.083456 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 12 02:19:53.083456 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 12 02:19:53.083456 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 12 02:19:53.083456 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 02:19:53.083456 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 02:19:53.083456 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 02:19:53.083456 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 02:19:53.083456 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 02:19:53.083456 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 02:19:53.083456 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 02:19:53.083456 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application with Lock( Oct 12 02:19:53.083456 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 02:19:53.083456 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._enter() Oct 12 02:19:53.083456 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 02:19:53.083456 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 02:19:53.084326 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 02:19:53.084326 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.creator() Oct 12 02:19:53.084326 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 02:19:53.084326 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application created_value = creator( Oct 12 02:19:53.084326 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 12 02:19:53.084326 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 12 02:19:53.084326 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 12 02:19:53.084326 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 12 02:19:53.084326 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 12 02:19:53.084326 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 12 02:19:53.084326 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 12 02:19:53.084326 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Oct 12 02:19:53.084326 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 463/926] 10.222.0.18 () {56 vars in 1102 bytes} [Wed Oct 12 02:19:52 2022] GET /identity/v3/roles/service => generated 85 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 02:19:53.090215 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c66994-a21a-41ca-b0bb-e8a53ba7312a None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:19:53.153113 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:19:53.204383 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c66994-a21a-41ca-b0bb-e8a53ba7312a None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:19:53.240144 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ba9d4d-f5ac-4bf1-8a02-e230f3cf001c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:19:53.240781 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ba9d4d-f5ac-4bf1-8a02-e230f3cf001c None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:19:53.241057 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ba9d4d-f5ac-4bf1-8a02-e230f3cf001c None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:19:53.241322 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ba9d4d-f5ac-4bf1-8a02-e230f3cf001c None admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:19:53.241977 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ba9d4d-f5ac-4bf1-8a02-e230f3cf001c None admin] RBAC: Adding query filter params (name=service) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 02:19:53.242269 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ba9d4d-f5ac-4bf1-8a02-e230f3cf001c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:19:53.244221 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ba9d4d-f5ac-4bf1-8a02-e230f3cf001c None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:19:53.252280 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 464/927] 10.222.0.18 () {56 vars in 1103 bytes} [Wed Oct 12 02:19:53 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 02:19:53.258492 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85da5d56-6b9c-4f72-b559-006527336cdc None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:19:53.368073 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85da5d56-6b9c-4f72-b559-006527336cdc None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:19:53.408501 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c2132e-2dd1-414f-9e03-a573bb1d103e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:19:53.409133 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c2132e-2dd1-414f-9e03-a573bb1d103e None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:19:53.409422 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c2132e-2dd1-414f-9e03-a573bb1d103e None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:19:53.409688 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c2132e-2dd1-414f-9e03-a573bb1d103e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:19:53.419959 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c2132e-2dd1-414f-9e03-a573bb1d103e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:19:53.421550 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c2132e-2dd1-414f-9e03-a573bb1d103e None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:19:53.437302 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application [None req-94c2132e-2dd1-414f-9e03-a573bb1d103e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 02:19:53.437302 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 02:19:53.437302 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 02:19:53.437302 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 02:19:53.437302 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 02:19:53.437302 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 02:19:53.437302 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 02:19:53.437302 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 02:19:53.437302 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 02:19:53.437302 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 02:19:53.437302 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 02:19:53.437302 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 02:19:53.437302 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 12 02:19:53.437302 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 12 02:19:53.437302 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 12 02:19:53.437302 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 12 02:19:53.438505 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 02:19:53.438505 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 02:19:53.438505 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 02:19:53.438505 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 02:19:53.438505 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 02:19:53.438505 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 02:19:53.438505 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 02:19:53.438505 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application with Lock( Oct 12 02:19:53.438505 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 02:19:53.438505 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._enter() Oct 12 02:19:53.438505 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 02:19:53.438505 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 02:19:53.438505 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 02:19:53.438505 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.creator() Oct 12 02:19:53.438505 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 02:19:53.438505 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application created_value = creator( Oct 12 02:19:53.438505 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 12 02:19:53.439414 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 12 02:19:53.439414 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 02:19:53.439414 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Oct 12 02:19:53.439414 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 464/928] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Oct 12 02:19:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 02:19:53.444370 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ba9d4d-f5ac-4bf1-8a02-e230f3cf001c None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:19:53.554888 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ba9d4d-f5ac-4bf1-8a02-e230f3cf001c None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:19:53.573291 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:19:53.593223 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a588843-dc85-468c-8f14-b089e625d454 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:19:53.594139 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a588843-dc85-468c-8f14-b089e625d454 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:19:53.594507 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a588843-dc85-468c-8f14-b089e625d454 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:19:53.594784 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a588843-dc85-468c-8f14-b089e625d454 None admin] PATH_INFO: `/v3/domains` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:19:53.595574 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a588843-dc85-468c-8f14-b089e625d454 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 02:19:53.595881 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a588843-dc85-468c-8f14-b089e625d454 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:19:53.597900 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a588843-dc85-468c-8f14-b089e625d454 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:19:53.613225 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 465/929] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Oct 12 02:19:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 02:19:53.619762 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c2132e-2dd1-414f-9e03-a573bb1d103e None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:19:53.679195 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:19:53.732791 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c2132e-2dd1-414f-9e03-a573bb1d103e None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:19:53.770566 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d0c6ff-bdcd-4056-8e84-cbcd23d6643d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:19:53.771191 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d0c6ff-bdcd-4056-8e84-cbcd23d6643d None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:19:53.771464 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d0c6ff-bdcd-4056-8e84-cbcd23d6643d None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:19:53.771730 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d0c6ff-bdcd-4056-8e84-cbcd23d6643d None admin] PATH_INFO: `/v3/users/placement` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:19:53.779559 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d0c6ff-bdcd-4056-8e84-cbcd23d6643d None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:19:53.781065 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d0c6ff-bdcd-4056-8e84-cbcd23d6643d None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:19:53.793566 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application [None req-d4d0c6ff-bdcd-4056-8e84-cbcd23d6643d None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 12 02:19:53.793566 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 02:19:53.793566 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 02:19:53.793566 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 02:19:53.793566 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 02:19:53.793566 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 02:19:53.793566 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 02:19:53.793566 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 02:19:53.793566 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 02:19:53.793566 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 02:19:53.793566 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 02:19:53.793566 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 02:19:53.793566 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 12 02:19:53.793566 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 12 02:19:53.793566 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 12 02:19:53.793566 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 12 02:19:53.794694 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 02:19:53.794694 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 02:19:53.794694 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 12 02:19:53.794694 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 12 02:19:53.794694 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 12 02:19:53.794694 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 12 02:19:53.794694 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 02:19:53.794694 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 02:19:53.794694 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 02:19:53.794694 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 02:19:53.794694 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 02:19:53.794694 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application with Lock( Oct 12 02:19:53.794694 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 02:19:53.794694 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._enter() Oct 12 02:19:53.794694 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 02:19:53.794694 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 02:19:53.794694 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 02:19:53.794694 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.creator() Oct 12 02:19:53.795957 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 02:19:53.795957 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application created_value = creator( Oct 12 02:19:53.795957 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 12 02:19:53.795957 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 12 02:19:53.795957 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 12 02:19:53.795957 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 12 02:19:53.795957 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 12 02:19:53.795957 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 12 02:19:53.795957 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 12 02:19:53.795957 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Oct 12 02:19:53.795957 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 465/930] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Oct 12 02:19:53 2022] GET /identity/v3/users/placement => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 02:19:53.800770 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a588843-dc85-468c-8f14-b089e625d454 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:19:53.913646 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a588843-dc85-468c-8f14-b089e625d454 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:19:53.947885 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78ba484-5eff-4310-9aa0-3803f0268f07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:19:53.948513 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78ba484-5eff-4310-9aa0-3803f0268f07 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:19:53.948790 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78ba484-5eff-4310-9aa0-3803f0268f07 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:19:53.949064 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78ba484-5eff-4310-9aa0-3803f0268f07 None admin] PATH_INFO: `/v3/users` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:19:53.950026 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78ba484-5eff-4310-9aa0-3803f0268f07 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 02:19:53.950389 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78ba484-5eff-4310-9aa0-3803f0268f07 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:19:53.951969 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78ba484-5eff-4310-9aa0-3803f0268f07 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:19:53.972298 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 466/931] 10.222.0.18 () {56 vars in 1143 bytes} [Wed Oct 12 02:19:53 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 02:19:53.978930 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d0c6ff-bdcd-4056-8e84-cbcd23d6643d None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:19:54.085770 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d0c6ff-bdcd-4056-8e84-cbcd23d6643d None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:19:54.098275 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:19:54.125680 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289ccd5e-a67f-4028-99cb-12ad9b9e17d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:19:54.126288 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289ccd5e-a67f-4028-99cb-12ad9b9e17d5 None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:19:54.126562 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289ccd5e-a67f-4028-99cb-12ad9b9e17d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:19:54.126832 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289ccd5e-a67f-4028-99cb-12ad9b9e17d5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:19:54.202649 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289ccd5e-a67f-4028-99cb-12ad9b9e17d5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:19:54.204100 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289ccd5e-a67f-4028-99cb-12ad9b9e17d5 None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:19:54.315871 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 466/932] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Oct 12 02:19:53 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Oct 12 02:19:54.322972 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78ba484-5eff-4310-9aa0-3803f0268f07 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:19:54.358778 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:19:54.432746 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78ba484-5eff-4310-9aa0-3803f0268f07 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:19:54.469528 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443b9d9d-2e99-4df7-98e9-0632c395471f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:19:54.470136 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443b9d9d-2e99-4df7-98e9-0632c395471f None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:19:54.470415 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443b9d9d-2e99-4df7-98e9-0632c395471f None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:19:54.470684 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443b9d9d-2e99-4df7-98e9-0632c395471f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:19:54.482078 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443b9d9d-2e99-4df7-98e9-0632c395471f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:19:54.483513 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443b9d9d-2e99-4df7-98e9-0632c395471f None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:19:54.499093 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-443b9d9d-2e99-4df7-98e9-0632c395471f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 02:19:54.499093 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 02:19:54.499093 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 02:19:54.499093 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 02:19:54.499093 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 02:19:54.499093 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 02:19:54.499093 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 02:19:54.499093 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 02:19:54.499093 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 02:19:54.499093 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 02:19:54.499093 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 02:19:54.499093 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 02:19:54.499093 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 12 02:19:54.499093 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 12 02:19:54.499093 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 12 02:19:54.499093 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 12 02:19:54.500249 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 02:19:54.500249 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 02:19:54.500249 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 02:19:54.500249 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 02:19:54.500249 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 02:19:54.500249 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 02:19:54.500249 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 02:19:54.500249 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Oct 12 02:19:54.500249 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 02:19:54.500249 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Oct 12 02:19:54.500249 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 02:19:54.500249 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 02:19:54.500249 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 02:19:54.500249 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Oct 12 02:19:54.500249 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 02:19:54.500249 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Oct 12 02:19:54.500249 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 12 02:19:54.501513 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 12 02:19:54.501513 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 02:19:54.501513 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Oct 12 02:19:54.501513 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 467/933] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Oct 12 02:19:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 02:19:54.505906 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289ccd5e-a67f-4028-99cb-12ad9b9e17d5 None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:19:54.518757 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:19:54.610849 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289ccd5e-a67f-4028-99cb-12ad9b9e17d5 None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:19:54.645400 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb17b83-c773-4c70-b4b6-9e93e82d14a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:19:54.646316 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb17b83-c773-4c70-b4b6-9e93e82d14a5 None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:19:54.646316 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb17b83-c773-4c70-b4b6-9e93e82d14a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:19:54.646554 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb17b83-c773-4c70-b4b6-9e93e82d14a5 None admin] PATH_INFO: `/v3/domains` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:19:54.647175 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb17b83-c773-4c70-b4b6-9e93e82d14a5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 02:19:54.647461 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb17b83-c773-4c70-b4b6-9e93e82d14a5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:19:54.648890 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb17b83-c773-4c70-b4b6-9e93e82d14a5 None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:19:54.662241 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 467/934] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Oct 12 02:19:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 02:19:54.669102 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443b9d9d-2e99-4df7-98e9-0632c395471f None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:19:54.767681 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:19:54.786206 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443b9d9d-2e99-4df7-98e9-0632c395471f None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:19:54.825150 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a52c6af-4e54-4593-be54-38e74f254d4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:19:54.825774 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a52c6af-4e54-4593-be54-38e74f254d4c None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:19:54.826051 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a52c6af-4e54-4593-be54-38e74f254d4c None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:19:54.826320 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a52c6af-4e54-4593-be54-38e74f254d4c None admin] PATH_INFO: `/v3/projects/service` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:19:54.833319 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a52c6af-4e54-4593-be54-38e74f254d4c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:19:54.834739 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a52c6af-4e54-4593-be54-38e74f254d4c None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:19:54.847437 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-4a52c6af-4e54-4593-be54-38e74f254d4c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 12 02:19:54.847437 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 02:19:54.847437 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 02:19:54.847437 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 02:19:54.847437 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 02:19:54.847437 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 02:19:54.847437 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 02:19:54.847437 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 02:19:54.847437 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 02:19:54.847437 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 02:19:54.847437 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 02:19:54.847437 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 02:19:54.847437 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 12 02:19:54.847437 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 12 02:19:54.847437 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 12 02:19:54.848540 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 12 02:19:54.848540 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 02:19:54.848540 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 02:19:54.848540 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 02:19:54.848540 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 02:19:54.848540 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 02:19:54.848540 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 02:19:54.848540 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 02:19:54.848540 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Oct 12 02:19:54.848540 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 02:19:54.848540 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Oct 12 02:19:54.848540 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 02:19:54.848540 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 02:19:54.848540 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 02:19:54.848540 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Oct 12 02:19:54.848540 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 02:19:54.848540 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Oct 12 02:19:54.849480 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 12 02:19:54.849480 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 12 02:19:54.849480 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 12 02:19:54.849480 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 12 02:19:54.849480 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 12 02:19:54.849480 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 12 02:19:54.849480 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 12 02:19:54.849480 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Oct 12 02:19:54.849480 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 468/935] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Oct 12 02:19:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 02:19:54.857841 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb17b83-c773-4c70-b4b6-9e93e82d14a5 None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:19:54.929439 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:19:54.963238 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb17b83-c773-4c70-b4b6-9e93e82d14a5 None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:19:55.000592 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4037137f-c3cc-43cc-a2ef-1ecaaa04c634 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:19:55.001204 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4037137f-c3cc-43cc-a2ef-1ecaaa04c634 None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:19:55.001545 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4037137f-c3cc-43cc-a2ef-1ecaaa04c634 None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:19:55.001802 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4037137f-c3cc-43cc-a2ef-1ecaaa04c634 None admin] PATH_INFO: `/v3/projects` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:19:55.002494 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4037137f-c3cc-43cc-a2ef-1ecaaa04c634 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 02:19:55.002800 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4037137f-c3cc-43cc-a2ef-1ecaaa04c634 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:19:55.004284 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4037137f-c3cc-43cc-a2ef-1ecaaa04c634 None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:19:55.021962 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 468/936] 10.222.0.18 () {56 vars in 1148 bytes} [Wed Oct 12 02:19:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 02:19:55.028727 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a52c6af-4e54-4593-be54-38e74f254d4c None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:19:55.151283 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a52c6af-4e54-4593-be54-38e74f254d4c None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:19:55.198088 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c09f90-168f-4760-9a04-950e47342ef1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:19:55.199122 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c09f90-168f-4760-9a04-950e47342ef1 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:19:55.199436 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c09f90-168f-4760-9a04-950e47342ef1 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:19:55.199709 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c09f90-168f-4760-9a04-950e47342ef1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:19:55.200497 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c09f90-168f-4760-9a04-950e47342ef1 None admin] RBAC: Adding query filter params (role.id=91634b0ac542413bb04e5ce92e66459d, scope.project.id=beb6def6fcad45959e56425bb8bff4d1, user.id=a58b9e0467c040638c3d43e3ac9c0495) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 02:19:55.200940 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c09f90-168f-4760-9a04-950e47342ef1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:19:55.202626 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c09f90-168f-4760-9a04-950e47342ef1 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:19:55.210173 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 469/937] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Oct 12 02:19:55 2022] GET /identity/v3/role_assignments?user.id=a58b9e0467c040638c3d43e3ac9c0495&scope.project.id=beb6def6fcad45959e56425bb8bff4d1&role.id=91634b0ac542413bb04e5ce92e66459d => generated 608 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 02:19:57.626843 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69454f33-2bbe-48c9-a896-8ddb684b5e02 None None] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:19:57.626843 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69454f33-2bbe-48c9-a896-8ddb684b5e02 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:19:57.627472 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69454f33-2bbe-48c9-a896-8ddb684b5e02 None None] PATH_INFO: `/` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:19:57.628729 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 469/938] 10.222.0.18 () {54 vars in 927 bytes} [Wed Oct 12 02:19:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 02:19:57.634157 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dcd5d5-73d9-4a9d-a8dc-d3387677203b None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:19:57.634608 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dcd5d5-73d9-4a9d-a8dc-d3387677203b None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:19:57.634705 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dcd5d5-73d9-4a9d-a8dc-d3387677203b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:19:57.653630 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-f8dcd5d5-73d9-4a9d-a8dc-d3387677203b None None] MFA Rules not processed for user `a326a5bb7364479382f528a592371656`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:19:57.654810 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-f8dcd5d5-73d9-4a9d-a8dc-d3387677203b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:19:57.657768 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:19:57.737004 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 470/939] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Oct 12 02:19:57 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 12 02:19:58.015852 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69454f33-2bbe-48c9-a896-8ddb684b5e02 None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:19:58.127417 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69454f33-2bbe-48c9-a896-8ddb684b5e02 None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:19:58.160010 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:19:58.167282 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7d0924-a3bf-4c9d-bb35-5a76e507fe9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:19:58.167955 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7d0924-a3bf-4c9d-bb35-5a76e507fe9a None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:19:58.168256 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7d0924-a3bf-4c9d-bb35-5a76e507fe9a None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:19:58.168521 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7d0924-a3bf-4c9d-bb35-5a76e507fe9a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:19:58.180072 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7d0924-a3bf-4c9d-bb35-5a76e507fe9a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 02:19:58.187318 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application [None req-5c7d0924-a3bf-4c9d-bb35-5a76e507fe9a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 12 02:19:58.187318 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 02:19:58.187318 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 02:19:58.187318 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 02:19:58.187318 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 02:19:58.187318 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 02:19:58.187318 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 02:19:58.187318 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 02:19:58.187318 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 02:19:58.187318 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 02:19:58.187318 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 02:19:58.187318 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 02:19:58.187318 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 12 02:19:58.187318 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 12 02:19:58.187318 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 12 02:19:58.187318 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 12 02:19:58.188346 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 12 02:19:58.188346 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 12 02:19:58.188346 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 12 02:19:58.188346 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 12 02:19:58.188346 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 02:19:58.188346 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 02:19:58.188346 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 02:19:58.188346 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 02:19:58.188346 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 02:19:58.188346 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 02:19:58.188346 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 02:19:58.188346 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application with Lock( Oct 12 02:19:58.188346 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 02:19:58.188346 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._enter() Oct 12 02:19:58.188346 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 02:19:58.188346 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 02:19:58.189473 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 02:19:58.189473 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.creator() Oct 12 02:19:58.189473 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 02:19:58.189473 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application created_value = creator( Oct 12 02:19:58.189473 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 12 02:19:58.189473 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 12 02:19:58.189473 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 12 02:19:58.189473 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 12 02:19:58.189473 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 12 02:19:58.189473 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 12 02:19:58.189473 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 12 02:19:58.189473 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Oct 12 02:19:58.190131 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 470/940] 10.222.0.18 () {56 vars in 1096 bytes} [Wed Oct 12 02:19:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 02:19:58.195019 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8dcd5d5-73d9-4a9d-a8dc-d3387677203b None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:19:58.308111 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8dcd5d5-73d9-4a9d-a8dc-d3387677203b None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:19:58.347541 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13be0cce-02ee-4b50-8b20-4a1b9f3b123b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:19:58.348147 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13be0cce-02ee-4b50-8b20-4a1b9f3b123b None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:19:58.348420 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13be0cce-02ee-4b50-8b20-4a1b9f3b123b None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:19:58.348725 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13be0cce-02ee-4b50-8b20-4a1b9f3b123b None admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:19:58.349387 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13be0cce-02ee-4b50-8b20-4a1b9f3b123b None admin] RBAC: Adding query filter params (name=admin) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 02:19:58.349674 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13be0cce-02ee-4b50-8b20-4a1b9f3b123b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:19:58.351034 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13be0cce-02ee-4b50-8b20-4a1b9f3b123b None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:19:58.362211 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 471/941] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Oct 12 02:19:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 02:19:58.368620 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7d0924-a3bf-4c9d-bb35-5a76e507fe9a None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:19:58.481922 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7d0924-a3bf-4c9d-bb35-5a76e507fe9a None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:19:58.522660 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd72b4a8-a43b-460f-b8ad-9e5d80b297d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:19:58.523399 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd72b4a8-a43b-460f-b8ad-9e5d80b297d4 None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:19:58.523753 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd72b4a8-a43b-460f-b8ad-9e5d80b297d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:19:58.524674 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd72b4a8-a43b-460f-b8ad-9e5d80b297d4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:19:58.536903 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd72b4a8-a43b-460f-b8ad-9e5d80b297d4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:19:58.538507 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd72b4a8-a43b-460f-b8ad-9e5d80b297d4 None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:19:58.554413 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application [None req-cd72b4a8-a43b-460f-b8ad-9e5d80b297d4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 02:19:58.554413 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 02:19:58.554413 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 02:19:58.554413 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 02:19:58.554413 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 02:19:58.554413 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 02:19:58.554413 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 02:19:58.554413 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 02:19:58.554413 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 02:19:58.554413 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 02:19:58.554413 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 02:19:58.554413 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 02:19:58.554413 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 12 02:19:58.554413 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 12 02:19:58.554413 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 12 02:19:58.554413 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 12 02:19:58.555803 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 02:19:58.555803 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 02:19:58.555803 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 02:19:58.555803 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 02:19:58.555803 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 02:19:58.555803 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 02:19:58.555803 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 02:19:58.555803 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application with Lock( Oct 12 02:19:58.555803 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 02:19:58.555803 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._enter() Oct 12 02:19:58.555803 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 02:19:58.555803 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 02:19:58.555803 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 02:19:58.555803 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.creator() Oct 12 02:19:58.555803 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 02:19:58.555803 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application created_value = creator( Oct 12 02:19:58.555803 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 12 02:19:58.557180 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 12 02:19:58.557180 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 02:19:58.557180 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Oct 12 02:19:58.557180 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 471/942] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Oct 12 02:19:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 02:19:58.561937 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13be0cce-02ee-4b50-8b20-4a1b9f3b123b None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:19:58.565312 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:19:58.678508 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13be0cce-02ee-4b50-8b20-4a1b9f3b123b None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:19:58.716843 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33102f92-41a6-4700-a16d-5535b6c31df7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:19:58.717461 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33102f92-41a6-4700-a16d-5535b6c31df7 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:19:58.717766 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33102f92-41a6-4700-a16d-5535b6c31df7 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:19:58.718018 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33102f92-41a6-4700-a16d-5535b6c31df7 None admin] PATH_INFO: `/v3/domains` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:19:58.718847 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33102f92-41a6-4700-a16d-5535b6c31df7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 02:19:58.719162 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33102f92-41a6-4700-a16d-5535b6c31df7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:19:58.720753 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33102f92-41a6-4700-a16d-5535b6c31df7 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:19:58.734169 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 472/943] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Oct 12 02:19:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 02:19:58.740180 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd72b4a8-a43b-460f-b8ad-9e5d80b297d4 None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:19:58.788822 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:19:58.856170 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd72b4a8-a43b-460f-b8ad-9e5d80b297d4 None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:19:58.893955 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5360bc4-559a-4b28-ad8a-603bdd127ce5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:19:58.894601 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5360bc4-559a-4b28-ad8a-603bdd127ce5 None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:19:58.894876 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5360bc4-559a-4b28-ad8a-603bdd127ce5 None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:19:58.895152 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5360bc4-559a-4b28-ad8a-603bdd127ce5 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:19:58.905313 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5360bc4-559a-4b28-ad8a-603bdd127ce5 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:19:58.906868 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5360bc4-559a-4b28-ad8a-603bdd127ce5 None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:19:58.920247 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application [None req-e5360bc4-559a-4b28-ad8a-603bdd127ce5 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 12 02:19:58.920247 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 02:19:58.920247 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 02:19:58.920247 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 02:19:58.920247 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 02:19:58.920247 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 02:19:58.920247 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 02:19:58.920247 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 02:19:58.920247 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 02:19:58.920247 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 02:19:58.920247 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 02:19:58.920247 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 02:19:58.920247 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 12 02:19:58.920247 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 12 02:19:58.920247 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 12 02:19:58.920247 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 12 02:19:58.921285 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 02:19:58.921285 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 02:19:58.921285 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 12 02:19:58.921285 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 12 02:19:58.921285 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 12 02:19:58.921285 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 12 02:19:58.921285 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 02:19:58.921285 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 02:19:58.921285 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 02:19:58.921285 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 02:19:58.921285 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 02:19:58.921285 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application with Lock( Oct 12 02:19:58.921285 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 02:19:58.921285 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._enter() Oct 12 02:19:58.921285 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 02:19:58.921285 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 02:19:58.921285 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 02:19:58.921285 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.creator() Oct 12 02:19:58.922374 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 02:19:58.922374 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application created_value = creator( Oct 12 02:19:58.922374 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 12 02:19:58.922374 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 12 02:19:58.922374 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 12 02:19:58.922374 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 12 02:19:58.922374 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 12 02:19:58.922374 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 12 02:19:58.922374 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 12 02:19:58.922374 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Oct 12 02:19:58.922374 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 472/944] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Oct 12 02:19:58 2022] GET /identity/v3/users/placement => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 02:19:58.927759 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33102f92-41a6-4700-a16d-5535b6c31df7 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:19:59.000276 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:19:59.046802 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33102f92-41a6-4700-a16d-5535b6c31df7 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:19:59.083471 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27497f67-8fd4-445d-a9e1-7f01e974f22d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:19:59.084180 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27497f67-8fd4-445d-a9e1-7f01e974f22d None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:19:59.084549 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27497f67-8fd4-445d-a9e1-7f01e974f22d None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:19:59.084771 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27497f67-8fd4-445d-a9e1-7f01e974f22d None admin] PATH_INFO: `/v3/users` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:19:59.085608 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27497f67-8fd4-445d-a9e1-7f01e974f22d None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 02:19:59.085977 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27497f67-8fd4-445d-a9e1-7f01e974f22d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:19:59.087551 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27497f67-8fd4-445d-a9e1-7f01e974f22d None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:19:59.107140 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 473/945] 10.222.0.18 () {56 vars in 1143 bytes} [Wed Oct 12 02:19:58 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 02:19:59.113824 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5360bc4-559a-4b28-ad8a-603bdd127ce5 None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:19:59.231144 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5360bc4-559a-4b28-ad8a-603bdd127ce5 None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:19:59.232866 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:19:59.269280 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0885b2d4-bc1c-47d7-ba5f-4b0943132ee6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:19:59.269989 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0885b2d4-bc1c-47d7-ba5f-4b0943132ee6 None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:19:59.270272 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0885b2d4-bc1c-47d7-ba5f-4b0943132ee6 None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:19:59.270545 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0885b2d4-bc1c-47d7-ba5f-4b0943132ee6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:19:59.283328 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0885b2d4-bc1c-47d7-ba5f-4b0943132ee6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:19:59.284844 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0885b2d4-bc1c-47d7-ba5f-4b0943132ee6 None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:19:59.299939 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application [None req-0885b2d4-bc1c-47d7-ba5f-4b0943132ee6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 02:19:59.299939 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 02:19:59.299939 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 02:19:59.299939 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 02:19:59.299939 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 02:19:59.299939 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 02:19:59.299939 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 02:19:59.299939 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 02:19:59.299939 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 02:19:59.299939 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 02:19:59.299939 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 02:19:59.299939 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 02:19:59.299939 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 12 02:19:59.299939 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 12 02:19:59.299939 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 12 02:19:59.299939 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 12 02:19:59.301130 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 02:19:59.301130 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 02:19:59.301130 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 02:19:59.301130 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 02:19:59.301130 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 02:19:59.301130 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 02:19:59.301130 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 02:19:59.301130 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application with Lock( Oct 12 02:19:59.301130 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 02:19:59.301130 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._enter() Oct 12 02:19:59.301130 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 02:19:59.301130 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 02:19:59.301130 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 02:19:59.301130 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.creator() Oct 12 02:19:59.301130 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 02:19:59.301130 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application created_value = creator( Oct 12 02:19:59.301130 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 12 02:19:59.302043 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 12 02:19:59.302043 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 02:19:59.302043 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Oct 12 02:19:59.302043 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 473/946] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Oct 12 02:19:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 02:19:59.307549 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27497f67-8fd4-445d-a9e1-7f01e974f22d None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:19:59.421602 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27497f67-8fd4-445d-a9e1-7f01e974f22d None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:19:59.444506 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:19:59.459684 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1c0155-69e7-494c-b504-0305640ff941 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:19:59.460289 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1c0155-69e7-494c-b504-0305640ff941 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:19:59.460587 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1c0155-69e7-494c-b504-0305640ff941 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:19:59.460855 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1c0155-69e7-494c-b504-0305640ff941 None admin] PATH_INFO: `/v3/domains` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:19:59.462063 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1c0155-69e7-494c-b504-0305640ff941 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 02:19:59.462433 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1c0155-69e7-494c-b504-0305640ff941 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:19:59.464035 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1c0155-69e7-494c-b504-0305640ff941 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:19:59.477188 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 474/947] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Oct 12 02:19:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 02:19:59.484747 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0885b2d4-bc1c-47d7-ba5f-4b0943132ee6 None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:19:59.600955 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0885b2d4-bc1c-47d7-ba5f-4b0943132ee6 None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:19:59.640769 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c858f27-ece0-4c3f-b89d-c8ffefc41bad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:19:59.641468 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c858f27-ece0-4c3f-b89d-c8ffefc41bad None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:19:59.641963 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c858f27-ece0-4c3f-b89d-c8ffefc41bad None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:19:59.642319 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c858f27-ece0-4c3f-b89d-c8ffefc41bad None admin] PATH_INFO: `/v3/projects/service` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:19:59.651893 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c858f27-ece0-4c3f-b89d-c8ffefc41bad None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:19:59.653375 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c858f27-ece0-4c3f-b89d-c8ffefc41bad None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:19:59.669746 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application [None req-4c858f27-ece0-4c3f-b89d-c8ffefc41bad None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 12 02:19:59.669746 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 02:19:59.669746 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 02:19:59.669746 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 02:19:59.669746 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 02:19:59.669746 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 02:19:59.669746 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 02:19:59.669746 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 02:19:59.669746 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 02:19:59.669746 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 02:19:59.669746 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 02:19:59.669746 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 02:19:59.669746 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 12 02:19:59.669746 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 12 02:19:59.669746 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 12 02:19:59.670997 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 12 02:19:59.670997 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 02:19:59.670997 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 02:19:59.670997 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 02:19:59.670997 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 02:19:59.670997 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 02:19:59.670997 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 02:19:59.670997 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 02:19:59.670997 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application with Lock( Oct 12 02:19:59.670997 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 02:19:59.670997 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._enter() Oct 12 02:19:59.670997 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 02:19:59.670997 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 02:19:59.670997 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 02:19:59.670997 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.creator() Oct 12 02:19:59.670997 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 02:19:59.670997 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application created_value = creator( Oct 12 02:19:59.672280 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 12 02:19:59.672280 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 12 02:19:59.672280 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 12 02:19:59.672280 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 12 02:19:59.672280 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 12 02:19:59.672280 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 12 02:19:59.672280 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 12 02:19:59.672280 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Oct 12 02:19:59.676752 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 474/948] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Oct 12 02:19:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 12 02:19:59.677750 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1c0155-69e7-494c-b504-0305640ff941 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:19:59.786374 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1c0155-69e7-494c-b504-0305640ff941 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:19:59.826073 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69706e88-738e-4997-9afd-e24ef5c165f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:19:59.826692 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69706e88-738e-4997-9afd-e24ef5c165f1 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:19:59.826970 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69706e88-738e-4997-9afd-e24ef5c165f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:19:59.827241 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69706e88-738e-4997-9afd-e24ef5c165f1 None admin] PATH_INFO: `/v3/projects` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:19:59.827929 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69706e88-738e-4997-9afd-e24ef5c165f1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 02:19:59.828232 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69706e88-738e-4997-9afd-e24ef5c165f1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:19:59.829695 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69706e88-738e-4997-9afd-e24ef5c165f1 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:19:59.842391 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 475/949] 10.222.0.18 () {56 vars in 1148 bytes} [Wed Oct 12 02:19:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 02:19:59.849676 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c858f27-ece0-4c3f-b89d-c8ffefc41bad None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:19:59.868337 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:19:59.965021 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c858f27-ece0-4c3f-b89d-c8ffefc41bad None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:20:00.003160 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01dd7424-306f-45e1-a552-92b6e2afb3e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:20:00.003823 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dd7424-306f-45e1-a552-92b6e2afb3e1 None admin] REQUEST_METHOD: `PUT` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:20:00.004098 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dd7424-306f-45e1-a552-92b6e2afb3e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:20:00.004371 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dd7424-306f-45e1-a552-92b6e2afb3e1 None admin] PATH_INFO: `/v3/projects/beb6def6fcad45959e56425bb8bff4d1/users/a58b9e0467c040638c3d43e3ac9c0495/roles/39b1e8108dff402383def3c559f48189` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:20:00.006276 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01dd7424-306f-45e1-a552-92b6e2afb3e1 None admin] RBAC: Authorizing `identity:create_grant(project_id=beb6def6fcad45959e56425bb8bff4d1, user_id=a58b9e0467c040638c3d43e3ac9c0495, role_id=39b1e8108dff402383def3c559f48189)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:20:00.007708 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01dd7424-306f-45e1-a552-92b6e2afb3e1 None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:20:00.022413 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 475/950] 10.222.0.18 () {58 vars in 1439 bytes} [Wed Oct 12 02:19:59 2022] PUT /identity/v3/projects/beb6def6fcad45959e56425bb8bff4d1/users/a58b9e0467c040638c3d43e3ac9c0495/roles/39b1e8108dff402383def3c559f48189 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 02:20:02.248516 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02d794c-8bb0-4be7-932b-3b30914f9d60 None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:20:02.249050 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02d794c-8bb0-4be7-932b-3b30914f9d60 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:20:02.249050 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02d794c-8bb0-4be7-932b-3b30914f9d60 None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:20:02.250532 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 476/951] 10.222.0.18 () {54 vars in 927 bytes} [Wed Oct 12 02:20:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 02:20:02.255519 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021f0119-facd-474d-9692-b452434f422d None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:20:02.255918 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021f0119-facd-474d-9692-b452434f422d None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:20:02.256154 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021f0119-facd-474d-9692-b452434f422d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:20:02.279402 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-021f0119-facd-474d-9692-b452434f422d None None] MFA Rules not processed for user `a326a5bb7364479382f528a592371656`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:20:02.280811 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-021f0119-facd-474d-9692-b452434f422d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:20:02.361660 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 476/952] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Oct 12 02:20:02 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 12 02:20:02.666331 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02d794c-8bb0-4be7-932b-3b30914f9d60 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:20:02.714566 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:20:02.777632 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02d794c-8bb0-4be7-932b-3b30914f9d60 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:20:02.817310 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d7b08e-7bec-482a-bde7-edcc33f2928d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:20:02.817869 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d7b08e-7bec-482a-bde7-edcc33f2928d None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:20:02.818145 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d7b08e-7bec-482a-bde7-edcc33f2928d None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:20:02.818411 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d7b08e-7bec-482a-bde7-edcc33f2928d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:20:02.829245 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d7b08e-7bec-482a-bde7-edcc33f2928d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 02:20:02.833981 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-35d7b08e-7bec-482a-bde7-edcc33f2928d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 12 02:20:02.833981 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 02:20:02.833981 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 02:20:02.833981 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 02:20:02.833981 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 02:20:02.833981 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 02:20:02.833981 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 02:20:02.833981 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 02:20:02.833981 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 02:20:02.833981 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 02:20:02.833981 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 02:20:02.833981 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 02:20:02.833981 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 12 02:20:02.833981 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 12 02:20:02.833981 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 12 02:20:02.833981 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 12 02:20:02.835106 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 12 02:20:02.835106 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 12 02:20:02.835106 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 12 02:20:02.835106 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 12 02:20:02.835106 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 02:20:02.835106 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 02:20:02.835106 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 02:20:02.835106 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 02:20:02.835106 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 02:20:02.835106 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 02:20:02.835106 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 02:20:02.835106 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Oct 12 02:20:02.835106 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 02:20:02.835106 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Oct 12 02:20:02.835106 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 02:20:02.835106 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 02:20:02.835956 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 02:20:02.835956 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Oct 12 02:20:02.835956 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 02:20:02.835956 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Oct 12 02:20:02.835956 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 12 02:20:02.835956 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 12 02:20:02.835956 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 12 02:20:02.835956 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 12 02:20:02.835956 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 12 02:20:02.835956 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 12 02:20:02.835956 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 12 02:20:02.835956 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Oct 12 02:20:02.835956 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 477/953] 10.222.0.18 () {56 vars in 1096 bytes} [Wed Oct 12 02:20:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 02:20:02.842642 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021f0119-facd-474d-9692-b452434f422d None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:20:02.845719 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:20:02.952058 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021f0119-facd-474d-9692-b452434f422d None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:20:02.989623 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b01add1-92df-4570-acc3-60822a4e2342 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:20:02.990239 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b01add1-92df-4570-acc3-60822a4e2342 None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:20:02.990512 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b01add1-92df-4570-acc3-60822a4e2342 None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:20:02.990781 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b01add1-92df-4570-acc3-60822a4e2342 None admin] PATH_INFO: `/v3/roles` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:20:02.991441 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b01add1-92df-4570-acc3-60822a4e2342 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 02:20:02.991780 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b01add1-92df-4570-acc3-60822a4e2342 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:20:02.993733 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b01add1-92df-4570-acc3-60822a4e2342 None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:20:03.002142 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 477/954] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Oct 12 02:20:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 02:20:03.009525 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d7b08e-7bec-482a-bde7-edcc33f2928d None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:20:03.116153 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:20:03.120197 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d7b08e-7bec-482a-bde7-edcc33f2928d None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:20:03.165602 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259c5624-a185-4ccb-9c53-875495545543 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:20:03.166270 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259c5624-a185-4ccb-9c53-875495545543 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:20:03.166562 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259c5624-a185-4ccb-9c53-875495545543 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:20:03.166962 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259c5624-a185-4ccb-9c53-875495545543 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:20:03.178043 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259c5624-a185-4ccb-9c53-875495545543 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:20:03.179522 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259c5624-a185-4ccb-9c53-875495545543 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:20:03.199014 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-259c5624-a185-4ccb-9c53-875495545543 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 02:20:03.199014 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 02:20:03.199014 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 02:20:03.199014 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 02:20:03.199014 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 02:20:03.199014 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 02:20:03.199014 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 02:20:03.199014 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 02:20:03.199014 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 02:20:03.199014 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 02:20:03.199014 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 02:20:03.199014 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 02:20:03.199014 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 12 02:20:03.199014 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 12 02:20:03.199014 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 12 02:20:03.199014 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 12 02:20:03.200273 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 02:20:03.200273 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 02:20:03.200273 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 02:20:03.200273 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 02:20:03.200273 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 02:20:03.200273 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 02:20:03.200273 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 02:20:03.200273 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Oct 12 02:20:03.200273 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 02:20:03.200273 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Oct 12 02:20:03.200273 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 02:20:03.200273 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 02:20:03.200273 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 02:20:03.200273 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Oct 12 02:20:03.200273 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 02:20:03.200273 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Oct 12 02:20:03.200273 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 12 02:20:03.201426 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 12 02:20:03.201426 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 02:20:03.201426 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Oct 12 02:20:03.201426 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 478/955] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Oct 12 02:20:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 02:20:03.206495 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b01add1-92df-4570-acc3-60822a4e2342 None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:20:03.278671 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:20:03.318699 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b01add1-92df-4570-acc3-60822a4e2342 None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:20:03.354491 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2288124d-2032-4fb3-a490-50bda576dae8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:20:03.355115 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2288124d-2032-4fb3-a490-50bda576dae8 None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:20:03.355393 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2288124d-2032-4fb3-a490-50bda576dae8 None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:20:03.355664 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2288124d-2032-4fb3-a490-50bda576dae8 None admin] PATH_INFO: `/v3/domains` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:20:03.356341 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2288124d-2032-4fb3-a490-50bda576dae8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 02:20:03.356658 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2288124d-2032-4fb3-a490-50bda576dae8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:20:03.358067 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2288124d-2032-4fb3-a490-50bda576dae8 None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:20:03.372038 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 478/956] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Oct 12 02:20:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 02:20:03.377781 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259c5624-a185-4ccb-9c53-875495545543 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:20:03.480920 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259c5624-a185-4ccb-9c53-875495545543 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:20:03.516207 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf28867-ec14-401d-90a7-f6f6a5ce6501 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:20:03.516871 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf28867-ec14-401d-90a7-f6f6a5ce6501 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:20:03.517145 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf28867-ec14-401d-90a7-f6f6a5ce6501 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:20:03.517410 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf28867-ec14-401d-90a7-f6f6a5ce6501 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:20:03.525497 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf28867-ec14-401d-90a7-f6f6a5ce6501 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:20:03.526940 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf28867-ec14-401d-90a7-f6f6a5ce6501 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:20:03.539858 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-0bf28867-ec14-401d-90a7-f6f6a5ce6501 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 12 02:20:03.539858 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 02:20:03.539858 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 02:20:03.539858 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 02:20:03.539858 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 02:20:03.539858 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 02:20:03.539858 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 02:20:03.539858 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 02:20:03.539858 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 02:20:03.539858 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 02:20:03.539858 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 02:20:03.539858 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 02:20:03.539858 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 12 02:20:03.539858 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 12 02:20:03.539858 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 12 02:20:03.539858 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 12 02:20:03.541209 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 02:20:03.541209 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 02:20:03.541209 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 12 02:20:03.541209 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 12 02:20:03.541209 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 12 02:20:03.541209 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 12 02:20:03.541209 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 02:20:03.541209 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 02:20:03.541209 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 02:20:03.541209 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 02:20:03.541209 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 02:20:03.541209 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Oct 12 02:20:03.541209 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 02:20:03.541209 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Oct 12 02:20:03.541209 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 02:20:03.541209 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 02:20:03.541209 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 02:20:03.541209 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Oct 12 02:20:03.542374 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 02:20:03.542374 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Oct 12 02:20:03.542374 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 12 02:20:03.542374 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 12 02:20:03.542374 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 12 02:20:03.542374 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 12 02:20:03.542374 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 12 02:20:03.542374 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 12 02:20:03.542374 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 12 02:20:03.542374 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Oct 12 02:20:03.542374 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 479/957] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Oct 12 02:20:03 2022] GET /identity/v3/users/placement => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 02:20:03.547127 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2288124d-2032-4fb3-a490-50bda576dae8 None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:20:03.654876 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2288124d-2032-4fb3-a490-50bda576dae8 None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:20:03.682026 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:20:03.691874 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddc293f-895c-4366-a9a8-cc5134da69ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:20:03.692500 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddc293f-895c-4366-a9a8-cc5134da69ee None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:20:03.692783 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddc293f-895c-4366-a9a8-cc5134da69ee None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:20:03.693054 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddc293f-895c-4366-a9a8-cc5134da69ee None admin] PATH_INFO: `/v3/users` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:20:03.693783 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ddc293f-895c-4366-a9a8-cc5134da69ee None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 02:20:03.694088 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ddc293f-895c-4366-a9a8-cc5134da69ee None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:20:03.695521 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ddc293f-895c-4366-a9a8-cc5134da69ee None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:20:03.713099 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 479/958] 10.222.0.18 () {56 vars in 1143 bytes} [Wed Oct 12 02:20:03 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 02:20:03.719097 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf28867-ec14-401d-90a7-f6f6a5ce6501 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:20:03.735372 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:20:03.823038 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf28867-ec14-401d-90a7-f6f6a5ce6501 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:20:03.856317 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235bdd38-0586-41ed-afef-09df28f3bef4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:20:03.856954 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235bdd38-0586-41ed-afef-09df28f3bef4 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:20:03.857228 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235bdd38-0586-41ed-afef-09df28f3bef4 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:20:03.857498 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235bdd38-0586-41ed-afef-09df28f3bef4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:20:03.924234 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235bdd38-0586-41ed-afef-09df28f3bef4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:20:03.925661 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235bdd38-0586-41ed-afef-09df28f3bef4 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:20:03.939313 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:20:04.021228 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 480/959] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Oct 12 02:20:03 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 12 02:20:04.029336 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddc293f-895c-4366-a9a8-cc5134da69ee None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:20:04.126496 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddc293f-895c-4366-a9a8-cc5134da69ee None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:20:04.169297 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b4d649-6b7f-4b6e-8b1d-8a168f870ae9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:20:04.170021 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b4d649-6b7f-4b6e-8b1d-8a168f870ae9 None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:20:04.170383 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b4d649-6b7f-4b6e-8b1d-8a168f870ae9 None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:20:04.170703 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b4d649-6b7f-4b6e-8b1d-8a168f870ae9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:20:04.182046 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b4d649-6b7f-4b6e-8b1d-8a168f870ae9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:20:04.183441 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b4d649-6b7f-4b6e-8b1d-8a168f870ae9 None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:20:04.198343 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application [None req-69b4d649-6b7f-4b6e-8b1d-8a168f870ae9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 02:20:04.198343 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 02:20:04.198343 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 02:20:04.198343 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 02:20:04.198343 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 02:20:04.198343 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 02:20:04.198343 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 02:20:04.198343 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 02:20:04.198343 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 02:20:04.198343 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 02:20:04.198343 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 02:20:04.198343 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 02:20:04.198343 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 12 02:20:04.198343 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 12 02:20:04.198343 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 12 02:20:04.198343 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 12 02:20:04.199438 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 02:20:04.199438 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 02:20:04.199438 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 02:20:04.199438 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 02:20:04.199438 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 02:20:04.199438 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 02:20:04.199438 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 02:20:04.199438 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application with Lock( Oct 12 02:20:04.199438 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 02:20:04.199438 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._enter() Oct 12 02:20:04.199438 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 02:20:04.199438 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 02:20:04.199438 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 02:20:04.199438 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.creator() Oct 12 02:20:04.199438 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 02:20:04.199438 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application created_value = creator( Oct 12 02:20:04.199438 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 12 02:20:04.200691 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 12 02:20:04.200691 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 02:20:04.200691 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Oct 12 02:20:04.200691 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 480/960] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Oct 12 02:20:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 02:20:04.205177 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235bdd38-0586-41ed-afef-09df28f3bef4 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:20:04.299693 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235bdd38-0586-41ed-afef-09df28f3bef4 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:20:04.311977 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:20:04.332420 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d620ab8b-dd95-4c8d-aefd-62239f6278d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:20:04.333034 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d620ab8b-dd95-4c8d-aefd-62239f6278d1 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:20:04.333308 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d620ab8b-dd95-4c8d-aefd-62239f6278d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:20:04.333576 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d620ab8b-dd95-4c8d-aefd-62239f6278d1 None admin] PATH_INFO: `/v3/domains` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:20:04.334202 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d620ab8b-dd95-4c8d-aefd-62239f6278d1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 02:20:04.334498 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d620ab8b-dd95-4c8d-aefd-62239f6278d1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:20:04.335833 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d620ab8b-dd95-4c8d-aefd-62239f6278d1 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:20:04.347145 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 481/961] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Oct 12 02:20:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 02:20:04.352713 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b4d649-6b7f-4b6e-8b1d-8a168f870ae9 None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:20:04.387267 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:20:04.449915 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b4d649-6b7f-4b6e-8b1d-8a168f870ae9 None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:20:04.482615 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a574ed6-345b-4a85-83e6-8eaa8dd5926b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:20:04.483218 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a574ed6-345b-4a85-83e6-8eaa8dd5926b None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:20:04.483756 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a574ed6-345b-4a85-83e6-8eaa8dd5926b None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:20:04.484021 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a574ed6-345b-4a85-83e6-8eaa8dd5926b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:20:04.490409 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a574ed6-345b-4a85-83e6-8eaa8dd5926b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:20:04.491839 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a574ed6-345b-4a85-83e6-8eaa8dd5926b None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:20:04.503058 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application [None req-5a574ed6-345b-4a85-83e6-8eaa8dd5926b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 12 02:20:04.503058 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 02:20:04.503058 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 02:20:04.503058 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 02:20:04.503058 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 02:20:04.503058 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 02:20:04.503058 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 02:20:04.503058 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 02:20:04.503058 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 02:20:04.503058 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 02:20:04.503058 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 02:20:04.503058 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 02:20:04.503058 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 12 02:20:04.503058 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 12 02:20:04.503058 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 12 02:20:04.504087 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 12 02:20:04.504087 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 02:20:04.504087 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 02:20:04.504087 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 02:20:04.504087 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 02:20:04.504087 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 02:20:04.504087 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 02:20:04.504087 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 02:20:04.504087 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application with Lock( Oct 12 02:20:04.504087 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 02:20:04.504087 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._enter() Oct 12 02:20:04.504087 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 02:20:04.504087 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 02:20:04.504087 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 02:20:04.504087 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.creator() Oct 12 02:20:04.504087 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 02:20:04.504087 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application created_value = creator( Oct 12 02:20:04.505213 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 12 02:20:04.505213 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 12 02:20:04.505213 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 12 02:20:04.505213 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 12 02:20:04.505213 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 12 02:20:04.505213 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 12 02:20:04.505213 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 12 02:20:04.505213 dv-cinder-849143-14-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Oct 12 02:20:04.505213 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 481/962] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Oct 12 02:20:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 02:20:04.510590 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d620ab8b-dd95-4c8d-aefd-62239f6278d1 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:20:04.607495 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d620ab8b-dd95-4c8d-aefd-62239f6278d1 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:20:04.640892 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c697c55f-e7ec-47bb-b374-bb6bbe380ffd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:20:04.641494 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c697c55f-e7ec-47bb-b374-bb6bbe380ffd None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:20:04.641771 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c697c55f-e7ec-47bb-b374-bb6bbe380ffd None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:20:04.642096 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c697c55f-e7ec-47bb-b374-bb6bbe380ffd None admin] PATH_INFO: `/v3/projects` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:20:04.642730 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c697c55f-e7ec-47bb-b374-bb6bbe380ffd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 02:20:04.643033 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c697c55f-e7ec-47bb-b374-bb6bbe380ffd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:20:04.644450 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c697c55f-e7ec-47bb-b374-bb6bbe380ffd None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:20:04.656545 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 482/963] 10.222.0.18 () {56 vars in 1148 bytes} [Wed Oct 12 02:20:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 02:20:04.662583 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a574ed6-345b-4a85-83e6-8eaa8dd5926b None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:20:04.759998 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:20:04.765993 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a574ed6-345b-4a85-83e6-8eaa8dd5926b None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:20:04.797868 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16bfbe3-0369-42d0-b840-142b6f75cd6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:20:04.798458 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16bfbe3-0369-42d0-b840-142b6f75cd6f None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:20:04.798737 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16bfbe3-0369-42d0-b840-142b6f75cd6f None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:20:04.799008 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16bfbe3-0369-42d0-b840-142b6f75cd6f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:20:04.799729 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16bfbe3-0369-42d0-b840-142b6f75cd6f None admin] RBAC: Adding query filter params (role.id=39b1e8108dff402383def3c559f48189, scope.project.id=beb6def6fcad45959e56425bb8bff4d1, user.id=a58b9e0467c040638c3d43e3ac9c0495) {{(pid=81361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 02:20:04.800035 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16bfbe3-0369-42d0-b840-142b6f75cd6f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:20:04.801488 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16bfbe3-0369-42d0-b840-142b6f75cd6f None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:20:04.807557 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 482/964] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Oct 12 02:20:04 2022] GET /identity/v3/role_assignments?user.id=a58b9e0467c040638c3d43e3ac9c0495&scope.project.id=beb6def6fcad45959e56425bb8bff4d1&role.id=39b1e8108dff402383def3c559f48189 => generated 608 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 02:20:06.948110 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94979f6f-8aa8-44eb-baaa-f12922150675 None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:20:06.948788 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94979f6f-8aa8-44eb-baaa-f12922150675 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:20:06.948788 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94979f6f-8aa8-44eb-baaa-f12922150675 None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:20:06.949996 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 483/965] 10.222.0.18 () {54 vars in 927 bytes} [Wed Oct 12 02:20:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 02:20:06.955049 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc23c932-29c7-4797-9b80-c8e2a8cad330 None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:20:06.955490 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc23c932-29c7-4797-9b80-c8e2a8cad330 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:20:06.955583 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc23c932-29c7-4797-9b80-c8e2a8cad330 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:20:06.973687 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-fc23c932-29c7-4797-9b80-c8e2a8cad330 None None] MFA Rules not processed for user `a326a5bb7364479382f528a592371656`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:20:06.974896 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-fc23c932-29c7-4797-9b80-c8e2a8cad330 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:20:07.045519 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 483/966] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Oct 12 02:20:06 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 12 02:20:07.332877 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94979f6f-8aa8-44eb-baaa-f12922150675 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:20:07.363518 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:20:07.432115 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94979f6f-8aa8-44eb-baaa-f12922150675 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:20:07.464217 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80927768-0583-44ad-a4f5-442e6b919c1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:20:07.464865 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80927768-0583-44ad-a4f5-442e6b919c1f None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:20:07.465145 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80927768-0583-44ad-a4f5-442e6b919c1f None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:20:07.465416 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80927768-0583-44ad-a4f5-442e6b919c1f None admin] PATH_INFO: `/v3/services/placement` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:20:07.465992 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80927768-0583-44ad-a4f5-442e6b919c1f None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:20:07.467338 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80927768-0583-44ad-a4f5-442e6b919c1f None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:20:07.475889 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-80927768-0583-44ad-a4f5-442e6b919c1f None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Oct 12 02:20:07.475889 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 02:20:07.475889 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 12 02:20:07.475889 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 12 02:20:07.475889 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 12 02:20:07.475889 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 12 02:20:07.475889 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 12 02:20:07.475889 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 12 02:20:07.475889 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 12 02:20:07.475889 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Oct 12 02:20:07.475889 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 12 02:20:07.475889 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Oct 12 02:20:07.475889 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 02:20:07.475889 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 02:20:07.475889 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 02:20:07.475889 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 02:20:07.475889 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 02:20:07.477817 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 02:20:07.477817 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 02:20:07.477817 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 02:20:07.477817 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 02:20:07.477817 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 02:20:07.477817 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 02:20:07.477817 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 12 02:20:07.477817 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 12 02:20:07.477817 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 12 02:20:07.477817 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 12 02:20:07.477817 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 02:20:07.477817 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 02:20:07.477817 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 02:20:07.477817 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 02:20:07.477817 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 02:20:07.477817 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 02:20:07.478707 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 02:20:07.478707 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Oct 12 02:20:07.478707 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 02:20:07.478707 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Oct 12 02:20:07.478707 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 02:20:07.478707 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 02:20:07.478707 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 02:20:07.478707 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Oct 12 02:20:07.478707 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 02:20:07.478707 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Oct 12 02:20:07.478707 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 12 02:20:07.478707 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 12 02:20:07.478707 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 12 02:20:07.478707 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Oct 12 02:20:07.478707 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 484/967] 10.222.0.18 () {56 vars in 1117 bytes} [Wed Oct 12 02:20:07 2022] GET /identity/v3/services/placement => generated 90 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 02:20:07.483754 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc23c932-29c7-4797-9b80-c8e2a8cad330 None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:20:07.570269 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:20:07.579925 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc23c932-29c7-4797-9b80-c8e2a8cad330 None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:20:07.613049 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524f7924-6c7c-4d1a-a042-aa27e9bb41c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:20:07.613579 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524f7924-6c7c-4d1a-a042-aa27e9bb41c0 None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:20:07.613849 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524f7924-6c7c-4d1a-a042-aa27e9bb41c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:20:07.614114 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524f7924-6c7c-4d1a-a042-aa27e9bb41c0 None admin] PATH_INFO: `/v3/services` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:20:07.614728 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524f7924-6c7c-4d1a-a042-aa27e9bb41c0 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 02:20:07.615020 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524f7924-6c7c-4d1a-a042-aa27e9bb41c0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:20:07.616360 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524f7924-6c7c-4d1a-a042-aa27e9bb41c0 None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:20:07.621130 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 484/968] 10.222.0.18 () {56 vars in 1116 bytes} [Wed Oct 12 02:20:07 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 02:20:07.626860 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80927768-0583-44ad-a4f5-442e6b919c1f None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:20:07.717902 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:20:07.723912 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80927768-0583-44ad-a4f5-442e6b919c1f None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:20:07.756407 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8b2c12-a50c-443c-9763-bf2427dc8c65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:20:07.757040 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8b2c12-a50c-443c-9763-bf2427dc8c65 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:20:07.757320 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8b2c12-a50c-443c-9763-bf2427dc8c65 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:20:07.759112 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8b2c12-a50c-443c-9763-bf2427dc8c65 None admin] PATH_INFO: `/v3/services` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:20:07.759112 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8b2c12-a50c-443c-9763-bf2427dc8c65 None admin] RBAC: Adding query filter params (type=placement) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 02:20:07.759112 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8b2c12-a50c-443c-9763-bf2427dc8c65 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:20:07.760306 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8b2c12-a50c-443c-9763-bf2427dc8c65 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:20:07.764926 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 485/969] 10.222.0.18 () {56 vars in 1116 bytes} [Wed Oct 12 02:20:07 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 02:20:09.887301 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c19b02f-b4a4-4cd6-bf92-61497e52d5b3 None None] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:20:09.887802 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c19b02f-b4a4-4cd6-bf92-61497e52d5b3 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:20:09.887895 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c19b02f-b4a4-4cd6-bf92-61497e52d5b3 None None] PATH_INFO: `/` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:20:09.889345 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 485/970] 10.222.0.18 () {54 vars in 927 bytes} [Wed Oct 12 02:20:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 02:20:09.894379 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f22aabe-4455-4e60-8c7a-86d3e5388052 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:20:09.894762 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f22aabe-4455-4e60-8c7a-86d3e5388052 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:20:09.894929 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f22aabe-4455-4e60-8c7a-86d3e5388052 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:20:09.913245 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-3f22aabe-4455-4e60-8c7a-86d3e5388052 None None] MFA Rules not processed for user `a326a5bb7364479382f528a592371656`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:20:09.915044 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-3f22aabe-4455-4e60-8c7a-86d3e5388052 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:20:09.978473 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 486/971] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Oct 12 02:20:09 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 12 02:20:10.267434 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c19b02f-b4a4-4cd6-bf92-61497e52d5b3 None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:20:10.368721 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c19b02f-b4a4-4cd6-bf92-61497e52d5b3 None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:20:10.401576 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb52605-27a0-4d79-93c8-86dde7ff1b68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:20:10.402169 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb52605-27a0-4d79-93c8-86dde7ff1b68 None admin] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:20:10.402444 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb52605-27a0-4d79-93c8-86dde7ff1b68 None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:20:10.402712 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb52605-27a0-4d79-93c8-86dde7ff1b68 None admin] PATH_INFO: `/v3/services` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:20:10.403362 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb52605-27a0-4d79-93c8-86dde7ff1b68 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:20:10.404745 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb52605-27a0-4d79-93c8-86dde7ff1b68 None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:20:10.418693 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 486/972] 10.222.0.18 () {60 vars in 1141 bytes} [Wed Oct 12 02:20:10 2022] POST /identity/v3/services => generated 246 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 02:20:12.561065 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e694a6-9296-41ba-9b11-d8e214ab2260 None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:20:12.561546 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e694a6-9296-41ba-9b11-d8e214ab2260 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:20:12.561647 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e694a6-9296-41ba-9b11-d8e214ab2260 None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:20:12.562938 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 487/973] 10.222.0.18 () {54 vars in 927 bytes} [Wed Oct 12 02:20:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 02:20:12.568303 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a4b7ea-8867-40c2-a38e-e40d2933c9e0 None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:20:12.568721 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a4b7ea-8867-40c2-a38e-e40d2933c9e0 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:20:12.568885 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a4b7ea-8867-40c2-a38e-e40d2933c9e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:20:12.587898 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-b6a4b7ea-8867-40c2-a38e-e40d2933c9e0 None None] MFA Rules not processed for user `a326a5bb7364479382f528a592371656`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:20:12.589129 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-b6a4b7ea-8867-40c2-a38e-e40d2933c9e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:20:12.598178 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:20:12.661839 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 487/974] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Oct 12 02:20:12 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 12 02:20:12.946141 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e694a6-9296-41ba-9b11-d8e214ab2260 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:20:13.040374 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:20:13.050747 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e694a6-9296-41ba-9b11-d8e214ab2260 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:20:13.084039 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02718df-e285-494d-971f-9b97bd229227 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:20:13.084696 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02718df-e285-494d-971f-9b97bd229227 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:20:13.084976 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02718df-e285-494d-971f-9b97bd229227 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:20:13.085244 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02718df-e285-494d-971f-9b97bd229227 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:20:13.085818 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02718df-e285-494d-971f-9b97bd229227 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:20:13.087174 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02718df-e285-494d-971f-9b97bd229227 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:20:13.095745 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-f02718df-e285-494d-971f-9b97bd229227 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Oct 12 02:20:13.095745 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 02:20:13.095745 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 12 02:20:13.095745 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 12 02:20:13.095745 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 12 02:20:13.095745 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 12 02:20:13.095745 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 12 02:20:13.095745 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 12 02:20:13.095745 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 12 02:20:13.095745 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Oct 12 02:20:13.095745 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 12 02:20:13.095745 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Oct 12 02:20:13.095745 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 02:20:13.095745 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 02:20:13.095745 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 02:20:13.095745 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 02:20:13.095745 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 02:20:13.097036 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 02:20:13.097036 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 02:20:13.097036 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 02:20:13.097036 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 02:20:13.097036 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 02:20:13.097036 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 02:20:13.097036 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 12 02:20:13.097036 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 12 02:20:13.097036 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 12 02:20:13.097036 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 12 02:20:13.097036 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 02:20:13.097036 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 02:20:13.097036 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 02:20:13.097036 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 02:20:13.097036 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 02:20:13.097036 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 02:20:13.097978 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 02:20:13.097978 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Oct 12 02:20:13.097978 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 02:20:13.097978 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Oct 12 02:20:13.097978 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 02:20:13.097978 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 02:20:13.097978 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 02:20:13.097978 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Oct 12 02:20:13.097978 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 02:20:13.097978 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Oct 12 02:20:13.097978 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 12 02:20:13.097978 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 12 02:20:13.097978 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 12 02:20:13.097978 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Oct 12 02:20:13.097978 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 488/975] 10.222.0.18 () {56 vars in 1117 bytes} [Wed Oct 12 02:20:12 2022] GET /identity/v3/services/placement => generated 90 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 02:20:13.103488 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a4b7ea-8867-40c2-a38e-e40d2933c9e0 None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:20:13.213982 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a4b7ea-8867-40c2-a38e-e40d2933c9e0 None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:20:13.248252 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a9c3fc-97ab-428e-ae14-2c6d07b750cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:20:13.248883 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a9c3fc-97ab-428e-ae14-2c6d07b750cd None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:20:13.249159 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a9c3fc-97ab-428e-ae14-2c6d07b750cd None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:20:13.249429 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a9c3fc-97ab-428e-ae14-2c6d07b750cd None admin] PATH_INFO: `/v3/services` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:20:13.250053 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a9c3fc-97ab-428e-ae14-2c6d07b750cd None admin] RBAC: Adding query filter params (name=placement) {{(pid=81361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 02:20:13.250355 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a9c3fc-97ab-428e-ae14-2c6d07b750cd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:20:13.251713 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a9c3fc-97ab-428e-ae14-2c6d07b750cd None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:20:13.256673 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 488/976] 10.222.0.18 () {56 vars in 1116 bytes} [Wed Oct 12 02:20:13 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 02:20:13.262642 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02718df-e285-494d-971f-9b97bd229227 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:20:13.359163 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02718df-e285-494d-971f-9b97bd229227 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:20:13.390878 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f17e5b4-87bb-4cc9-8b03-80203aa67c31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:20:13.391461 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f17e5b4-87bb-4cc9-8b03-80203aa67c31 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:20:13.391732 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f17e5b4-87bb-4cc9-8b03-80203aa67c31 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:20:13.391997 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f17e5b4-87bb-4cc9-8b03-80203aa67c31 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:20:13.392709 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f17e5b4-87bb-4cc9-8b03-80203aa67c31 None admin] RBAC: Adding query filter params (interface=public, service_id=092d189ab3f249f69779dd3b5bbbd0fd, region_id=RegionOne) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 02:20:13.393010 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f17e5b4-87bb-4cc9-8b03-80203aa67c31 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:20:13.394348 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f17e5b4-87bb-4cc9-8b03-80203aa67c31 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:20:13.399093 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 489/977] 10.222.0.18 () {56 vars in 1251 bytes} [Wed Oct 12 02:20:13 2022] GET /identity/v3/endpoints?service_id=092d189ab3f249f69779dd3b5bbbd0fd&interface=public®ion_id=RegionOne => generated 194 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 02:20:13.404506 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a9c3fc-97ab-428e-ae14-2c6d07b750cd None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:20:13.408125 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:20:13.503306 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a9c3fc-97ab-428e-ae14-2c6d07b750cd None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:20:13.535548 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcd923b-c690-41c3-bb9d-7b6ec9236dd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:20:13.536139 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcd923b-c690-41c3-bb9d-7b6ec9236dd6 None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:20:13.536417 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcd923b-c690-41c3-bb9d-7b6ec9236dd6 None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:20:13.536713 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcd923b-c690-41c3-bb9d-7b6ec9236dd6 None admin] PATH_INFO: `/v3/services` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:20:13.537407 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dcd923b-c690-41c3-bb9d-7b6ec9236dd6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:20:13.539330 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dcd923b-c690-41c3-bb9d-7b6ec9236dd6 None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:20:13.546030 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 489/978] 10.222.0.18 () {56 vars in 1087 bytes} [Wed Oct 12 02:20:13 2022] GET /identity/v3/services => generated 2191 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 02:20:15.685230 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0530e445-016d-46eb-9e01-c1af98d60b1d None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:20:15.685775 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0530e445-016d-46eb-9e01-c1af98d60b1d None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:20:15.685775 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0530e445-016d-46eb-9e01-c1af98d60b1d None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:20:15.687100 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 490/979] 10.222.0.18 () {54 vars in 927 bytes} [Wed Oct 12 02:20:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 02:20:15.692440 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7bee3f-e97e-49b8-bb72-4eda5310a662 None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:20:15.692862 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7bee3f-e97e-49b8-bb72-4eda5310a662 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:20:15.693021 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7bee3f-e97e-49b8-bb72-4eda5310a662 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:20:15.711990 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-9d7bee3f-e97e-49b8-bb72-4eda5310a662 None None] MFA Rules not processed for user `a326a5bb7364479382f528a592371656`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:20:15.713194 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-9d7bee3f-e97e-49b8-bb72-4eda5310a662 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:20:15.772021 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:20:15.777940 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 490/980] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Oct 12 02:20:15 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 12 02:20:16.044057 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0530e445-016d-46eb-9e01-c1af98d60b1d None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:20:16.063842 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:20:16.151665 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0530e445-016d-46eb-9e01-c1af98d60b1d None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:20:16.191908 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404c043c-6d97-4126-846f-b90c97541d8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:20:16.192623 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404c043c-6d97-4126-846f-b90c97541d8f None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:20:16.192983 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404c043c-6d97-4126-846f-b90c97541d8f None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:20:16.193277 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404c043c-6d97-4126-846f-b90c97541d8f None admin] PATH_INFO: `/v3/services/placement` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:20:16.194063 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404c043c-6d97-4126-846f-b90c97541d8f None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:20:16.195767 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404c043c-6d97-4126-846f-b90c97541d8f None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:20:16.206104 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-404c043c-6d97-4126-846f-b90c97541d8f None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Oct 12 02:20:16.206104 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 02:20:16.206104 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 12 02:20:16.206104 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 12 02:20:16.206104 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 12 02:20:16.206104 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 12 02:20:16.206104 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 12 02:20:16.206104 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 12 02:20:16.206104 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 12 02:20:16.206104 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Oct 12 02:20:16.206104 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 12 02:20:16.206104 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Oct 12 02:20:16.206104 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 02:20:16.206104 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 02:20:16.206104 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 02:20:16.206104 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 02:20:16.206104 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 02:20:16.207185 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 02:20:16.207185 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 02:20:16.207185 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 02:20:16.207185 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 02:20:16.207185 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 02:20:16.207185 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 02:20:16.207185 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 12 02:20:16.207185 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 12 02:20:16.207185 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 12 02:20:16.207185 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 12 02:20:16.207185 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 02:20:16.207185 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 02:20:16.207185 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 02:20:16.207185 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 02:20:16.207185 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 02:20:16.207185 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 02:20:16.208034 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 02:20:16.208034 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Oct 12 02:20:16.208034 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 02:20:16.208034 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Oct 12 02:20:16.208034 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 02:20:16.208034 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 02:20:16.208034 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 02:20:16.208034 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Oct 12 02:20:16.208034 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 02:20:16.208034 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Oct 12 02:20:16.208034 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 12 02:20:16.208034 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 12 02:20:16.208034 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 12 02:20:16.208034 dv-cinder-849143-14-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Oct 12 02:20:16.208034 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 491/981] 10.222.0.18 () {56 vars in 1117 bytes} [Wed Oct 12 02:20:16 2022] GET /identity/v3/services/placement => generated 90 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 02:20:16.214205 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7bee3f-e97e-49b8-bb72-4eda5310a662 None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:20:16.309190 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7bee3f-e97e-49b8-bb72-4eda5310a662 None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:20:16.340817 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d290a5d-a80a-45f6-bee2-f256b0a57a49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:20:16.341404 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d290a5d-a80a-45f6-bee2-f256b0a57a49 None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:20:16.341676 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d290a5d-a80a-45f6-bee2-f256b0a57a49 None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:20:16.341944 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d290a5d-a80a-45f6-bee2-f256b0a57a49 None admin] PATH_INFO: `/v3/services` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:20:16.342559 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d290a5d-a80a-45f6-bee2-f256b0a57a49 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 02:20:16.342854 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d290a5d-a80a-45f6-bee2-f256b0a57a49 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:20:16.344203 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d290a5d-a80a-45f6-bee2-f256b0a57a49 None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:20:16.349093 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 491/982] 10.222.0.18 () {56 vars in 1116 bytes} [Wed Oct 12 02:20:16 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 02:20:16.355439 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404c043c-6d97-4126-846f-b90c97541d8f None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:20:16.435295 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:20:16.452737 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404c043c-6d97-4126-846f-b90c97541d8f None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:20:16.485293 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cf01ff-868d-42b7-94e3-1d0a381b4bbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:20:16.485877 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cf01ff-868d-42b7-94e3-1d0a381b4bbc None admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:20:16.486149 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cf01ff-868d-42b7-94e3-1d0a381b4bbc None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:20:16.486416 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cf01ff-868d-42b7-94e3-1d0a381b4bbc None admin] PATH_INFO: `/v3/endpoints` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:20:16.487073 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6cf01ff-868d-42b7-94e3-1d0a381b4bbc None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:20:16.488407 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6cf01ff-868d-42b7-94e3-1d0a381b4bbc None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:20:16.506563 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 492/983] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Oct 12 02:20:16 2022] POST /identity/v3/endpoints => generated 331 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 02:20:26.346191 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=69 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:20:26.502445 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=30,keystone:INSERT=1 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:21:20.143785 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3c4f99-b00f-4b7b-a663-f63f47c830db None None] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:21:20.144461 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3c4f99-b00f-4b7b-a663-f63f47c830db None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:21:20.144461 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3c4f99-b00f-4b7b-a663-f63f47c830db None None] PATH_INFO: `/` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:21:20.145972 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 492/984] 10.222.0.18 () {54 vars in 927 bytes} [Wed Oct 12 02:21:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 12 02:21:20.155105 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49e7f20-401c-4a24-82d9-47a722287311 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:21:20.156325 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49e7f20-401c-4a24-82d9-47a722287311 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:21:20.157126 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49e7f20-401c-4a24-82d9-47a722287311 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:21:20.281996 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-f49e7f20-401c-4a24-82d9-47a722287311 None None] MFA Rules not processed for user `a326a5bb7364479382f528a592371656`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:21:20.283387 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-f49e7f20-401c-4a24-82d9-47a722287311 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:21:20.400520 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 493/985] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Oct 12 02:21:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 02:21:20.696182 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd77d7ec-859b-4bee-9385-8c1f6d4ed7c7 None None] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:21:20.696561 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd77d7ec-859b-4bee-9385-8c1f6d4ed7c7 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:21:20.696767 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd77d7ec-859b-4bee-9385-8c1f6d4ed7c7 None None] PATH_INFO: `/` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:21:20.698331 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 493/986] 10.222.0.18 () {54 vars in 964 bytes} [Wed Oct 12 02:21:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 02:21:20.705875 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be894314-a9d3-4f59-a07a-92d7a316ce91 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:21:20.706516 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be894314-a9d3-4f59-a07a-92d7a316ce91 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:21:20.707016 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be894314-a9d3-4f59-a07a-92d7a316ce91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:21:20.798144 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-be894314-a9d3-4f59-a07a-92d7a316ce91 None None] MFA Rules not processed for user `5223b5cab3114e9b9a13c582f8ef8386`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:21:20.800133 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-be894314-a9d3-4f59-a07a-92d7a316ce91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:21:20.821794 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:21:20.881458 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 494/987] 10.222.0.18 () {58 vars in 1061 bytes} [Wed Oct 12 02:21:20 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 02:21:20.890244 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd77d7ec-859b-4bee-9385-8c1f6d4ed7c7 None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:21:20.892106 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-fd77d7ec-859b-4bee-9385-8c1f6d4ed7c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:21:21.009196 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd77d7ec-859b-4bee-9385-8c1f6d4ed7c7 None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:21:21.109496 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0720220-01ff-4096-8258-9af16433e257 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5223b5cab3114e9b9a13c582f8ef8386', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'beb6def6fcad45959e56425bb8bff4d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:21:21.110024 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0720220-01ff-4096-8258-9af16433e257 service neutron] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:21:21.110298 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0720220-01ff-4096-8258-9af16433e257 service neutron] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:21:21.110565 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0720220-01ff-4096-8258-9af16433e257 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:21:21.112320 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-d0720220-01ff-4096-8258-9af16433e257 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:21:21.180777 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:21:21.252909 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0720220-01ff-4096-8258-9af16433e257 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:21:21.255415 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0720220-01ff-4096-8258-9af16433e257 service neutron] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:21:21.276854 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 494/988] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 02:21:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 02:21:23.845095 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe274737-c9ba-442a-8ac9-78acf09cc9a9 None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:21:23.846219 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe274737-c9ba-442a-8ac9-78acf09cc9a9 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:21:23.846310 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe274737-c9ba-442a-8ac9-78acf09cc9a9 None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:21:23.847613 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 495/989] 10.222.0.18 () {54 vars in 927 bytes} [Wed Oct 12 02:21:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 02:21:23.852919 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f620b80d-d73c-4ec6-9926-ea3ad25976c8 None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:21:23.853293 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f620b80d-d73c-4ec6-9926-ea3ad25976c8 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:21:23.853413 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f620b80d-d73c-4ec6-9926-ea3ad25976c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:21:23.929706 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-f620b80d-d73c-4ec6-9926-ea3ad25976c8 None None] MFA Rules not processed for user `a326a5bb7364479382f528a592371656`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:21:23.930966 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-f620b80d-d73c-4ec6-9926-ea3ad25976c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:21:24.030927 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 495/990] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Oct 12 02:21:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 02:21:24.323807 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe274737-c9ba-442a-8ac9-78acf09cc9a9 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:21:24.325383 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-fe274737-c9ba-442a-8ac9-78acf09cc9a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:21:24.429470 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe274737-c9ba-442a-8ac9-78acf09cc9a9 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:21:24.499315 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:21:24.502209 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d319b3-c1f5-4960-b1a5-0e977364ea6e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5223b5cab3114e9b9a13c582f8ef8386', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'beb6def6fcad45959e56425bb8bff4d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:21:24.502885 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d319b3-c1f5-4960-b1a5-0e977364ea6e service neutron] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:21:24.503371 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d319b3-c1f5-4960-b1a5-0e977364ea6e service neutron] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:21:24.503824 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d319b3-c1f5-4960-b1a5-0e977364ea6e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:21:24.505642 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-81d319b3-c1f5-4960-b1a5-0e977364ea6e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:21:24.614188 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d319b3-c1f5-4960-b1a5-0e977364ea6e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:21:24.615617 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d319b3-c1f5-4960-b1a5-0e977364ea6e service neutron] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:21:24.633511 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 496/991] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 02:21:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 02:21:27.080063 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7b7a39-de8e-4cae-a4ab-6feb0582c259 None None] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:21:27.080700 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7b7a39-de8e-4cae-a4ab-6feb0582c259 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:21:27.080700 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7b7a39-de8e-4cae-a4ab-6feb0582c259 None None] PATH_INFO: `/` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:21:27.081996 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 496/992] 10.222.0.18 () {54 vars in 927 bytes} [Wed Oct 12 02:21:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 02:21:27.087162 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f192e162-f0a7-41ed-8e6a-9bc996e98ca0 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:21:27.087573 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f192e162-f0a7-41ed-8e6a-9bc996e98ca0 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:21:27.087712 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f192e162-f0a7-41ed-8e6a-9bc996e98ca0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:21:27.153318 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-f192e162-f0a7-41ed-8e6a-9bc996e98ca0 None None] MFA Rules not processed for user `0b038ba692d94cff9a2a3042ea6f6922`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:21:27.154513 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-f192e162-f0a7-41ed-8e6a-9bc996e98ca0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:21:27.208286 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:21:27.252562 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 497/993] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Oct 12 02:21:27 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 02:21:27.542326 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7b7a39-de8e-4cae-a4ab-6feb0582c259 None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:21:27.543894 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-4b7b7a39-de8e-4cae-a4ab-6feb0582c259 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:21:27.554545 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:21:27.648116 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7b7a39-de8e-4cae-a4ab-6feb0582c259 None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:21:27.719774 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e955b976-5868-4afb-a58f-e6b4ca9c0f1f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5223b5cab3114e9b9a13c582f8ef8386', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'beb6def6fcad45959e56425bb8bff4d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:21:27.720406 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e955b976-5868-4afb-a58f-e6b4ca9c0f1f service neutron] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:21:27.720715 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e955b976-5868-4afb-a58f-e6b4ca9c0f1f service neutron] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:21:27.720987 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e955b976-5868-4afb-a58f-e6b4ca9c0f1f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:21:27.722571 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-e955b976-5868-4afb-a58f-e6b4ca9c0f1f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:21:27.789299 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:21:27.837260 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e955b976-5868-4afb-a58f-e6b4ca9c0f1f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:21:27.838701 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e955b976-5868-4afb-a58f-e6b4ca9c0f1f service neutron] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:21:27.856407 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 497/994] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 02:21:27 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 02:21:30.541271 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b2eec2-af96-43e3-b6ea-061199d4b395 None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:21:30.541740 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b2eec2-af96-43e3-b6ea-061199d4b395 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:21:30.541858 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b2eec2-af96-43e3-b6ea-061199d4b395 None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:21:30.543131 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 498/995] 10.222.0.18 () {54 vars in 927 bytes} [Wed Oct 12 02:21:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 02:21:30.548963 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2568aad-74e4-4a10-8857-dada3cd0fba7 None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:21:30.549344 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2568aad-74e4-4a10-8857-dada3cd0fba7 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:21:30.549510 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2568aad-74e4-4a10-8857-dada3cd0fba7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:21:30.614154 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-f2568aad-74e4-4a10-8857-dada3cd0fba7 None None] MFA Rules not processed for user `a326a5bb7364479382f528a592371656`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:21:30.615336 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-f2568aad-74e4-4a10-8857-dada3cd0fba7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:21:30.707681 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 498/996] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Oct 12 02:21:30 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 02:21:30.992555 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b2eec2-af96-43e3-b6ea-061199d4b395 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:21:30.994113 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-e6b2eec2-af96-43e3-b6ea-061199d4b395 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:21:31.100758 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b2eec2-af96-43e3-b6ea-061199d4b395 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:21:31.178203 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fd95fb-ae35-41c0-b81a-163412beba05 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5223b5cab3114e9b9a13c582f8ef8386', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'beb6def6fcad45959e56425bb8bff4d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:21:31.178816 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fd95fb-ae35-41c0-b81a-163412beba05 service neutron] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:21:31.179095 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fd95fb-ae35-41c0-b81a-163412beba05 service neutron] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:21:31.179366 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fd95fb-ae35-41c0-b81a-163412beba05 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:21:31.181009 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-b0fd95fb-ae35-41c0-b81a-163412beba05 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:21:31.188122 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:21:31.292973 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fd95fb-ae35-41c0-b81a-163412beba05 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:21:31.294318 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fd95fb-ae35-41c0-b81a-163412beba05 service neutron] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:21:31.313836 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 499/997] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 02:21:30 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 02:21:34.097893 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b943f31c-a781-4121-87ff-14458735581d None None] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:21:34.098417 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b943f31c-a781-4121-87ff-14458735581d None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:21:34.098417 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b943f31c-a781-4121-87ff-14458735581d None None] PATH_INFO: `/` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:21:34.099770 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 499/998] 10.222.0.18 () {54 vars in 927 bytes} [Wed Oct 12 02:21:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 02:21:34.105352 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2df0b0d-bf98-401f-9aa5-05688f67ae2d None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:21:34.105734 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2df0b0d-bf98-401f-9aa5-05688f67ae2d None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:21:34.105938 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2df0b0d-bf98-401f-9aa5-05688f67ae2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:21:34.177644 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-c2df0b0d-bf98-401f-9aa5-05688f67ae2d None None] MFA Rules not processed for user `a326a5bb7364479382f528a592371656`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:21:34.178896 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-c2df0b0d-bf98-401f-9aa5-05688f67ae2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:21:34.243482 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:21:34.288590 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 500/999] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Oct 12 02:21:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 02:21:34.586864 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a16d050-6e62-46a4-9881-aa7d8f0e2e22 None None] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:21:34.587060 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a16d050-6e62-46a4-9881-aa7d8f0e2e22 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:21:34.587316 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a16d050-6e62-46a4-9881-aa7d8f0e2e22 None None] PATH_INFO: `/` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:21:34.588703 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 500/1000] 10.222.0.18 () {54 vars in 964 bytes} [Wed Oct 12 02:21:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 02:21:34.595088 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d9aa48-8d82-4750-a759-afe45f727b15 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:21:34.595381 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d9aa48-8d82-4750-a759-afe45f727b15 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:21:34.595653 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d9aa48-8d82-4750-a759-afe45f727b15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:21:34.671429 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-20d9aa48-8d82-4750-a759-afe45f727b15 None None] MFA Rules not processed for user `5223b5cab3114e9b9a13c582f8ef8386`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:21:34.672675 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-20d9aa48-8d82-4750-a759-afe45f727b15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:21:34.747472 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 501/1001] 10.222.0.18 () {58 vars in 1061 bytes} [Wed Oct 12 02:21:34 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 02:21:34.756490 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a16d050-6e62-46a4-9881-aa7d8f0e2e22 None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:21:34.758100 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-4a16d050-6e62-46a4-9881-aa7d8f0e2e22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:21:34.778311 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:21:34.862860 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a16d050-6e62-46a4-9881-aa7d8f0e2e22 None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:21:34.936440 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917b17b5-33c6-4a1a-87f0-ca35268f7a63 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5223b5cab3114e9b9a13c582f8ef8386', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'beb6def6fcad45959e56425bb8bff4d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:21:34.937069 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917b17b5-33c6-4a1a-87f0-ca35268f7a63 service neutron] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:21:34.937344 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917b17b5-33c6-4a1a-87f0-ca35268f7a63 service neutron] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:21:34.937612 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917b17b5-33c6-4a1a-87f0-ca35268f7a63 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:21:34.939854 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-917b17b5-33c6-4a1a-87f0-ca35268f7a63 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:21:35.010169 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:21:35.047597 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917b17b5-33c6-4a1a-87f0-ca35268f7a63 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:21:35.049069 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917b17b5-33c6-4a1a-87f0-ca35268f7a63 service neutron] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:21:35.067693 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 501/1002] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 02:21:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 02:21:37.519752 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e44093d-0ee0-4489-a50c-44626c6a172f None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:21:37.520252 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e44093d-0ee0-4489-a50c-44626c6a172f None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:21:37.520252 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e44093d-0ee0-4489-a50c-44626c6a172f None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:21:37.521583 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 502/1003] 10.222.0.18 () {54 vars in 927 bytes} [Wed Oct 12 02:21:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 02:21:37.526996 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef04c152-cdb4-46af-b1e9-b1fe145f2647 None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:21:37.527462 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef04c152-cdb4-46af-b1e9-b1fe145f2647 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:21:37.527612 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef04c152-cdb4-46af-b1e9-b1fe145f2647 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:21:37.596356 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-ef04c152-cdb4-46af-b1e9-b1fe145f2647 None None] MFA Rules not processed for user `a326a5bb7364479382f528a592371656`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:21:37.597597 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-ef04c152-cdb4-46af-b1e9-b1fe145f2647 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:21:37.694888 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 502/1004] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Oct 12 02:21:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 02:21:37.987150 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e44093d-0ee0-4489-a50c-44626c6a172f None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:21:37.988696 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-6e44093d-0ee0-4489-a50c-44626c6a172f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:21:38.049286 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:21:38.093455 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e44093d-0ee0-4489-a50c-44626c6a172f None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:21:38.171085 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98f95fa-434c-461e-b7ab-f4b3e4e903d2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5223b5cab3114e9b9a13c582f8ef8386', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'beb6def6fcad45959e56425bb8bff4d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:21:38.171687 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98f95fa-434c-461e-b7ab-f4b3e4e903d2 service neutron] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:21:38.171960 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98f95fa-434c-461e-b7ab-f4b3e4e903d2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:21:38.172376 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98f95fa-434c-461e-b7ab-f4b3e4e903d2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:21:38.174496 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-c98f95fa-434c-461e-b7ab-f4b3e4e903d2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:21:38.283108 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:21:38.285238 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98f95fa-434c-461e-b7ab-f4b3e4e903d2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:21:38.286978 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98f95fa-434c-461e-b7ab-f4b3e4e903d2 service neutron] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:21:38.304817 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 503/1005] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 02:21:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 02:21:40.529918 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19807349-ca05-458c-8c5e-60919042df53 None None] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:21:40.530449 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19807349-ca05-458c-8c5e-60919042df53 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:21:40.530449 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19807349-ca05-458c-8c5e-60919042df53 None None] PATH_INFO: `/` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:21:40.531917 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 503/1006] 10.222.0.18 () {54 vars in 927 bytes} [Wed Oct 12 02:21:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 02:21:40.537736 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d694291-a39c-4663-9b23-6472ed633537 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:21:40.538216 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d694291-a39c-4663-9b23-6472ed633537 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:21:40.538316 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d694291-a39c-4663-9b23-6472ed633537 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:21:40.609465 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-5d694291-a39c-4663-9b23-6472ed633537 None None] MFA Rules not processed for user `0b038ba692d94cff9a2a3042ea6f6922`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:21:40.611254 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-5d694291-a39c-4663-9b23-6472ed633537 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:21:40.706839 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 504/1007] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Oct 12 02:21:40 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 02:21:40.990526 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19807349-ca05-458c-8c5e-60919042df53 None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:21:40.992045 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-19807349-ca05-458c-8c5e-60919042df53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:21:41.023877 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:21:41.099851 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19807349-ca05-458c-8c5e-60919042df53 None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:21:41.175196 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d69269-91a6-4ad8-bd86-0309d5113e29 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5223b5cab3114e9b9a13c582f8ef8386', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'beb6def6fcad45959e56425bb8bff4d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:21:41.175802 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d69269-91a6-4ad8-bd86-0309d5113e29 service neutron] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:21:41.176076 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d69269-91a6-4ad8-bd86-0309d5113e29 service neutron] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:21:41.176343 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d69269-91a6-4ad8-bd86-0309d5113e29 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:21:41.178002 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-38d69269-91a6-4ad8-bd86-0309d5113e29 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:21:41.258094 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:21:41.292108 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d69269-91a6-4ad8-bd86-0309d5113e29 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:21:41.293596 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d69269-91a6-4ad8-bd86-0309d5113e29 service neutron] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:21:41.314591 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 504/1008] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 02:21:40 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 02:21:43.714818 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279acb82-e99b-4e50-92c5-eab4e11ddbfd None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:21:43.715401 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279acb82-e99b-4e50-92c5-eab4e11ddbfd None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:21:43.715401 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279acb82-e99b-4e50-92c5-eab4e11ddbfd None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:21:43.716733 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 505/1009] 10.222.0.18 () {54 vars in 927 bytes} [Wed Oct 12 02:21:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 02:21:43.722473 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead8a9f9-2382-4847-9d06-6c04f060817d None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:21:43.722869 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead8a9f9-2382-4847-9d06-6c04f060817d None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:21:43.723010 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead8a9f9-2382-4847-9d06-6c04f060817d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:21:43.787329 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-ead8a9f9-2382-4847-9d06-6c04f060817d None None] MFA Rules not processed for user `a326a5bb7364479382f528a592371656`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:21:43.788591 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-ead8a9f9-2382-4847-9d06-6c04f060817d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:21:43.882823 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 505/1010] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Oct 12 02:21:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 02:21:44.167711 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279acb82-e99b-4e50-92c5-eab4e11ddbfd None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:21:44.169268 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-279acb82-e99b-4e50-92c5-eab4e11ddbfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:21:44.243268 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:21:44.280417 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279acb82-e99b-4e50-92c5-eab4e11ddbfd None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:21:44.354232 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67dddc4c-ff2b-4c3a-815e-8036b41c030e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5223b5cab3114e9b9a13c582f8ef8386', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'beb6def6fcad45959e56425bb8bff4d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:21:44.354832 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dddc4c-ff2b-4c3a-815e-8036b41c030e service neutron] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:21:44.355108 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dddc4c-ff2b-4c3a-815e-8036b41c030e service neutron] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:21:44.355378 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dddc4c-ff2b-4c3a-815e-8036b41c030e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:21:44.357000 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-67dddc4c-ff2b-4c3a-815e-8036b41c030e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:21:44.463512 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67dddc4c-ff2b-4c3a-815e-8036b41c030e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:21:44.464901 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67dddc4c-ff2b-4c3a-815e-8036b41c030e service neutron] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:21:44.475320 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:21:44.483857 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 506/1011] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 02:21:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 02:21:46.665144 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66625f32-0b99-480f-9ff6-e3bf537bae1d None None] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:21:46.665719 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66625f32-0b99-480f-9ff6-e3bf537bae1d None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:21:46.665719 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66625f32-0b99-480f-9ff6-e3bf537bae1d None None] PATH_INFO: `/` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:21:46.667029 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 506/1012] 10.222.0.18 () {54 vars in 927 bytes} [Wed Oct 12 02:21:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 02:21:46.672942 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a124fac-ca5b-41e2-b2c6-dcd29fe7ed83 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:21:46.673368 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a124fac-ca5b-41e2-b2c6-dcd29fe7ed83 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:21:46.673525 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a124fac-ca5b-41e2-b2c6-dcd29fe7ed83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:21:46.740948 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-2a124fac-ca5b-41e2-b2c6-dcd29fe7ed83 None None] MFA Rules not processed for user `a326a5bb7364479382f528a592371656`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:21:46.742172 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-2a124fac-ca5b-41e2-b2c6-dcd29fe7ed83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:21:46.839220 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 507/1013] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Oct 12 02:21:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 02:21:47.123843 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66625f32-0b99-480f-9ff6-e3bf537bae1d None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:21:47.125501 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-66625f32-0b99-480f-9ff6-e3bf537bae1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:21:47.165460 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:21:47.227774 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66625f32-0b99-480f-9ff6-e3bf537bae1d None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:21:47.301947 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc9c301-1598-49dd-a0c6-421bc248b0d6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5223b5cab3114e9b9a13c582f8ef8386', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'beb6def6fcad45959e56425bb8bff4d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:21:47.302548 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc9c301-1598-49dd-a0c6-421bc248b0d6 service neutron] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:21:47.302825 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc9c301-1598-49dd-a0c6-421bc248b0d6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:21:47.303097 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc9c301-1598-49dd-a0c6-421bc248b0d6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:21:47.304712 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-4bc9c301-1598-49dd-a0c6-421bc248b0d6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:21:47.390325 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:21:47.416176 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc9c301-1598-49dd-a0c6-421bc248b0d6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:21:47.417646 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc9c301-1598-49dd-a0c6-421bc248b0d6 service neutron] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:21:47.436225 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 507/1014] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 02:21:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 02:21:49.899535 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f75062-bb19-43cf-8007-5ffce5037146 None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:21:49.900073 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f75062-bb19-43cf-8007-5ffce5037146 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:21:49.900073 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f75062-bb19-43cf-8007-5ffce5037146 None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:21:49.901454 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 508/1015] 10.222.0.18 () {54 vars in 927 bytes} [Wed Oct 12 02:21:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 02:21:49.907010 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e9950b-76a5-41b7-8487-98be9d42407c None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:21:49.907403 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e9950b-76a5-41b7-8487-98be9d42407c None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:21:49.907545 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e9950b-76a5-41b7-8487-98be9d42407c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:21:49.971434 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-40e9950b-76a5-41b7-8487-98be9d42407c None None] MFA Rules not processed for user `a326a5bb7364479382f528a592371656`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:21:49.972650 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-40e9950b-76a5-41b7-8487-98be9d42407c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:21:50.067727 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 508/1016] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Oct 12 02:21:49 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 02:21:50.352078 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f75062-bb19-43cf-8007-5ffce5037146 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:21:50.353929 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-d0f75062-bb19-43cf-8007-5ffce5037146 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:21:50.428920 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:21:50.456721 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f75062-bb19-43cf-8007-5ffce5037146 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:21:50.532893 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3bf7f1-0e83-4463-ad4e-af8d2b637e71 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5223b5cab3114e9b9a13c582f8ef8386', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'beb6def6fcad45959e56425bb8bff4d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:21:50.533446 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3bf7f1-0e83-4463-ad4e-af8d2b637e71 service neutron] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:21:50.533723 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3bf7f1-0e83-4463-ad4e-af8d2b637e71 service neutron] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:21:50.534058 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3bf7f1-0e83-4463-ad4e-af8d2b637e71 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:21:50.535823 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-fe3bf7f1-0e83-4463-ad4e-af8d2b637e71 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:21:50.645080 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3bf7f1-0e83-4463-ad4e-af8d2b637e71 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:21:50.646541 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3bf7f1-0e83-4463-ad4e-af8d2b637e71 service neutron] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:21:50.664087 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 509/1017] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 02:21:50 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 02:21:54.708013 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619e2caf-1d9c-4a96-b302-66da7e038924 None None] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:21:54.708539 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619e2caf-1d9c-4a96-b302-66da7e038924 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:21:54.708539 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619e2caf-1d9c-4a96-b302-66da7e038924 None None] PATH_INFO: `/` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:21:54.710144 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 509/1018] 10.222.0.18 () {54 vars in 927 bytes} [Wed Oct 12 02:21:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 02:21:54.715133 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb7c39d-4df8-4edb-8d9f-e6cc8674bb95 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:21:54.715528 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb7c39d-4df8-4edb-8d9f-e6cc8674bb95 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:21:54.715683 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb7c39d-4df8-4edb-8d9f-e6cc8674bb95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:21:54.721335 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:21:54.783438 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-bbb7c39d-4df8-4edb-8d9f-e6cc8674bb95 None None] MFA Rules not processed for user `a326a5bb7364479382f528a592371656`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:21:54.784582 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-bbb7c39d-4df8-4edb-8d9f-e6cc8674bb95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:21:54.884895 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 510/1019] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Oct 12 02:21:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 02:21:55.177798 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619e2caf-1d9c-4a96-b302-66da7e038924 None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:21:55.179786 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-619e2caf-1d9c-4a96-b302-66da7e038924 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:21:55.230812 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:21:55.286494 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619e2caf-1d9c-4a96-b302-66da7e038924 None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:21:55.360449 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b15dea-1ed5-4759-8b15-650ce648c7e8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5223b5cab3114e9b9a13c582f8ef8386', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'beb6def6fcad45959e56425bb8bff4d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:21:55.361077 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b15dea-1ed5-4759-8b15-650ce648c7e8 service neutron] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:21:55.361356 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b15dea-1ed5-4759-8b15-650ce648c7e8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:21:55.361627 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b15dea-1ed5-4759-8b15-650ce648c7e8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:21:55.363223 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-f9b15dea-1ed5-4759-8b15-650ce648c7e8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:21:55.457798 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:21:55.476023 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b15dea-1ed5-4759-8b15-650ce648c7e8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:21:55.477494 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b15dea-1ed5-4759-8b15-650ce648c7e8 service neutron] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:21:55.497384 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 510/1020] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 02:21:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 02:21:58.306480 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c819a66d-de3d-4c46-bd90-e233565f1e51 None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:21:58.307043 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c819a66d-de3d-4c46-bd90-e233565f1e51 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:21:58.307043 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c819a66d-de3d-4c46-bd90-e233565f1e51 None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:21:58.308587 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 511/1021] 10.222.0.18 () {54 vars in 927 bytes} [Wed Oct 12 02:21:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 02:21:58.313725 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a604c98b-2b7d-4b17-873f-2e8e857273cd None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:21:58.314120 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a604c98b-2b7d-4b17-873f-2e8e857273cd None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:21:58.314269 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a604c98b-2b7d-4b17-873f-2e8e857273cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:21:58.380624 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-a604c98b-2b7d-4b17-873f-2e8e857273cd None None] MFA Rules not processed for user `a326a5bb7364479382f528a592371656`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:21:58.381833 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-a604c98b-2b7d-4b17-873f-2e8e857273cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:21:58.477423 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 511/1022] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Oct 12 02:21:58 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 02:21:58.763430 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c819a66d-de3d-4c46-bd90-e233565f1e51 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:21:58.765531 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-c819a66d-de3d-4c46-bd90-e233565f1e51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:21:58.854958 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:21:58.874884 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c819a66d-de3d-4c46-bd90-e233565f1e51 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:21:58.948845 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db21eae-b8a7-4ecb-863b-b44c8b2ab628 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5223b5cab3114e9b9a13c582f8ef8386', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'beb6def6fcad45959e56425bb8bff4d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:21:58.949449 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db21eae-b8a7-4ecb-863b-b44c8b2ab628 service neutron] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:21:58.949721 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db21eae-b8a7-4ecb-863b-b44c8b2ab628 service neutron] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:21:58.949986 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db21eae-b8a7-4ecb-863b-b44c8b2ab628 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:21:58.951552 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-4db21eae-b8a7-4ecb-863b-b44c8b2ab628 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:21:59.063091 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db21eae-b8a7-4ecb-863b-b44c8b2ab628 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:21:59.064448 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db21eae-b8a7-4ecb-863b-b44c8b2ab628 service neutron] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:21:59.083936 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 512/1023] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 02:21:58 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 02:22:03.796766 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ff2e92-dc8a-49a3-b676-38ad3b4c6847 None None] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:22:03.797299 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ff2e92-dc8a-49a3-b676-38ad3b4c6847 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:22:03.797299 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ff2e92-dc8a-49a3-b676-38ad3b4c6847 None None] PATH_INFO: `/` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:22:03.798930 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 512/1024] 10.222.0.18 () {54 vars in 927 bytes} [Wed Oct 12 02:22:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 02:22:03.804317 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d6fae8-277b-4229-ab36-b6d6f84c70bf None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:22:03.804787 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d6fae8-277b-4229-ab36-b6d6f84c70bf None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:22:03.804877 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d6fae8-277b-4229-ab36-b6d6f84c70bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:22:03.820443 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:22:03.881884 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-b2d6fae8-277b-4229-ab36-b6d6f84c70bf None None] MFA Rules not processed for user `a326a5bb7364479382f528a592371656`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:22:03.883974 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-b2d6fae8-277b-4229-ab36-b6d6f84c70bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:22:03.989202 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 513/1025] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Oct 12 02:22:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 02:22:04.283558 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ff2e92-dc8a-49a3-b676-38ad3b4c6847 None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:22:04.285136 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-b1ff2e92-dc8a-49a3-b676-38ad3b4c6847 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:22:04.343433 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:22:04.389865 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ff2e92-dc8a-49a3-b676-38ad3b4c6847 None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:22:04.462155 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e24a1f-3bef-4dba-88a1-a2dd3ac8fae7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5223b5cab3114e9b9a13c582f8ef8386', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'beb6def6fcad45959e56425bb8bff4d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:22:04.462751 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e24a1f-3bef-4dba-88a1-a2dd3ac8fae7 service neutron] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:22:04.463030 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e24a1f-3bef-4dba-88a1-a2dd3ac8fae7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:22:04.463304 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e24a1f-3bef-4dba-88a1-a2dd3ac8fae7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:22:04.464928 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-60e24a1f-3bef-4dba-88a1-a2dd3ac8fae7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:22:04.572509 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:22:04.576726 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e24a1f-3bef-4dba-88a1-a2dd3ac8fae7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:22:04.578276 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e24a1f-3bef-4dba-88a1-a2dd3ac8fae7 service neutron] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:22:04.596285 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 513/1026] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 02:22:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 02:22:09.489789 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701457d6-8ff9-44fc-810f-5d6c19b79f29 None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:22:09.490192 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701457d6-8ff9-44fc-810f-5d6c19b79f29 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:22:09.490271 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701457d6-8ff9-44fc-810f-5d6c19b79f29 None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:22:09.491731 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 514/1027] 10.222.0.18 () {54 vars in 921 bytes} [Wed Oct 12 02:22:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 02:22:09.497548 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3967e2-00b5-47d6-b820-0225c5285bd0 None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:22:09.498556 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3967e2-00b5-47d6-b820-0225c5285bd0 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:22:09.498955 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3967e2-00b5-47d6-b820-0225c5285bd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:22:09.660640 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-8e3967e2-00b5-47d6-b820-0225c5285bd0 None None] MFA Rules not processed for user `a58b9e0467c040638c3d43e3ac9c0495`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:22:09.662054 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-8e3967e2-00b5-47d6-b820-0225c5285bd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:22:09.790770 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 514/1028] 10.222.0.18 () {58 vars in 1018 bytes} [Wed Oct 12 02:22:09 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 294 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 02:22:13.987588 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=59 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:22:14.031910 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cf0dc4-f4ec-46f9-a028-7624b1417a60 None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:22:14.032310 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cf0dc4-f4ec-46f9-a028-7624b1417a60 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:22:14.032444 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cf0dc4-f4ec-46f9-a028-7624b1417a60 None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:22:14.033979 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 515/1029] 10.222.0.18 () {54 vars in 921 bytes} [Wed Oct 12 02:22:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 02:22:14.038961 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d439909a-006f-4a89-b151-1dc5883bd756 None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:22:14.039472 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d439909a-006f-4a89-b151-1dc5883bd756 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:22:14.039755 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d439909a-006f-4a89-b151-1dc5883bd756 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:22:14.097303 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:22:14.123154 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-d439909a-006f-4a89-b151-1dc5883bd756 None None] MFA Rules not processed for user `a58b9e0467c040638c3d43e3ac9c0495`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:22:14.124621 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-d439909a-006f-4a89-b151-1dc5883bd756 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:22:14.245484 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 515/1030] 10.222.0.18 () {58 vars in 1018 bytes} [Wed Oct 12 02:22:14 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 02:22:15.397275 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7942dbf-bfaa-4b82-b7df-cb37dac6ed61 None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:22:15.397847 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7942dbf-bfaa-4b82-b7df-cb37dac6ed61 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:22:15.397847 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7942dbf-bfaa-4b82-b7df-cb37dac6ed61 None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:22:15.399134 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 516/1031] 10.222.0.18 () {54 vars in 921 bytes} [Wed Oct 12 02:22:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 02:22:15.404422 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255c2e28-67f8-4d6d-afcb-d11901c84ffe None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:22:15.404844 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255c2e28-67f8-4d6d-afcb-d11901c84ffe None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:22:15.405056 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255c2e28-67f8-4d6d-afcb-d11901c84ffe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:22:15.486995 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-255c2e28-67f8-4d6d-afcb-d11901c84ffe None None] MFA Rules not processed for user `a58b9e0467c040638c3d43e3ac9c0495`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:22:15.488228 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-255c2e28-67f8-4d6d-afcb-d11901c84ffe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:22:15.532014 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:22:15.601230 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 516/1032] 10.222.0.18 () {58 vars in 1018 bytes} [Wed Oct 12 02:22:15 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 02:22:19.217792 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f78a115-90b3-43d0-8307-bf7edd7dbac7 None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:22:19.218622 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f78a115-90b3-43d0-8307-bf7edd7dbac7 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:22:19.219068 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f78a115-90b3-43d0-8307-bf7edd7dbac7 None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:22:19.220866 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 517/1033] 10.222.0.18 () {54 vars in 927 bytes} [Wed Oct 12 02:22:19 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 02:22:19.226569 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca6ffae-9901-4680-a112-bd2c370310a9 None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:22:19.227612 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca6ffae-9901-4680-a112-bd2c370310a9 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:22:19.227893 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca6ffae-9901-4680-a112-bd2c370310a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:22:19.302296 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-cca6ffae-9901-4680-a112-bd2c370310a9 None None] MFA Rules not processed for user `a326a5bb7364479382f528a592371656`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:22:19.303528 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-cca6ffae-9901-4680-a112-bd2c370310a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:22:19.405987 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 517/1034] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Oct 12 02:22:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 02:22:19.720983 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c95effc-4c30-4a3a-8786-f6a78778c338 None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:22:19.721818 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c95effc-4c30-4a3a-8786-f6a78778c338 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:22:19.722396 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c95effc-4c30-4a3a-8786-f6a78778c338 None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:22:19.724072 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 518/1035] 10.222.0.18 () {54 vars in 961 bytes} [Wed Oct 12 02:22:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 02:22:19.733225 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649af885-4e28-42d3-b368-55d78deab80c None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:22:19.734099 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649af885-4e28-42d3-b368-55d78deab80c None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:22:19.734612 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649af885-4e28-42d3-b368-55d78deab80c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:22:19.756489 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:22:19.832198 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-649af885-4e28-42d3-b368-55d78deab80c None None] MFA Rules not processed for user `f2fca96c111b45b795fb757f77908ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:22:19.833461 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-649af885-4e28-42d3-b368-55d78deab80c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:22:19.955925 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 518/1036] 10.222.0.18 () {58 vars in 1058 bytes} [Wed Oct 12 02:22:19 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 02:22:19.963516 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c95effc-4c30-4a3a-8786-f6a78778c338 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:22:19.965079 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-6c95effc-4c30-4a3a-8786-f6a78778c338 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:22:20.121822 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c95effc-4c30-4a3a-8786-f6a78778c338 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:22:20.199410 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:22:20.247302 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870752e3-f0c4-46d3-9cb6-97e57f2397de service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fca96c111b45b795fb757f77908ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'beb6def6fcad45959e56425bb8bff4d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:22:20.247971 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870752e3-f0c4-46d3-9cb6-97e57f2397de service nova] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:22:20.248149 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870752e3-f0c4-46d3-9cb6-97e57f2397de service nova] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:22:20.248668 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870752e3-f0c4-46d3-9cb6-97e57f2397de service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:22:20.250558 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-870752e3-f0c4-46d3-9cb6-97e57f2397de service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:22:20.347582 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870752e3-f0c4-46d3-9cb6-97e57f2397de service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:22:20.349211 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870752e3-f0c4-46d3-9cb6-97e57f2397de service nova] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:22:20.371007 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 519/1037] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 02:22:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 02:22:22.777737 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0427e41-e941-478a-8b44-d4d2e7526b55 None None] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:22:22.779034 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0427e41-e941-478a-8b44-d4d2e7526b55 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:22:22.779034 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0427e41-e941-478a-8b44-d4d2e7526b55 None None] PATH_INFO: `/` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:22:22.780378 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 519/1038] 10.222.0.18 () {54 vars in 927 bytes} [Wed Oct 12 02:22:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 02:22:22.796882 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e21a8c-b8bc-4225-b5f4-1c3ccf57fc74 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:22:22.797384 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e21a8c-b8bc-4225-b5f4-1c3ccf57fc74 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:22:22.797904 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e21a8c-b8bc-4225-b5f4-1c3ccf57fc74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:22:22.882844 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-61e21a8c-b8bc-4225-b5f4-1c3ccf57fc74 None None] MFA Rules not processed for user `a326a5bb7364479382f528a592371656`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:22:22.884231 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-61e21a8c-b8bc-4225-b5f4-1c3ccf57fc74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:22:22.933264 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:22:22.999341 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 520/1039] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Oct 12 02:22:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 02:22:23.331792 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0427e41-e941-478a-8b44-d4d2e7526b55 None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:22:23.333378 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-f0427e41-e941-478a-8b44-d4d2e7526b55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:22:23.407976 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:22:23.532565 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0427e41-e941-478a-8b44-d4d2e7526b55 None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:22:23.683064 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ca4234-138e-4898-9c5d-240f8997da07 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fca96c111b45b795fb757f77908ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'beb6def6fcad45959e56425bb8bff4d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:22:23.684602 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ca4234-138e-4898-9c5d-240f8997da07 service nova] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:22:23.685020 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ca4234-138e-4898-9c5d-240f8997da07 service nova] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:22:23.685296 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ca4234-138e-4898-9c5d-240f8997da07 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:22:23.686949 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-f4ca4234-138e-4898-9c5d-240f8997da07 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:22:23.714245 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:22:23.794561 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ca4234-138e-4898-9c5d-240f8997da07 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:22:23.796163 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ca4234-138e-4898-9c5d-240f8997da07 service nova] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:22:23.814914 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 520/1040] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 02:22:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 484 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 02:22:26.331651 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e0ade0-8ef7-4ca3-a76b-0c09527dc678 None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:22:26.332221 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e0ade0-8ef7-4ca3-a76b-0c09527dc678 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:22:26.332221 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e0ade0-8ef7-4ca3-a76b-0c09527dc678 None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:22:26.333698 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 521/1041] 10.222.0.18 () {54 vars in 927 bytes} [Wed Oct 12 02:22:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 02:22:26.338882 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4985f692-0370-4d58-bda7-fe5d1e84998c None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:22:26.339325 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4985f692-0370-4d58-bda7-fe5d1e84998c None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:22:26.339714 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4985f692-0370-4d58-bda7-fe5d1e84998c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:22:26.413144 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-4985f692-0370-4d58-bda7-fe5d1e84998c None None] MFA Rules not processed for user `a326a5bb7364479382f528a592371656`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:22:26.414514 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-4985f692-0370-4d58-bda7-fe5d1e84998c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:22:26.518601 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:22:26.529672 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 521/1042] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Oct 12 02:22:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 02:22:26.818600 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b6a4db-f337-49ae-aa48-4f0cb20d21d3 None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:22:26.818879 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b6a4db-f337-49ae-aa48-4f0cb20d21d3 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:22:26.819147 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b6a4db-f337-49ae-aa48-4f0cb20d21d3 None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:22:26.820607 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 522/1043] 10.222.0.18 () {54 vars in 961 bytes} [Wed Oct 12 02:22:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 02:22:26.827143 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135f3f50-7397-41af-a12f-507b88aa9a06 None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:22:26.827533 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135f3f50-7397-41af-a12f-507b88aa9a06 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:22:26.827904 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135f3f50-7397-41af-a12f-507b88aa9a06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:22:26.910024 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-135f3f50-7397-41af-a12f-507b88aa9a06 None None] MFA Rules not processed for user `f2fca96c111b45b795fb757f77908ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:22:26.911399 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-135f3f50-7397-41af-a12f-507b88aa9a06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:22:27.039955 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 522/1044] 10.222.0.18 () {58 vars in 1058 bytes} [Wed Oct 12 02:22:26 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 02:22:27.049081 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b6a4db-f337-49ae-aa48-4f0cb20d21d3 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:22:27.050712 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-f1b6a4db-f337-49ae-aa48-4f0cb20d21d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:22:27.209377 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b6a4db-f337-49ae-aa48-4f0cb20d21d3 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:22:27.232543 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:22:27.338632 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e17843a-1967-4a6f-a6b7-2eed3db27b5f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fca96c111b45b795fb757f77908ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'beb6def6fcad45959e56425bb8bff4d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:22:27.339380 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e17843a-1967-4a6f-a6b7-2eed3db27b5f service nova] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:22:27.339677 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e17843a-1967-4a6f-a6b7-2eed3db27b5f service nova] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:22:27.339950 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e17843a-1967-4a6f-a6b7-2eed3db27b5f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:22:27.342518 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-7e17843a-1967-4a6f-a6b7-2eed3db27b5f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:22:27.444844 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e17843a-1967-4a6f-a6b7-2eed3db27b5f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:22:27.446445 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e17843a-1967-4a6f-a6b7-2eed3db27b5f service nova] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:22:27.466527 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 523/1045] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 02:22:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 02:22:27.496964 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a236063-7279-4aa8-a150-b1a7f6cf5ff1 None None] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:22:27.497475 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a236063-7279-4aa8-a150-b1a7f6cf5ff1 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:22:27.497475 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a236063-7279-4aa8-a150-b1a7f6cf5ff1 None None] PATH_INFO: `/` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:22:27.500550 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 523/1046] 10.222.0.18 () {54 vars in 927 bytes} [Wed Oct 12 02:22:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 02:22:27.504445 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814b081c-7088-460f-8c68-bad43952bd56 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:22:27.505012 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814b081c-7088-460f-8c68-bad43952bd56 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:22:27.505354 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814b081c-7088-460f-8c68-bad43952bd56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:22:27.554809 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:22:27.597410 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-814b081c-7088-460f-8c68-bad43952bd56 None None] MFA Rules not processed for user `a326a5bb7364479382f528a592371656`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:22:27.598789 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-814b081c-7088-460f-8c68-bad43952bd56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:22:27.724567 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 524/1047] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Oct 12 02:22:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 02:22:28.062009 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdd85fd-a742-4e71-a281-3fe9ba48aa03 None None] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:22:28.062009 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdd85fd-a742-4e71-a281-3fe9ba48aa03 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:22:28.062009 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdd85fd-a742-4e71-a281-3fe9ba48aa03 None None] PATH_INFO: `/` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:22:28.062994 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 524/1048] 10.222.0.18 () {54 vars in 963 bytes} [Wed Oct 12 02:22:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 02:22:28.067458 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef513a9-b272-407b-98f5-489073f0ef28 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:22:28.067644 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef513a9-b272-407b-98f5-489073f0ef28 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:22:28.067925 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef513a9-b272-407b-98f5-489073f0ef28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:22:28.149213 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-eef513a9-b272-407b-98f5-489073f0ef28 None None] MFA Rules not processed for user `9ba688e0c4d44d13898539ee886f95fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:22:28.150501 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-eef513a9-b272-407b-98f5-489073f0ef28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:22:28.205439 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:22:28.238228 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 525/1049] 10.222.0.18 () {58 vars in 1060 bytes} [Wed Oct 12 02:22:28 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 02:22:28.245972 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdd85fd-a742-4e71-a281-3fe9ba48aa03 None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:22:28.248538 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-ebdd85fd-a742-4e71-a281-3fe9ba48aa03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:22:28.305983 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:22:28.367904 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdd85fd-a742-4e71-a281-3fe9ba48aa03 None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:22:28.460849 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce71ab2f-6585-4495-9648-2c647d256932 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ba688e0c4d44d13898539ee886f95fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'beb6def6fcad45959e56425bb8bff4d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:22:28.462553 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce71ab2f-6585-4495-9648-2c647d256932 service cinder] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:22:28.462553 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce71ab2f-6585-4495-9648-2c647d256932 service cinder] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:22:28.462553 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce71ab2f-6585-4495-9648-2c647d256932 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:22:28.464752 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-ce71ab2f-6585-4495-9648-2c647d256932 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:22:28.599764 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:22:28.614114 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce71ab2f-6585-4495-9648-2c647d256932 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:22:28.615643 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce71ab2f-6585-4495-9648-2c647d256932 service cinder] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:22:28.635041 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 525/1050] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 02:22:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 02:22:29.713270 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede15cc7-d9c0-4fde-a85e-957c62b224e0 None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:22:29.713865 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede15cc7-d9c0-4fde-a85e-957c62b224e0 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:22:29.713865 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede15cc7-d9c0-4fde-a85e-957c62b224e0 None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:22:29.715767 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 526/1051] 10.222.0.18 () {54 vars in 927 bytes} [Wed Oct 12 02:22:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 02:22:29.721089 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7460aa73-7b04-4885-b71a-b88cbd9a6ad4 None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:22:29.721533 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7460aa73-7b04-4885-b71a-b88cbd9a6ad4 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:22:29.721772 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7460aa73-7b04-4885-b71a-b88cbd9a6ad4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:22:29.789781 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-7460aa73-7b04-4885-b71a-b88cbd9a6ad4 None None] MFA Rules not processed for user `a326a5bb7364479382f528a592371656`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:22:29.790912 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-7460aa73-7b04-4885-b71a-b88cbd9a6ad4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:22:29.887917 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 526/1052] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Oct 12 02:22:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 02:22:30.180584 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede15cc7-d9c0-4fde-a85e-957c62b224e0 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:22:30.182164 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-ede15cc7-d9c0-4fde-a85e-957c62b224e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:22:30.337211 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede15cc7-d9c0-4fde-a85e-957c62b224e0 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:22:30.390822 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:22:30.453926 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b50ec1-de54-4a2d-bbfa-7a5b74e5b1ac service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fca96c111b45b795fb757f77908ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'beb6def6fcad45959e56425bb8bff4d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:22:30.454528 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b50ec1-de54-4a2d-bbfa-7a5b74e5b1ac service nova] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:22:30.454804 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b50ec1-de54-4a2d-bbfa-7a5b74e5b1ac service nova] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:22:30.455072 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b50ec1-de54-4a2d-bbfa-7a5b74e5b1ac service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:22:30.456695 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-77b50ec1-de54-4a2d-bbfa-7a5b74e5b1ac service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:22:30.562987 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b50ec1-de54-4a2d-bbfa-7a5b74e5b1ac service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:22:30.564949 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b50ec1-de54-4a2d-bbfa-7a5b74e5b1ac service nova] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:22:30.584073 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 527/1053] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 02:22:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 02:22:32.818330 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d99e2c-203a-41be-975f-feb85bef8257 None None] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:22:32.818839 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d99e2c-203a-41be-975f-feb85bef8257 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:22:32.818839 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d99e2c-203a-41be-975f-feb85bef8257 None None] PATH_INFO: `/` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:22:32.820266 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 527/1054] 10.222.0.18 () {54 vars in 927 bytes} [Wed Oct 12 02:22:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 02:22:32.825378 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9b90e5-bc8a-4fb6-bc35-d34a0041d923 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:22:32.825829 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9b90e5-bc8a-4fb6-bc35-d34a0041d923 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:22:32.825912 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9b90e5-bc8a-4fb6-bc35-d34a0041d923 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:22:32.894447 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-6f9b90e5-bc8a-4fb6-bc35-d34a0041d923 None None] MFA Rules not processed for user `a326a5bb7364479382f528a592371656`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:22:32.895645 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-6f9b90e5-bc8a-4fb6-bc35-d34a0041d923 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:22:32.903261 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:22:33.004519 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 528/1055] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Oct 12 02:22:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 02:22:33.307444 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d99e2c-203a-41be-975f-feb85bef8257 None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:22:33.309302 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-d8d99e2c-203a-41be-975f-feb85bef8257 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:22:33.375702 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:22:33.469914 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d99e2c-203a-41be-975f-feb85bef8257 None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:22:33.597628 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905116ba-5029-41d7-b945-4893d80a650e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fca96c111b45b795fb757f77908ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'beb6def6fcad45959e56425bb8bff4d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:22:33.598128 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905116ba-5029-41d7-b945-4893d80a650e service nova] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:22:33.598412 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905116ba-5029-41d7-b945-4893d80a650e service nova] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:22:33.598667 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905116ba-5029-41d7-b945-4893d80a650e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:22:33.600229 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-905116ba-5029-41d7-b945-4893d80a650e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:22:33.619664 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:22:33.697078 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905116ba-5029-41d7-b945-4893d80a650e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:22:33.698657 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905116ba-5029-41d7-b945-4893d80a650e service nova] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:22:33.717998 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 528/1056] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 02:22:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 02:22:35.973845 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20db6245-d3bd-4596-9a78-0cd49eafa602 None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:22:35.974280 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20db6245-d3bd-4596-9a78-0cd49eafa602 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:22:35.974435 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20db6245-d3bd-4596-9a78-0cd49eafa602 None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:22:35.979987 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 529/1057] 10.222.0.18 () {54 vars in 927 bytes} [Wed Oct 12 02:22:35 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 02:22:35.982131 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0625dee5-49aa-4c9c-a9ce-70ea05fe9e84 None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:22:35.982560 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0625dee5-49aa-4c9c-a9ce-70ea05fe9e84 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:22:35.982736 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0625dee5-49aa-4c9c-a9ce-70ea05fe9e84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:22:36.059230 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-0625dee5-49aa-4c9c-a9ce-70ea05fe9e84 None None] MFA Rules not processed for user `a326a5bb7364479382f528a592371656`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:22:36.061685 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-0625dee5-49aa-4c9c-a9ce-70ea05fe9e84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:22:36.186188 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:22:36.192041 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 529/1058] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Oct 12 02:22:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 02:22:36.486558 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20db6245-d3bd-4596-9a78-0cd49eafa602 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:22:36.488189 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-20db6245-d3bd-4596-9a78-0cd49eafa602 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:22:36.624554 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:22:36.635882 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20db6245-d3bd-4596-9a78-0cd49eafa602 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:22:36.757468 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe458555-ca97-4435-9cdf-a2465392454f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fca96c111b45b795fb757f77908ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'beb6def6fcad45959e56425bb8bff4d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:22:36.758003 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe458555-ca97-4435-9cdf-a2465392454f service nova] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:22:36.758308 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe458555-ca97-4435-9cdf-a2465392454f service nova] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:22:36.758583 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe458555-ca97-4435-9cdf-a2465392454f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:22:36.760184 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-fe458555-ca97-4435-9cdf-a2465392454f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:22:36.852242 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe458555-ca97-4435-9cdf-a2465392454f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:22:36.853858 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe458555-ca97-4435-9cdf-a2465392454f service nova] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:22:36.863763 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:22:36.872463 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 530/1059] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 02:22:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 02:22:39.056615 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af802b4-8ba6-45d3-a198-bf5fe180c3d9 None None] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:22:39.057159 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af802b4-8ba6-45d3-a198-bf5fe180c3d9 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:22:39.057159 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af802b4-8ba6-45d3-a198-bf5fe180c3d9 None None] PATH_INFO: `/` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:22:39.058886 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 530/1060] 10.222.0.18 () {54 vars in 927 bytes} [Wed Oct 12 02:22:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 02:22:39.064135 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6ff269-2433-438c-9a9e-22e64cefbf9d None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:22:39.064593 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6ff269-2433-438c-9a9e-22e64cefbf9d None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:22:39.064690 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6ff269-2433-438c-9a9e-22e64cefbf9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:22:39.130705 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-dc6ff269-2433-438c-9a9e-22e64cefbf9d None None] MFA Rules not processed for user `a326a5bb7364479382f528a592371656`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:22:39.131899 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-dc6ff269-2433-438c-9a9e-22e64cefbf9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:22:39.233899 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 531/1061] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Oct 12 02:22:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 02:22:39.519181 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af802b4-8ba6-45d3-a198-bf5fe180c3d9 None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:22:39.520794 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-9af802b4-8ba6-45d3-a198-bf5fe180c3d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:22:39.677919 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af802b4-8ba6-45d3-a198-bf5fe180c3d9 None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:22:39.743916 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:22:39.793156 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec8ea08-0bbe-4616-a7b1-3bde655ecdbe service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fca96c111b45b795fb757f77908ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'beb6def6fcad45959e56425bb8bff4d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:22:39.793761 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec8ea08-0bbe-4616-a7b1-3bde655ecdbe service nova] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:22:39.794065 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec8ea08-0bbe-4616-a7b1-3bde655ecdbe service nova] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:22:39.794333 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec8ea08-0bbe-4616-a7b1-3bde655ecdbe service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:22:39.795952 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-fec8ea08-0bbe-4616-a7b1-3bde655ecdbe service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:22:39.885416 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec8ea08-0bbe-4616-a7b1-3bde655ecdbe service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:22:39.888802 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec8ea08-0bbe-4616-a7b1-3bde655ecdbe service nova] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:22:39.906707 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 531/1062] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 02:22:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 02:22:42.109651 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a441b6-190a-430b-8f87-e75aad8b7cd7 None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:22:42.110347 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a441b6-190a-430b-8f87-e75aad8b7cd7 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:22:42.110347 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a441b6-190a-430b-8f87-e75aad8b7cd7 None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:22:42.111588 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 532/1063] 10.222.0.18 () {54 vars in 927 bytes} [Wed Oct 12 02:22:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 02:22:42.117108 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea24eb8-409c-46b8-b3be-2f2323f4fa69 None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:22:42.117681 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea24eb8-409c-46b8-b3be-2f2323f4fa69 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:22:42.117681 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea24eb8-409c-46b8-b3be-2f2323f4fa69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:22:42.206013 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-dea24eb8-409c-46b8-b3be-2f2323f4fa69 None None] MFA Rules not processed for user `a326a5bb7364479382f528a592371656`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:22:42.207671 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-dea24eb8-409c-46b8-b3be-2f2323f4fa69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:22:42.253106 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:22:42.318569 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 532/1064] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Oct 12 02:22:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 02:22:42.610896 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a441b6-190a-430b-8f87-e75aad8b7cd7 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:22:42.613070 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-33a441b6-190a-430b-8f87-e75aad8b7cd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:22:42.709246 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:22:42.793362 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a441b6-190a-430b-8f87-e75aad8b7cd7 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:22:42.930273 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef30e61-aee8-43c4-9dc1-83b0e8f8b352 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fca96c111b45b795fb757f77908ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'beb6def6fcad45959e56425bb8bff4d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:22:42.930875 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef30e61-aee8-43c4-9dc1-83b0e8f8b352 service nova] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:22:42.931154 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef30e61-aee8-43c4-9dc1-83b0e8f8b352 service nova] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:22:42.931420 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef30e61-aee8-43c4-9dc1-83b0e8f8b352 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:22:42.933705 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-8ef30e61-aee8-43c4-9dc1-83b0e8f8b352 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:22:42.974039 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:22:43.043483 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef30e61-aee8-43c4-9dc1-83b0e8f8b352 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:22:43.045579 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef30e61-aee8-43c4-9dc1-83b0e8f8b352 service nova] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:22:43.069746 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 533/1065] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 02:22:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 460 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 02:22:45.458157 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd15138-bbf5-40e5-a5fe-1c2b1289b974 None None] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:22:45.458753 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd15138-bbf5-40e5-a5fe-1c2b1289b974 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:22:45.458753 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd15138-bbf5-40e5-a5fe-1c2b1289b974 None None] PATH_INFO: `/` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:22:45.460078 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 533/1066] 10.222.0.18 () {54 vars in 927 bytes} [Wed Oct 12 02:22:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 02:22:45.465593 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d79fedb-db5e-4088-8f1b-3a48a9328966 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:22:45.466044 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d79fedb-db5e-4088-8f1b-3a48a9328966 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:22:45.466149 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d79fedb-db5e-4088-8f1b-3a48a9328966 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:22:45.534539 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-3d79fedb-db5e-4088-8f1b-3a48a9328966 None None] MFA Rules not processed for user `a326a5bb7364479382f528a592371656`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:22:45.536044 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-3d79fedb-db5e-4088-8f1b-3a48a9328966 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:22:45.634695 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 534/1067] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Oct 12 02:22:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 02:22:45.927923 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd15138-bbf5-40e5-a5fe-1c2b1289b974 None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:22:45.929478 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-cdd15138-bbf5-40e5-a5fe-1c2b1289b974 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:22:46.077577 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd15138-bbf5-40e5-a5fe-1c2b1289b974 None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:22:46.094605 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:22:46.194926 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12887e13-54cd-4f28-9b98-9e28a4a35dd2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fca96c111b45b795fb757f77908ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'beb6def6fcad45959e56425bb8bff4d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:22:46.195442 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12887e13-54cd-4f28-9b98-9e28a4a35dd2 service nova] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:22:46.195721 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12887e13-54cd-4f28-9b98-9e28a4a35dd2 service nova] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:22:46.195991 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12887e13-54cd-4f28-9b98-9e28a4a35dd2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:22:46.197613 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-12887e13-54cd-4f28-9b98-9e28a4a35dd2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:22:46.288681 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12887e13-54cd-4f28-9b98-9e28a4a35dd2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:22:46.290276 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12887e13-54cd-4f28-9b98-9e28a4a35dd2 service nova] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:22:46.309132 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 534/1068] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 02:22:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 02:22:47.065693 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c276aaa1-e590-48f6-8e5e-2ad16ddc18f8 None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:22:47.066261 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c276aaa1-e590-48f6-8e5e-2ad16ddc18f8 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:22:47.066261 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c276aaa1-e590-48f6-8e5e-2ad16ddc18f8 None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:22:47.067561 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 535/1069] 10.222.0.18 () {54 vars in 927 bytes} [Wed Oct 12 02:22:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 02:22:47.072753 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc1aa2e-5e3f-4815-bb3e-2e9dfcb7ac8d None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:22:47.073509 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc1aa2e-5e3f-4815-bb3e-2e9dfcb7ac8d None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:22:47.073509 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc1aa2e-5e3f-4815-bb3e-2e9dfcb7ac8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:22:47.099259 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:22:47.141440 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-6fc1aa2e-5e3f-4815-bb3e-2e9dfcb7ac8d None None] MFA Rules not processed for user `a326a5bb7364479382f528a592371656`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:22:47.142636 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-6fc1aa2e-5e3f-4815-bb3e-2e9dfcb7ac8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:22:47.243233 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 535/1070] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Oct 12 02:22:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 02:22:47.545794 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d707e09a-81d1-4c8d-a2c5-966cf70725b9 None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:22:47.546079 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d707e09a-81d1-4c8d-a2c5-966cf70725b9 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:22:47.546353 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d707e09a-81d1-4c8d-a2c5-966cf70725b9 None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:22:47.547681 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 536/1071] 10.222.0.18 () {54 vars in 962 bytes} [Wed Oct 12 02:22:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 02:22:47.553273 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a8b7ae-aec0-4c21-bc08-e51b9892d5b2 None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:22:47.553559 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a8b7ae-aec0-4c21-bc08-e51b9892d5b2 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:22:47.553831 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a8b7ae-aec0-4c21-bc08-e51b9892d5b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:22:47.631781 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-45a8b7ae-aec0-4c21-bc08-e51b9892d5b2 None None] MFA Rules not processed for user `8285a132afeb47558e1b3dcedfd7b4e7`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:22:47.633027 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-45a8b7ae-aec0-4c21-bc08-e51b9892d5b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:22:47.676771 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:22:47.716430 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 536/1072] 10.222.0.18 () {58 vars in 1059 bytes} [Wed Oct 12 02:22:47 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 02:22:47.725671 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d707e09a-81d1-4c8d-a2c5-966cf70725b9 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:22:47.727195 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-d707e09a-81d1-4c8d-a2c5-966cf70725b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:22:47.741410 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:22:47.832228 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d707e09a-81d1-4c8d-a2c5-966cf70725b9 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:22:47.910508 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316b17d5-a20c-4e5a-ad67-30bf4c3b340c service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8285a132afeb47558e1b3dcedfd7b4e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'beb6def6fcad45959e56425bb8bff4d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:22:47.911109 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316b17d5-a20c-4e5a-ad67-30bf4c3b340c service glance] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:22:47.911385 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316b17d5-a20c-4e5a-ad67-30bf4c3b340c service glance] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:22:47.911655 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316b17d5-a20c-4e5a-ad67-30bf4c3b340c service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:22:47.913278 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-316b17d5-a20c-4e5a-ad67-30bf4c3b340c service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:22:47.985669 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:22:48.028496 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316b17d5-a20c-4e5a-ad67-30bf4c3b340c service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:22:48.029932 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316b17d5-a20c-4e5a-ad67-30bf4c3b340c service glance] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:22:48.049345 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 537/1073] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 02:22:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 02:22:48.487744 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abfa861-f0b4-47b6-ba8e-8a4ac98a0181 None None] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:22:48.488283 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abfa861-f0b4-47b6-ba8e-8a4ac98a0181 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:22:48.488283 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abfa861-f0b4-47b6-ba8e-8a4ac98a0181 None None] PATH_INFO: `/` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:22:48.489550 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 537/1074] 10.222.0.18 () {54 vars in 927 bytes} [Wed Oct 12 02:22:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 02:22:48.495400 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbeb271-0719-4d9d-bb78-8a14fe45c0cd None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:22:48.495852 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbeb271-0719-4d9d-bb78-8a14fe45c0cd None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:22:48.496247 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbeb271-0719-4d9d-bb78-8a14fe45c0cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:22:48.571377 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-cbbeb271-0719-4d9d-bb78-8a14fe45c0cd None None] MFA Rules not processed for user `a326a5bb7364479382f528a592371656`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:22:48.572611 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-cbbeb271-0719-4d9d-bb78-8a14fe45c0cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:22:48.678107 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 538/1075] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Oct 12 02:22:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 02:22:48.818386 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311aee13-7067-4454-9bb7-c22f90a94068 None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:22:48.818732 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311aee13-7067-4454-9bb7-c22f90a94068 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:22:48.819069 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311aee13-7067-4454-9bb7-c22f90a94068 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:22:48.887339 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-311aee13-7067-4454-9bb7-c22f90a94068 None None] MFA Rules not processed for user `8d0e2087e5324071926c3dc3a3cb9b1d`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:22:48.888576 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-311aee13-7067-4454-9bb7-c22f90a94068 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:22:48.970268 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbeb271-0719-4d9d-bb78-8a14fe45c0cd None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:22:48.972035 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-cbbeb271-0719-4d9d-bb78-8a14fe45c0cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:22:48.982645 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 538/1076] 10.222.0.18 () {58 vars in 1009 bytes} [Wed Oct 12 02:22:48 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 02:22:49.002846 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:22:49.030427 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1986d175-9d60-4e22-9073-7f1732350996 None None] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:22:49.030727 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1986d175-9d60-4e22-9073-7f1732350996 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:22:49.030997 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1986d175-9d60-4e22-9073-7f1732350996 None None] PATH_INFO: `/` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:22:49.032915 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 539/1077] 10.222.0.18 () {54 vars in 943 bytes} [Wed Oct 12 02:22:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 12 02:22:49.040183 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860b57ed-e00b-455f-9bb6-9ee0c6675ab9 None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:22:49.040484 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860b57ed-e00b-455f-9bb6-9ee0c6675ab9 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:22:49.040766 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860b57ed-e00b-455f-9bb6-9ee0c6675ab9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:22:49.097048 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbeb271-0719-4d9d-bb78-8a14fe45c0cd None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:22:49.112396 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:22:49.121379 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-860b57ed-e00b-455f-9bb6-9ee0c6675ab9 None None] MFA Rules not processed for user `af9bd50c42cc437dbdd5a431d8adbb26`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:22:49.122588 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-860b57ed-e00b-455f-9bb6-9ee0c6675ab9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:22:49.214246 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3975779-12f1-49f6-a830-d03916ee9832 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fca96c111b45b795fb757f77908ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'beb6def6fcad45959e56425bb8bff4d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:22:49.214917 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3975779-12f1-49f6-a830-d03916ee9832 service nova] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:22:49.215193 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3975779-12f1-49f6-a830-d03916ee9832 service nova] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:22:49.215461 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3975779-12f1-49f6-a830-d03916ee9832 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:22:49.217101 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-c3975779-12f1-49f6-a830-d03916ee9832 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:22:49.231644 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 540/1078] 10.222.0.18 () {58 vars in 1040 bytes} [Wed Oct 12 02:22:49 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 02:22:49.236963 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:22:49.240764 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860b57ed-e00b-455f-9bb6-9ee0c6675ab9 None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:22:49.251475 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860b57ed-e00b-455f-9bb6-9ee0c6675ab9 None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:22:49.311675 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3975779-12f1-49f6-a830-d03916ee9832 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:22:49.313340 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3975779-12f1-49f6-a830-d03916ee9832 service nova] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:22:49.331551 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 539/1079] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 02:22:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 12 02:22:49.359562 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5527c3-3094-4116-8fc1-870b92202b7a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af9bd50c42cc437dbdd5a431d8adbb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'beb6def6fcad45959e56425bb8bff4d1', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:22:49.359950 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5527c3-3094-4116-8fc1-870b92202b7a service swift] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:22:49.360233 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5527c3-3094-4116-8fc1-870b92202b7a service swift] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:22:49.360622 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5527c3-3094-4116-8fc1-870b92202b7a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:22:49.362185 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-ac5527c3-3094-4116-8fc1-870b92202b7a service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:22:49.364977 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:22:49.455404 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5527c3-3094-4116-8fc1-870b92202b7a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:22:49.457076 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5527c3-3094-4116-8fc1-870b92202b7a service swift] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:22:49.466605 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 541/1080] 10.222.0.18 () {60 vars in 1384 bytes} [Wed Oct 12 02:22:49 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 12 02:22:51.586688 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b8eb5d-d9ba-4da4-87f9-8ab3a19e7635 None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:22:51.587234 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b8eb5d-d9ba-4da4-87f9-8ab3a19e7635 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:22:51.587234 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b8eb5d-d9ba-4da4-87f9-8ab3a19e7635 None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:22:51.592529 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 540/1081] 10.222.0.18 () {54 vars in 927 bytes} [Wed Oct 12 02:22:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 02:22:51.594675 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3866147-67f2-4ba1-937b-d229bea5ae7f None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:22:51.595089 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3866147-67f2-4ba1-937b-d229bea5ae7f None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:22:51.595265 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3866147-67f2-4ba1-937b-d229bea5ae7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:22:51.669717 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-e3866147-67f2-4ba1-937b-d229bea5ae7f None None] MFA Rules not processed for user `a326a5bb7364479382f528a592371656`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:22:51.671689 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-e3866147-67f2-4ba1-937b-d229bea5ae7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:22:51.776056 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:22:51.783607 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 542/1082] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Oct 12 02:22:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 02:22:52.086627 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b8eb5d-d9ba-4da4-87f9-8ab3a19e7635 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:22:52.088822 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-c4b8eb5d-d9ba-4da4-87f9-8ab3a19e7635 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:22:52.284612 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:22:52.286562 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b8eb5d-d9ba-4da4-87f9-8ab3a19e7635 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:22:52.413886 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13321aa-4337-4d02-8200-7dd6ef49de6d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fca96c111b45b795fb757f77908ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'beb6def6fcad45959e56425bb8bff4d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:22:52.414807 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13321aa-4337-4d02-8200-7dd6ef49de6d service nova] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:22:52.415259 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13321aa-4337-4d02-8200-7dd6ef49de6d service nova] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:22:52.415534 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13321aa-4337-4d02-8200-7dd6ef49de6d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:22:52.418177 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-f13321aa-4337-4d02-8200-7dd6ef49de6d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:22:52.521353 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13321aa-4337-4d02-8200-7dd6ef49de6d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:22:52.522957 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13321aa-4337-4d02-8200-7dd6ef49de6d service nova] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:22:52.548647 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 541/1083] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 02:22:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 462 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 02:22:54.758410 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c092b33a-b528-4244-a45e-e444f8327628 None None] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:22:54.758980 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c092b33a-b528-4244-a45e-e444f8327628 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:22:54.758980 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c092b33a-b528-4244-a45e-e444f8327628 None None] PATH_INFO: `/` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:22:54.764718 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 543/1084] 10.222.0.18 () {54 vars in 927 bytes} [Wed Oct 12 02:22:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 02:22:54.767013 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68d26f5-a0fe-40ed-bc47-3430e5e01eca None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:22:54.767440 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68d26f5-a0fe-40ed-bc47-3430e5e01eca None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:22:54.767572 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68d26f5-a0fe-40ed-bc47-3430e5e01eca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:22:54.772069 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:22:54.844039 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-a68d26f5-a0fe-40ed-bc47-3430e5e01eca None None] MFA Rules not processed for user `a326a5bb7364479382f528a592371656`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:22:54.845315 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-a68d26f5-a0fe-40ed-bc47-3430e5e01eca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:22:54.958468 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 542/1085] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Oct 12 02:22:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 02:22:55.254090 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c092b33a-b528-4244-a45e-e444f8327628 None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:22:55.255615 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-c092b33a-b528-4244-a45e-e444f8327628 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:22:55.418706 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c092b33a-b528-4244-a45e-e444f8327628 None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:22:55.492029 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:22:55.553110 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e560de-78fd-47ca-9711-92b11f30e5d1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fca96c111b45b795fb757f77908ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'beb6def6fcad45959e56425bb8bff4d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:22:55.553726 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e560de-78fd-47ca-9711-92b11f30e5d1 service nova] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:22:55.554007 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e560de-78fd-47ca-9711-92b11f30e5d1 service nova] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:22:55.554277 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e560de-78fd-47ca-9711-92b11f30e5d1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:22:55.555874 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-a4e560de-78fd-47ca-9711-92b11f30e5d1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:22:55.661992 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e560de-78fd-47ca-9711-92b11f30e5d1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:22:55.664050 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e560de-78fd-47ca-9711-92b11f30e5d1 service nova] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:22:55.683355 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 544/1086] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 02:22:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 429 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 02:23:04.956923 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=64 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:23:05.680704 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=64 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:23:12.299292 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb76d8f-624b-4cb2-812a-4c58f027d645 None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:23:12.299844 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb76d8f-624b-4cb2-812a-4c58f027d645 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:23:12.299844 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb76d8f-624b-4cb2-812a-4c58f027d645 None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:23:12.301191 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 543/1087] 10.222.0.18 () {54 vars in 918 bytes} [Wed Oct 12 02:23:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 02:23:12.306951 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4290c464-c737-46cd-b4fb-9ca66743ca10 None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:23:12.307364 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4290c464-c737-46cd-b4fb-9ca66743ca10 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:23:12.307470 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4290c464-c737-46cd-b4fb-9ca66743ca10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:23:12.382547 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-4290c464-c737-46cd-b4fb-9ca66743ca10 None None] MFA Rules not processed for user `a58b9e0467c040638c3d43e3ac9c0495`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:23:12.383733 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-4290c464-c737-46cd-b4fb-9ca66743ca10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:23:12.487289 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 545/1088] 10.222.0.18 () {58 vars in 1015 bytes} [Wed Oct 12 02:23:12 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 02:23:12.501398 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78893885-e77e-4499-a414-2cf6f46f0443 None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:23:12.501678 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78893885-e77e-4499-a414-2cf6f46f0443 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:23:12.501974 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78893885-e77e-4499-a414-2cf6f46f0443 None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:23:12.503280 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 544/1089] 10.222.0.18 () {54 vars in 918 bytes} [Wed Oct 12 02:23:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 02:23:12.507655 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b4ddf8-f31f-4c95-8d60-33dd67ec6503 None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:23:12.507934 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b4ddf8-f31f-4c95-8d60-33dd67ec6503 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:23:12.508202 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b4ddf8-f31f-4c95-8d60-33dd67ec6503 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:23:12.581500 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:23:12.584023 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-30b4ddf8-f31f-4c95-8d60-33dd67ec6503 None None] MFA Rules not processed for user `f2fca96c111b45b795fb757f77908ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:23:12.585773 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-30b4ddf8-f31f-4c95-8d60-33dd67ec6503 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:23:12.700358 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 546/1090] 10.222.0.18 () {58 vars in 1015 bytes} [Wed Oct 12 02:23:12 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 02:23:15.262751 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e4d732-9bc1-4619-b92e-201a1a05470c None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:23:15.263322 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e4d732-9bc1-4619-b92e-201a1a05470c None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:23:15.263322 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e4d732-9bc1-4619-b92e-201a1a05470c None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:23:15.264648 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 545/1091] 127.0.0.1 () {54 vars in 917 bytes} [Wed Oct 12 02:23:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 02:23:15.269819 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a468f7e2-d1a3-4546-814b-5128beb3bdb6 None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:23:15.270216 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a468f7e2-d1a3-4546-814b-5128beb3bdb6 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:23:15.270363 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a468f7e2-d1a3-4546-814b-5128beb3bdb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:23:15.336204 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-a468f7e2-d1a3-4546-814b-5128beb3bdb6 None None] MFA Rules not processed for user `a326a5bb7364479382f528a592371656`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:23:15.338000 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-a468f7e2-d1a3-4546-814b-5128beb3bdb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:23:15.393828 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:23:15.436181 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 547/1092] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Oct 12 02:23:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 02:23:15.727942 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e4d732-9bc1-4619-b92e-201a1a05470c None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:23:15.729642 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-a5e4d732-9bc1-4619-b92e-201a1a05470c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:23:15.872846 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e4d732-9bc1-4619-b92e-201a1a05470c None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:23:15.943649 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:23:15.984819 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b92ced-d000-471e-98fc-c3b849e83706 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fca96c111b45b795fb757f77908ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'beb6def6fcad45959e56425bb8bff4d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:23:15.985430 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b92ced-d000-471e-98fc-c3b849e83706 service nova] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:23:15.985705 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b92ced-d000-471e-98fc-c3b849e83706 service nova] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:23:15.985976 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b92ced-d000-471e-98fc-c3b849e83706 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:23:15.987573 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-f3b92ced-d000-471e-98fc-c3b849e83706 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:23:16.076226 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b92ced-d000-471e-98fc-c3b849e83706 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:23:16.077845 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b92ced-d000-471e-98fc-c3b849e83706 service nova] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:23:16.096261 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 546/1093] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 02:23:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 02:23:17.238223 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb6e4d5-fa9d-4f10-b394-3590427e8180 None None] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:23:17.238835 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb6e4d5-fa9d-4f10-b394-3590427e8180 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:23:17.238835 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb6e4d5-fa9d-4f10-b394-3590427e8180 None None] PATH_INFO: `/` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:23:17.240123 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 548/1094] 127.0.0.1 () {54 vars in 901 bytes} [Wed Oct 12 02:23:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 02:23:17.247150 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700003cf-54e6-48ea-9c36-9a69d0a47e7a None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:23:17.247589 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700003cf-54e6-48ea-9c36-9a69d0a47e7a None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:23:17.247708 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700003cf-54e6-48ea-9c36-9a69d0a47e7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:23:17.322477 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-700003cf-54e6-48ea-9c36-9a69d0a47e7a None None] MFA Rules not processed for user `a326a5bb7364479382f528a592371656`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:23:17.323653 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-700003cf-54e6-48ea-9c36-9a69d0a47e7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:23:17.350551 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:23:17.420862 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 547/1095] 127.0.0.1 () {58 vars in 998 bytes} [Wed Oct 12 02:23:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 02:23:17.569661 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb6e4d5-fa9d-4f10-b394-3590427e8180 None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:23:17.571695 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-6fb6e4d5-fa9d-4f10-b394-3590427e8180 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:23:17.715602 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb6e4d5-fa9d-4f10-b394-3590427e8180 None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:23:17.755338 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:23:17.828044 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b163d1-7fac-4ac1-ac1d-2547e1287622 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fca96c111b45b795fb757f77908ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'beb6def6fcad45959e56425bb8bff4d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:23:17.828608 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b163d1-7fac-4ac1-ac1d-2547e1287622 service nova] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:23:17.828891 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b163d1-7fac-4ac1-ac1d-2547e1287622 service nova] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:23:17.829174 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b163d1-7fac-4ac1-ac1d-2547e1287622 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:23:17.830810 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-f0b163d1-7fac-4ac1-ac1d-2547e1287622 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:23:17.920269 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b163d1-7fac-4ac1-ac1d-2547e1287622 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:23:17.921883 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b163d1-7fac-4ac1-ac1d-2547e1287622 service nova] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:23:17.939633 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 549/1096] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 02:23:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 02:23:19.061410 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7895d90-ea44-43e3-8554-dc94e2907dd2 None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:23:19.061970 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7895d90-ea44-43e3-8554-dc94e2907dd2 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:23:19.061970 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7895d90-ea44-43e3-8554-dc94e2907dd2 None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:23:19.063271 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 548/1097] 127.0.0.1 () {54 vars in 901 bytes} [Wed Oct 12 02:23:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 02:23:19.069473 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62678338-a30d-4335-814b-380099e1f95a None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:23:19.069897 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62678338-a30d-4335-814b-380099e1f95a None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:23:19.069999 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62678338-a30d-4335-814b-380099e1f95a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:23:19.124841 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:23:19.148818 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-62678338-a30d-4335-814b-380099e1f95a None None] MFA Rules not processed for user `a326a5bb7364479382f528a592371656`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:23:19.150176 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-62678338-a30d-4335-814b-380099e1f95a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:23:19.246083 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 550/1098] 127.0.0.1 () {58 vars in 998 bytes} [Wed Oct 12 02:23:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 02:23:19.395307 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7895d90-ea44-43e3-8554-dc94e2907dd2 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:23:19.396852 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-d7895d90-ea44-43e3-8554-dc94e2907dd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:23:19.545443 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7895d90-ea44-43e3-8554-dc94e2907dd2 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:23:19.557920 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:23:19.659156 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449b423f-48a6-4b70-b834-52364ed82996 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fca96c111b45b795fb757f77908ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'beb6def6fcad45959e56425bb8bff4d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:23:19.659767 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449b423f-48a6-4b70-b834-52364ed82996 service nova] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:23:19.660083 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449b423f-48a6-4b70-b834-52364ed82996 service nova] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:23:19.660358 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449b423f-48a6-4b70-b834-52364ed82996 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:23:19.662021 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-449b423f-48a6-4b70-b834-52364ed82996 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:23:19.750446 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449b423f-48a6-4b70-b834-52364ed82996 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:23:19.752015 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449b423f-48a6-4b70-b834-52364ed82996 service nova] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:23:19.770787 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 549/1099] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 02:23:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 02:23:20.882534 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655f435c-ddad-4488-8e30-cfeb5b2b1dee None None] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:23:20.883091 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655f435c-ddad-4488-8e30-cfeb5b2b1dee None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:23:20.883091 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655f435c-ddad-4488-8e30-cfeb5b2b1dee None None] PATH_INFO: `/` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:23:20.885101 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 551/1100] 127.0.0.1 () {54 vars in 901 bytes} [Wed Oct 12 02:23:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 02:23:20.891270 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82d6468-0428-4f15-9d07-2f08f329fbdf None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:23:20.891781 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82d6468-0428-4f15-9d07-2f08f329fbdf None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:23:20.891888 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82d6468-0428-4f15-9d07-2f08f329fbdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:23:20.911311 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:23:20.970154 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-c82d6468-0428-4f15-9d07-2f08f329fbdf None None] MFA Rules not processed for user `a326a5bb7364479382f528a592371656`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:23:20.971732 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-c82d6468-0428-4f15-9d07-2f08f329fbdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:23:21.067345 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 550/1101] 127.0.0.1 () {58 vars in 998 bytes} [Wed Oct 12 02:23:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 02:23:21.218404 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655f435c-ddad-4488-8e30-cfeb5b2b1dee None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:23:21.219931 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-655f435c-ddad-4488-8e30-cfeb5b2b1dee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:23:21.330633 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:23:21.368168 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655f435c-ddad-4488-8e30-cfeb5b2b1dee None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:23:21.481028 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d30d682-96df-4ffd-a28a-f9e416c38024 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fca96c111b45b795fb757f77908ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'beb6def6fcad45959e56425bb8bff4d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:23:21.481552 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d30d682-96df-4ffd-a28a-f9e416c38024 service nova] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:23:21.481828 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d30d682-96df-4ffd-a28a-f9e416c38024 service nova] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:23:21.482097 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d30d682-96df-4ffd-a28a-f9e416c38024 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:23:21.483681 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-0d30d682-96df-4ffd-a28a-f9e416c38024 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:23:21.561705 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:23:21.575461 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d30d682-96df-4ffd-a28a-f9e416c38024 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:23:21.577090 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d30d682-96df-4ffd-a28a-f9e416c38024 service nova] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:23:21.595267 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 552/1102] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 02:23:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 02:23:22.708755 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1564882b-fbc1-45b3-a8c6-8de3144ca960 None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:23:22.709324 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1564882b-fbc1-45b3-a8c6-8de3144ca960 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:23:22.709324 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1564882b-fbc1-45b3-a8c6-8de3144ca960 None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:23:22.710672 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 551/1103] 127.0.0.1 () {54 vars in 901 bytes} [Wed Oct 12 02:23:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 02:23:22.717070 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24002f2b-0537-4e4f-96b2-57738786ae53 None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:23:22.717530 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24002f2b-0537-4e4f-96b2-57738786ae53 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:23:22.717640 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24002f2b-0537-4e4f-96b2-57738786ae53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:23:22.793009 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-24002f2b-0537-4e4f-96b2-57738786ae53 None None] MFA Rules not processed for user `a326a5bb7364479382f528a592371656`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:23:22.794114 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-24002f2b-0537-4e4f-96b2-57738786ae53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:23:22.888932 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 553/1104] 127.0.0.1 () {58 vars in 998 bytes} [Wed Oct 12 02:23:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 02:23:23.042027 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1564882b-fbc1-45b3-a8c6-8de3144ca960 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:23:23.043641 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-1564882b-fbc1-45b3-a8c6-8de3144ca960 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:23:23.142216 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:23:23.209889 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1564882b-fbc1-45b3-a8c6-8de3144ca960 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:23:23.337585 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1858a8-5f3f-4b1d-be8c-b9c9fe0eff77 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fca96c111b45b795fb757f77908ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'beb6def6fcad45959e56425bb8bff4d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:23:23.338105 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1858a8-5f3f-4b1d-be8c-b9c9fe0eff77 service nova] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:23:23.338386 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1858a8-5f3f-4b1d-be8c-b9c9fe0eff77 service nova] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:23:23.338658 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1858a8-5f3f-4b1d-be8c-b9c9fe0eff77 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:23:23.340384 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-0e1858a8-5f3f-4b1d-be8c-b9c9fe0eff77 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:23:23.390726 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:23:23.437847 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1858a8-5f3f-4b1d-be8c-b9c9fe0eff77 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:23:23.439434 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1858a8-5f3f-4b1d-be8c-b9c9fe0eff77 service nova] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:23:23.463063 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 552/1105] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 02:23:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 421 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 12 02:23:24.545948 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b20eda-1194-412a-b7e9-3e127fd7643a None None] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:23:24.546455 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b20eda-1194-412a-b7e9-3e127fd7643a None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:23:24.546546 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b20eda-1194-412a-b7e9-3e127fd7643a None None] PATH_INFO: `/` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:23:24.547926 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 554/1106] 127.0.0.1 () {54 vars in 901 bytes} [Wed Oct 12 02:23:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 02:23:24.554138 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9552fe-eb45-4cff-a595-47a34ae67929 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:23:24.554572 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9552fe-eb45-4cff-a595-47a34ae67929 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:23:24.554700 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9552fe-eb45-4cff-a595-47a34ae67929 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:23:24.631250 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-5d9552fe-eb45-4cff-a595-47a34ae67929 None None] MFA Rules not processed for user `a326a5bb7364479382f528a592371656`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:23:24.632462 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-5d9552fe-eb45-4cff-a595-47a34ae67929 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:23:24.729696 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 553/1107] 127.0.0.1 () {58 vars in 998 bytes} [Wed Oct 12 02:23:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 02:23:24.879268 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b20eda-1194-412a-b7e9-3e127fd7643a None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:23:24.880761 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-81b20eda-1194-412a-b7e9-3e127fd7643a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:23:24.929073 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:23:25.025580 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b20eda-1194-412a-b7e9-3e127fd7643a None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:23:25.136715 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2df7f3-9d25-4f29-b18b-a3346efc5653 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fca96c111b45b795fb757f77908ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'beb6def6fcad45959e56425bb8bff4d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:23:25.137314 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2df7f3-9d25-4f29-b18b-a3346efc5653 service nova] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:23:25.137588 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2df7f3-9d25-4f29-b18b-a3346efc5653 service nova] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:23:25.137854 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2df7f3-9d25-4f29-b18b-a3346efc5653 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:23:25.139430 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-df2df7f3-9d25-4f29-b18b-a3346efc5653 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:23:25.146196 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:23:25.231622 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2df7f3-9d25-4f29-b18b-a3346efc5653 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:23:25.233243 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2df7f3-9d25-4f29-b18b-a3346efc5653 service nova] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:23:25.251180 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 555/1108] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 02:23:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 02:23:26.300748 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531953ef-4807-4996-9108-b2051a63f357 None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:23:26.301325 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531953ef-4807-4996-9108-b2051a63f357 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:23:26.301325 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531953ef-4807-4996-9108-b2051a63f357 None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:23:26.302609 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 554/1109] 127.0.0.1 () {54 vars in 901 bytes} [Wed Oct 12 02:23:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 02:23:26.309254 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ea00d4-cea2-414a-b1a2-a6f7afc9ed9c None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:23:26.309671 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ea00d4-cea2-414a-b1a2-a6f7afc9ed9c None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:23:26.309777 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ea00d4-cea2-414a-b1a2-a6f7afc9ed9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:23:26.393677 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-a0ea00d4-cea2-414a-b1a2-a6f7afc9ed9c None None] MFA Rules not processed for user `a326a5bb7364479382f528a592371656`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:23:26.394867 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-a0ea00d4-cea2-414a-b1a2-a6f7afc9ed9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:23:26.460753 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:23:26.490002 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 556/1110] 127.0.0.1 () {58 vars in 998 bytes} [Wed Oct 12 02:23:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 02:23:26.639920 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531953ef-4807-4996-9108-b2051a63f357 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:23:26.641463 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-531953ef-4807-4996-9108-b2051a63f357 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:23:26.659024 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:23:26.785540 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531953ef-4807-4996-9108-b2051a63f357 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:23:26.870815 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:23:26.895878 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af5daca-5e21-4fd2-924b-fcfa43ef8459 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fca96c111b45b795fb757f77908ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'beb6def6fcad45959e56425bb8bff4d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:23:26.896411 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af5daca-5e21-4fd2-924b-fcfa43ef8459 service nova] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:23:26.896709 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af5daca-5e21-4fd2-924b-fcfa43ef8459 service nova] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:23:26.896972 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af5daca-5e21-4fd2-924b-fcfa43ef8459 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:23:26.899077 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-7af5daca-5e21-4fd2-924b-fcfa43ef8459 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:23:26.988802 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af5daca-5e21-4fd2-924b-fcfa43ef8459 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:23:26.990385 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af5daca-5e21-4fd2-924b-fcfa43ef8459 service nova] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:23:27.009425 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 555/1111] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 02:23:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 02:23:28.065589 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fe5777-e3c5-4b07-a7ca-a64441402cb8 None None] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:23:28.066173 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fe5777-e3c5-4b07-a7ca-a64441402cb8 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:23:28.066173 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fe5777-e3c5-4b07-a7ca-a64441402cb8 None None] PATH_INFO: `/` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:23:28.067460 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 557/1112] 127.0.0.1 () {54 vars in 901 bytes} [Wed Oct 12 02:23:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 02:23:28.074198 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bb945c-57f8-4689-b8ff-3874715ea4e8 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:23:28.074654 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bb945c-57f8-4689-b8ff-3874715ea4e8 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:23:28.074760 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bb945c-57f8-4689-b8ff-3874715ea4e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:23:28.151701 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-59bb945c-57f8-4689-b8ff-3874715ea4e8 None None] MFA Rules not processed for user `a326a5bb7364479382f528a592371656`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:23:28.152979 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-59bb945c-57f8-4689-b8ff-3874715ea4e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:23:28.193923 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:23:28.248604 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 556/1113] 127.0.0.1 () {58 vars in 998 bytes} [Wed Oct 12 02:23:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 02:23:28.402423 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fe5777-e3c5-4b07-a7ca-a64441402cb8 None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:23:28.403943 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-f1fe5777-e3c5-4b07-a7ca-a64441402cb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:23:28.552154 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fe5777-e3c5-4b07-a7ca-a64441402cb8 None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:23:28.606654 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:23:28.666167 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180bf33f-e8b3-421b-b345-5987c61e0807 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fca96c111b45b795fb757f77908ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'beb6def6fcad45959e56425bb8bff4d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:23:28.666703 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180bf33f-e8b3-421b-b345-5987c61e0807 service nova] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:23:28.666979 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180bf33f-e8b3-421b-b345-5987c61e0807 service nova] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:23:28.667274 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180bf33f-e8b3-421b-b345-5987c61e0807 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:23:28.668908 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-180bf33f-e8b3-421b-b345-5987c61e0807 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:23:28.757451 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180bf33f-e8b3-421b-b345-5987c61e0807 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:23:28.759092 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180bf33f-e8b3-421b-b345-5987c61e0807 service nova] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:23:28.776846 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 558/1114] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 02:23:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 02:23:29.822335 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df55a955-9aaf-4774-ba87-9534e226d76e None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:23:29.822841 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df55a955-9aaf-4774-ba87-9534e226d76e None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:23:29.822841 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df55a955-9aaf-4774-ba87-9534e226d76e None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:23:29.824113 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 557/1115] 127.0.0.1 () {54 vars in 901 bytes} [Wed Oct 12 02:23:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 02:23:29.830251 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed604ce-4bbe-4c9e-ba4f-8d58b7ebfa21 None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:23:29.830703 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed604ce-4bbe-4c9e-ba4f-8d58b7ebfa21 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:23:29.830816 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed604ce-4bbe-4c9e-ba4f-8d58b7ebfa21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:23:29.906703 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-aed604ce-4bbe-4c9e-ba4f-8d58b7ebfa21 None None] MFA Rules not processed for user `a326a5bb7364479382f528a592371656`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:23:29.907901 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-aed604ce-4bbe-4c9e-ba4f-8d58b7ebfa21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:23:29.909930 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:23:30.006225 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 559/1116] 127.0.0.1 () {58 vars in 998 bytes} [Wed Oct 12 02:23:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 02:23:30.156988 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df55a955-9aaf-4774-ba87-9534e226d76e None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:23:30.158493 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-df55a955-9aaf-4774-ba87-9534e226d76e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:23:30.303092 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df55a955-9aaf-4774-ba87-9534e226d76e None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:23:30.330522 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:23:30.418281 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4652fb-45f8-4f7c-95a0-6a1f3ebe4157 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fca96c111b45b795fb757f77908ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'beb6def6fcad45959e56425bb8bff4d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:23:30.418800 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4652fb-45f8-4f7c-95a0-6a1f3ebe4157 service nova] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:23:30.419077 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4652fb-45f8-4f7c-95a0-6a1f3ebe4157 service nova] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:23:30.419347 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4652fb-45f8-4f7c-95a0-6a1f3ebe4157 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:23:30.420983 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-ee4652fb-45f8-4f7c-95a0-6a1f3ebe4157 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:23:30.510992 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4652fb-45f8-4f7c-95a0-6a1f3ebe4157 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:23:30.512596 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4652fb-45f8-4f7c-95a0-6a1f3ebe4157 service nova] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:23:30.530515 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 558/1117] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 02:23:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 02:23:32.621203 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f72625-298c-43a7-9e9a-0cc703120655 None None] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:23:32.621759 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f72625-298c-43a7-9e9a-0cc703120655 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:23:32.621759 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f72625-298c-43a7-9e9a-0cc703120655 None None] PATH_INFO: `/` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:23:32.623107 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 560/1118] 127.0.0.1 () {54 vars in 917 bytes} [Wed Oct 12 02:23:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 02:23:32.628421 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bd7030-4dcd-4e7a-aea6-97a368dc203a None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:23:32.628877 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bd7030-4dcd-4e7a-aea6-97a368dc203a None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:23:32.629009 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bd7030-4dcd-4e7a-aea6-97a368dc203a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:23:32.671561 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:23:32.698040 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-61bd7030-4dcd-4e7a-aea6-97a368dc203a None None] MFA Rules not processed for user `a326a5bb7364479382f528a592371656`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:23:32.699255 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-61bd7030-4dcd-4e7a-aea6-97a368dc203a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:23:32.794745 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 559/1119] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Oct 12 02:23:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 02:23:33.077389 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f72625-298c-43a7-9e9a-0cc703120655 None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:23:33.078965 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-15f72625-298c-43a7-9e9a-0cc703120655 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:23:33.183230 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f72625-298c-43a7-9e9a-0cc703120655 None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:23:33.215890 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:23:33.259519 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fec5c0-235c-47c9-8149-f01cae1885d4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5223b5cab3114e9b9a13c582f8ef8386', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'beb6def6fcad45959e56425bb8bff4d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:23:33.260115 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fec5c0-235c-47c9-8149-f01cae1885d4 service neutron] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:23:33.260387 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fec5c0-235c-47c9-8149-f01cae1885d4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:23:33.260681 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fec5c0-235c-47c9-8149-f01cae1885d4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:23:33.262297 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-e3fec5c0-235c-47c9-8149-f01cae1885d4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:23:33.371147 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fec5c0-235c-47c9-8149-f01cae1885d4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:23:33.372544 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fec5c0-235c-47c9-8149-f01cae1885d4 service neutron] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:23:33.390755 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 561/1120] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 02:23:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 02:23:35.695024 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b3bdb2-036c-4033-8dda-f0c9c659b815 None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:23:35.696074 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b3bdb2-036c-4033-8dda-f0c9c659b815 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:23:35.696191 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b3bdb2-036c-4033-8dda-f0c9c659b815 None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:23:35.697544 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 560/1121] 127.0.0.1 () {54 vars in 917 bytes} [Wed Oct 12 02:23:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 02:23:35.702760 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156b898b-e4b4-46e6-abfe-8e33e459f624 None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:23:35.703195 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156b898b-e4b4-46e6-abfe-8e33e459f624 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:23:35.703293 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156b898b-e4b4-46e6-abfe-8e33e459f624 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:23:35.768158 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-156b898b-e4b4-46e6-abfe-8e33e459f624 None None] MFA Rules not processed for user `a326a5bb7364479382f528a592371656`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:23:35.769375 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-156b898b-e4b4-46e6-abfe-8e33e459f624 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:23:35.782037 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:23:35.866436 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 562/1122] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Oct 12 02:23:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 02:23:36.154112 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b3bdb2-036c-4033-8dda-f0c9c659b815 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:23:36.155679 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-70b3bdb2-036c-4033-8dda-f0c9c659b815 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:23:36.259405 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b3bdb2-036c-4033-8dda-f0c9c659b815 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:23:36.271856 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:23:36.331854 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0d47d3-3cbe-4b8a-928d-36c82e8b033e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5223b5cab3114e9b9a13c582f8ef8386', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'beb6def6fcad45959e56425bb8bff4d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:23:36.332447 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0d47d3-3cbe-4b8a-928d-36c82e8b033e service neutron] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:23:36.332748 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0d47d3-3cbe-4b8a-928d-36c82e8b033e service neutron] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:23:36.333014 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0d47d3-3cbe-4b8a-928d-36c82e8b033e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:23:36.334599 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-4e0d47d3-3cbe-4b8a-928d-36c82e8b033e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:23:36.442284 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0d47d3-3cbe-4b8a-928d-36c82e8b033e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:23:36.443624 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0d47d3-3cbe-4b8a-928d-36c82e8b033e service neutron] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:23:36.461683 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 561/1123] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 02:23:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 02:23:38.897711 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ee9b51-7706-4fd1-9efe-0df6df2261e5 None None] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:23:38.898258 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ee9b51-7706-4fd1-9efe-0df6df2261e5 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:23:38.898258 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ee9b51-7706-4fd1-9efe-0df6df2261e5 None None] PATH_INFO: `/` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:23:38.899967 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 563/1124] 127.0.0.1 () {54 vars in 917 bytes} [Wed Oct 12 02:23:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 02:23:38.905376 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b8496d-563b-40bf-bec0-a9bff0d976e9 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:23:38.905830 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b8496d-563b-40bf-bec0-a9bff0d976e9 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:23:38.905939 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b8496d-563b-40bf-bec0-a9bff0d976e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:23:38.954727 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:23:38.972987 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-45b8496d-563b-40bf-bec0-a9bff0d976e9 None None] MFA Rules not processed for user `a326a5bb7364479382f528a592371656`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:23:38.974461 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-45b8496d-563b-40bf-bec0-a9bff0d976e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:23:39.069683 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 562/1125] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Oct 12 02:23:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 02:23:39.354419 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ee9b51-7706-4fd1-9efe-0df6df2261e5 None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:23:39.355962 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-76ee9b51-7706-4fd1-9efe-0df6df2261e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:23:39.456981 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ee9b51-7706-4fd1-9efe-0df6df2261e5 None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:23:39.496530 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:23:39.530142 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2e69b0-869b-4fde-b6c3-251573a1a1aa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5223b5cab3114e9b9a13c582f8ef8386', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'beb6def6fcad45959e56425bb8bff4d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:23:39.530741 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2e69b0-869b-4fde-b6c3-251573a1a1aa service neutron] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:23:39.531013 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2e69b0-869b-4fde-b6c3-251573a1a1aa service neutron] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:23:39.531278 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2e69b0-869b-4fde-b6c3-251573a1a1aa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:23:39.532880 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-0f2e69b0-869b-4fde-b6c3-251573a1a1aa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:23:39.639254 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2e69b0-869b-4fde-b6c3-251573a1a1aa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:23:39.640700 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2e69b0-869b-4fde-b6c3-251573a1a1aa service neutron] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:23:39.659033 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 564/1126] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 02:23:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 02:23:41.955155 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b7bb99-8080-4c40-a0ba-27c7c9481372 None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:23:41.955714 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b7bb99-8080-4c40-a0ba-27c7c9481372 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:23:41.955714 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b7bb99-8080-4c40-a0ba-27c7c9481372 None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:23:41.957077 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 563/1127] 127.0.0.1 () {54 vars in 917 bytes} [Wed Oct 12 02:23:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 02:23:41.963028 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c2531e-51db-47d9-abfd-b4bbc73760db None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:23:41.963468 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c2531e-51db-47d9-abfd-b4bbc73760db None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:23:41.963566 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c2531e-51db-47d9-abfd-b4bbc73760db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:23:42.029309 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-c5c2531e-51db-47d9-abfd-b4bbc73760db None None] MFA Rules not processed for user `a326a5bb7364479382f528a592371656`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:23:42.030510 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-c5c2531e-51db-47d9-abfd-b4bbc73760db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:23:42.050996 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:23:42.126802 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 565/1128] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Oct 12 02:23:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 02:23:42.421475 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b7bb99-8080-4c40-a0ba-27c7c9481372 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:23:42.423045 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-61b7bb99-8080-4c40-a0ba-27c7c9481372 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:23:42.528844 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b7bb99-8080-4c40-a0ba-27c7c9481372 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:23:42.549881 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:23:42.604423 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a5a59d-ceaa-46b6-b753-517f2f10cb6e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5223b5cab3114e9b9a13c582f8ef8386', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'beb6def6fcad45959e56425bb8bff4d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:23:42.605065 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a5a59d-ceaa-46b6-b753-517f2f10cb6e service neutron] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:23:42.605342 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a5a59d-ceaa-46b6-b753-517f2f10cb6e service neutron] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:23:42.605619 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a5a59d-ceaa-46b6-b753-517f2f10cb6e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:23:42.607216 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-62a5a59d-ceaa-46b6-b753-517f2f10cb6e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:23:42.714911 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a5a59d-ceaa-46b6-b753-517f2f10cb6e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:23:42.716274 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a5a59d-ceaa-46b6-b753-517f2f10cb6e service neutron] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:23:42.734899 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 564/1129] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 02:23:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 02:23:44.929906 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479c3157-485d-492a-8d5f-61f65fabf19d None None] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:23:44.930459 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479c3157-485d-492a-8d5f-61f65fabf19d None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:23:44.930991 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479c3157-485d-492a-8d5f-61f65fabf19d None None] PATH_INFO: `/` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:23:44.932347 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 566/1130] 127.0.0.1 () {54 vars in 917 bytes} [Wed Oct 12 02:23:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 02:23:44.937717 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff77477-1acc-4204-8377-33e1a9804d74 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:23:44.938138 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff77477-1acc-4204-8377-33e1a9804d74 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:23:44.938275 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff77477-1acc-4204-8377-33e1a9804d74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:23:45.001669 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:23:45.004573 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-eff77477-1acc-4204-8377-33e1a9804d74 None None] MFA Rules not processed for user `a326a5bb7364479382f528a592371656`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:23:45.006368 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-eff77477-1acc-4204-8377-33e1a9804d74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:23:45.103840 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 565/1131] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Oct 12 02:23:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 02:23:45.387648 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479c3157-485d-492a-8d5f-61f65fabf19d None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:23:45.389260 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-479c3157-485d-492a-8d5f-61f65fabf19d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:23:45.491004 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479c3157-485d-492a-8d5f-61f65fabf19d None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:23:45.540712 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:23:45.565374 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85380380-7342-493e-89b1-d5ee3bbab8a7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5223b5cab3114e9b9a13c582f8ef8386', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'beb6def6fcad45959e56425bb8bff4d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:23:45.565977 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85380380-7342-493e-89b1-d5ee3bbab8a7 service neutron] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:23:45.566255 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85380380-7342-493e-89b1-d5ee3bbab8a7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:23:45.566520 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85380380-7342-493e-89b1-d5ee3bbab8a7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:23:45.568102 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-85380380-7342-493e-89b1-d5ee3bbab8a7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:23:45.676934 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85380380-7342-493e-89b1-d5ee3bbab8a7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:23:45.678360 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85380380-7342-493e-89b1-d5ee3bbab8a7 service neutron] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:23:45.697074 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 567/1132] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 02:23:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 02:23:47.919024 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a44b53-70e3-4610-993b-076ef8f606d2 None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:23:47.919547 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a44b53-70e3-4610-993b-076ef8f606d2 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:23:47.919547 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a44b53-70e3-4610-993b-076ef8f606d2 None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:23:47.920933 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 566/1133] 127.0.0.1 () {54 vars in 917 bytes} [Wed Oct 12 02:23:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 02:23:47.926166 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a983dcd-2cd4-464e-9e22-55d3e0a35aac None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:23:47.926572 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a983dcd-2cd4-464e-9e22-55d3e0a35aac None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:23:47.926694 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a983dcd-2cd4-464e-9e22-55d3e0a35aac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:23:47.999473 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-4a983dcd-2cd4-464e-9e22-55d3e0a35aac None None] MFA Rules not processed for user `a326a5bb7364479382f528a592371656`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:23:48.000697 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-4a983dcd-2cd4-464e-9e22-55d3e0a35aac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:23:48.028880 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:23:48.097315 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 568/1134] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Oct 12 02:23:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 02:23:48.385040 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a44b53-70e3-4610-993b-076ef8f606d2 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:23:48.386571 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-e1a44b53-70e3-4610-993b-076ef8f606d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:23:48.489099 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a44b53-70e3-4610-993b-076ef8f606d2 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:23:48.518561 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:23:48.565448 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8e5ca7-3bd4-407b-91e8-b0af5f60e18b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5223b5cab3114e9b9a13c582f8ef8386', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'beb6def6fcad45959e56425bb8bff4d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:23:48.566050 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8e5ca7-3bd4-407b-91e8-b0af5f60e18b service neutron] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:23:48.566327 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8e5ca7-3bd4-407b-91e8-b0af5f60e18b service neutron] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:23:48.566595 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8e5ca7-3bd4-407b-91e8-b0af5f60e18b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:23:48.568253 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-2a8e5ca7-3bd4-407b-91e8-b0af5f60e18b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:23:48.674590 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8e5ca7-3bd4-407b-91e8-b0af5f60e18b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:23:48.676011 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8e5ca7-3bd4-407b-91e8-b0af5f60e18b service neutron] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:23:48.694169 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 567/1135] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 02:23:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 02:23:50.881429 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d96d3e-bc79-4297-b90a-cc9db5465108 None None] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:23:50.881959 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d96d3e-bc79-4297-b90a-cc9db5465108 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:23:50.881959 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d96d3e-bc79-4297-b90a-cc9db5465108 None None] PATH_INFO: `/` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:23:50.883219 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 569/1136] 127.0.0.1 () {54 vars in 917 bytes} [Wed Oct 12 02:23:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 02:23:50.888739 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a273d8c-a7af-423a-9168-0f368d2df6b7 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:23:50.889143 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a273d8c-a7af-423a-9168-0f368d2df6b7 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:23:50.889297 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a273d8c-a7af-423a-9168-0f368d2df6b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:23:50.955389 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-1a273d8c-a7af-423a-9168-0f368d2df6b7 None None] MFA Rules not processed for user `a326a5bb7364479382f528a592371656`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:23:50.956649 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-1a273d8c-a7af-423a-9168-0f368d2df6b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:23:50.965405 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:23:51.054432 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 568/1137] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Oct 12 02:23:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 02:23:51.341186 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d96d3e-bc79-4297-b90a-cc9db5465108 None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:23:51.342714 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-b3d96d3e-bc79-4297-b90a-cc9db5465108 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:23:51.445270 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d96d3e-bc79-4297-b90a-cc9db5465108 None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:23:51.499504 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:23:51.517485 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abdd4c3-5337-4fa8-bc51-0a90dfc82e7d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5223b5cab3114e9b9a13c582f8ef8386', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'beb6def6fcad45959e56425bb8bff4d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:23:51.518076 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abdd4c3-5337-4fa8-bc51-0a90dfc82e7d service neutron] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:23:51.518348 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abdd4c3-5337-4fa8-bc51-0a90dfc82e7d service neutron] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:23:51.518614 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abdd4c3-5337-4fa8-bc51-0a90dfc82e7d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:23:51.520174 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-8abdd4c3-5337-4fa8-bc51-0a90dfc82e7d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:23:51.631673 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8abdd4c3-5337-4fa8-bc51-0a90dfc82e7d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:23:51.633064 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8abdd4c3-5337-4fa8-bc51-0a90dfc82e7d service neutron] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:23:51.651936 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 570/1138] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 02:23:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 02:23:53.838532 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4974b5-15d2-44c5-9c77-36aa9be8d2d2 None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:23:53.839134 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4974b5-15d2-44c5-9c77-36aa9be8d2d2 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:23:53.839134 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4974b5-15d2-44c5-9c77-36aa9be8d2d2 None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:23:53.840331 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 569/1139] 127.0.0.1 () {54 vars in 917 bytes} [Wed Oct 12 02:23:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 02:23:53.845837 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ca1ecc-5011-4f52-9c45-ce6ecf8da22b None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:23:53.846242 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ca1ecc-5011-4f52-9c45-ce6ecf8da22b None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:23:53.846383 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ca1ecc-5011-4f52-9c45-ce6ecf8da22b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:23:53.912257 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-c9ca1ecc-5011-4f52-9c45-ce6ecf8da22b None None] MFA Rules not processed for user `a326a5bb7364479382f528a592371656`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:23:53.913484 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-c9ca1ecc-5011-4f52-9c45-ce6ecf8da22b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:23:53.951606 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:23:54.010381 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 571/1140] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Oct 12 02:23:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 02:23:54.294928 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4974b5-15d2-44c5-9c77-36aa9be8d2d2 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:23:54.296555 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-4b4974b5-15d2-44c5-9c77-36aa9be8d2d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:23:54.398033 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4974b5-15d2-44c5-9c77-36aa9be8d2d2 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:23:54.436128 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:23:54.470670 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a919ab-4c79-4c4b-8964-8d2c46632254 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5223b5cab3114e9b9a13c582f8ef8386', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'beb6def6fcad45959e56425bb8bff4d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:23:54.471264 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a919ab-4c79-4c4b-8964-8d2c46632254 service neutron] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:23:54.471536 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a919ab-4c79-4c4b-8964-8d2c46632254 service neutron] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:23:54.471806 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a919ab-4c79-4c4b-8964-8d2c46632254 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:23:54.473404 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-81a919ab-4c79-4c4b-8964-8d2c46632254 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:23:54.582225 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a919ab-4c79-4c4b-8964-8d2c46632254 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:23:54.583655 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a919ab-4c79-4c4b-8964-8d2c46632254 service neutron] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:23:54.601905 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 570/1141] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 02:23:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 02:23:56.762128 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5552bcda-8108-4368-9b15-64e81aa1a028 None None] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:23:56.762691 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5552bcda-8108-4368-9b15-64e81aa1a028 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:23:56.762691 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5552bcda-8108-4368-9b15-64e81aa1a028 None None] PATH_INFO: `/` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:23:56.763996 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 572/1142] 127.0.0.1 () {54 vars in 917 bytes} [Wed Oct 12 02:23:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 12 02:23:56.769355 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f4d550-ac47-45c2-8e33-f691160fd6ba None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:23:56.769769 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f4d550-ac47-45c2-8e33-f691160fd6ba None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:23:56.769907 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f4d550-ac47-45c2-8e33-f691160fd6ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:23:56.836270 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-44f4d550-ac47-45c2-8e33-f691160fd6ba None None] MFA Rules not processed for user `a326a5bb7364479382f528a592371656`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:23:56.837993 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-44f4d550-ac47-45c2-8e33-f691160fd6ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:23:56.856519 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:23:56.934411 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 571/1143] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Oct 12 02:23:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 02:23:57.219041 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5552bcda-8108-4368-9b15-64e81aa1a028 None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:23:57.220598 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-5552bcda-8108-4368-9b15-64e81aa1a028 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:23:57.322058 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5552bcda-8108-4368-9b15-64e81aa1a028 None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:23:57.388256 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:23:57.395254 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680d6cde-7b8b-46a2-bbb5-37d14a6cf532 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5223b5cab3114e9b9a13c582f8ef8386', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'beb6def6fcad45959e56425bb8bff4d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:23:57.395881 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680d6cde-7b8b-46a2-bbb5-37d14a6cf532 service neutron] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:23:57.396154 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680d6cde-7b8b-46a2-bbb5-37d14a6cf532 service neutron] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:23:57.396418 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680d6cde-7b8b-46a2-bbb5-37d14a6cf532 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:23:57.398057 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-680d6cde-7b8b-46a2-bbb5-37d14a6cf532 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:23:57.506721 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680d6cde-7b8b-46a2-bbb5-37d14a6cf532 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:23:57.508067 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680d6cde-7b8b-46a2-bbb5-37d14a6cf532 service neutron] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:23:57.526634 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 573/1144] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 02:23:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 02:23:59.695720 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e46c89-e6e2-4195-aa81-28d0aa75cc27 None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:23:59.696196 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e46c89-e6e2-4195-aa81-28d0aa75cc27 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:23:59.696307 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e46c89-e6e2-4195-aa81-28d0aa75cc27 None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:23:59.698377 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 572/1145] 127.0.0.1 () {54 vars in 917 bytes} [Wed Oct 12 02:23:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 02:23:59.703649 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6403e2-b6ef-4888-9c24-e1379a97a294 None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:23:59.704098 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6403e2-b6ef-4888-9c24-e1379a97a294 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:23:59.704204 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6403e2-b6ef-4888-9c24-e1379a97a294 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:23:59.770508 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-ac6403e2-b6ef-4888-9c24-e1379a97a294 None None] MFA Rules not processed for user `a326a5bb7364479382f528a592371656`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:23:59.771715 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-ac6403e2-b6ef-4888-9c24-e1379a97a294 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:23:59.819178 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:23:59.867522 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 574/1146] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Oct 12 02:23:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 02:24:00.153872 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e46c89-e6e2-4195-aa81-28d0aa75cc27 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:24:00.155490 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-35e46c89-e6e2-4195-aa81-28d0aa75cc27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:24:00.263133 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e46c89-e6e2-4195-aa81-28d0aa75cc27 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:24:00.310207 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:24:00.335467 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d58ece-51d9-45cd-98ea-e3f859799eeb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5223b5cab3114e9b9a13c582f8ef8386', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'beb6def6fcad45959e56425bb8bff4d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:24:00.336061 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d58ece-51d9-45cd-98ea-e3f859799eeb service neutron] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:24:00.336335 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d58ece-51d9-45cd-98ea-e3f859799eeb service neutron] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:24:00.336634 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d58ece-51d9-45cd-98ea-e3f859799eeb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:24:00.338893 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-e4d58ece-51d9-45cd-98ea-e3f859799eeb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:24:00.444515 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d58ece-51d9-45cd-98ea-e3f859799eeb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:24:00.445923 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d58ece-51d9-45cd-98ea-e3f859799eeb service neutron] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:24:00.464234 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 573/1147] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 02:24:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 12 02:24:09.866107 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=22 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:24:10.461957 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=66 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:24:20.507479 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68bd902-7f16-48a9-99cf-ca3cce1de62e None None] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:24:20.508023 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68bd902-7f16-48a9-99cf-ca3cce1de62e None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:24:20.508023 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68bd902-7f16-48a9-99cf-ca3cce1de62e None None] PATH_INFO: `/` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:24:20.509310 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 575/1148] 10.222.0.18 () {54 vars in 927 bytes} [Wed Oct 12 02:24:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 02:24:20.515055 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdad1edf-803f-4898-a9d6-6085d2ddb4f6 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:24:20.515470 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdad1edf-803f-4898-a9d6-6085d2ddb4f6 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:24:20.515594 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdad1edf-803f-4898-a9d6-6085d2ddb4f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:24:20.583892 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-bdad1edf-803f-4898-a9d6-6085d2ddb4f6 None None] MFA Rules not processed for user `a326a5bb7364479382f528a592371656`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:24:20.585099 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-bdad1edf-803f-4898-a9d6-6085d2ddb4f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:24:20.680220 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 574/1149] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Oct 12 02:24:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 02:24:20.976674 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ebbe3b-19ba-46ed-93f8-525fc43bee8c None None] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:24:20.976992 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ebbe3b-19ba-46ed-93f8-525fc43bee8c None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:24:20.977564 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ebbe3b-19ba-46ed-93f8-525fc43bee8c None None] PATH_INFO: `/` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:24:20.979725 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 576/1150] 10.222.0.18 () {54 vars in 962 bytes} [Wed Oct 12 02:24:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 12 02:24:20.985850 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bfd647-9660-48b7-afa4-1d79195773a8 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:24:20.986139 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bfd647-9660-48b7-afa4-1d79195773a8 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:24:20.986414 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bfd647-9660-48b7-afa4-1d79195773a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:24:21.065102 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-c6bfd647-9660-48b7-afa4-1d79195773a8 None None] MFA Rules not processed for user `8285a132afeb47558e1b3dcedfd7b4e7`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:24:21.066309 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-c6bfd647-9660-48b7-afa4-1d79195773a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:24:21.086763 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:24:21.143485 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 575/1151] 10.222.0.18 () {58 vars in 1059 bytes} [Wed Oct 12 02:24:20 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 02:24:21.151306 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ebbe3b-19ba-46ed-93f8-525fc43bee8c None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:24:21.152836 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-a7ebbe3b-19ba-46ed-93f8-525fc43bee8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:24:21.255029 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ebbe3b-19ba-46ed-93f8-525fc43bee8c None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:24:21.326827 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e722ef-bb09-491f-a05c-1bd679ca1d58 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8285a132afeb47558e1b3dcedfd7b4e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'beb6def6fcad45959e56425bb8bff4d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:24:21.327417 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e722ef-bb09-491f-a05c-1bd679ca1d58 service glance] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:24:21.327689 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e722ef-bb09-491f-a05c-1bd679ca1d58 service glance] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:24:21.327956 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e722ef-bb09-491f-a05c-1bd679ca1d58 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:24:21.329562 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-77e722ef-bb09-491f-a05c-1bd679ca1d58 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:24:21.383821 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:24:21.438154 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e722ef-bb09-491f-a05c-1bd679ca1d58 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:24:21.439571 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e722ef-bb09-491f-a05c-1bd679ca1d58 service glance] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:24:21.457304 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 577/1152] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 02:24:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 02:24:23.710628 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76be92c-d868-4442-b3f1-00772ab25bd2 None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:24:23.711128 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76be92c-d868-4442-b3f1-00772ab25bd2 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:24:23.711243 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76be92c-d868-4442-b3f1-00772ab25bd2 None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:24:23.712524 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 576/1153] 10.222.0.18 () {54 vars in 927 bytes} [Wed Oct 12 02:24:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 02:24:23.717944 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d9e1a2-9607-4c05-a0ab-fbcd795c6155 None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:24:23.718375 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d9e1a2-9607-4c05-a0ab-fbcd795c6155 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:24:23.718505 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d9e1a2-9607-4c05-a0ab-fbcd795c6155 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:24:23.783625 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-10d9e1a2-9607-4c05-a0ab-fbcd795c6155 None None] MFA Rules not processed for user `a326a5bb7364479382f528a592371656`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:24:23.784880 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-10d9e1a2-9607-4c05-a0ab-fbcd795c6155 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:24:23.880832 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 578/1154] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Oct 12 02:24:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 02:24:24.168446 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76be92c-d868-4442-b3f1-00772ab25bd2 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:24:24.170075 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-b76be92c-d868-4442-b3f1-00772ab25bd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:24:24.317636 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76be92c-d868-4442-b3f1-00772ab25bd2 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:24:24.375355 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:24:24.427231 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705adc7e-82d2-48f9-8797-92290c2f0295 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:24:24.427744 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705adc7e-82d2-48f9-8797-92290c2f0295 admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:24:24.428016 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705adc7e-82d2-48f9-8797-92290c2f0295 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:24:24.428283 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705adc7e-82d2-48f9-8797-92290c2f0295 admin admin] PATH_INFO: `/v3/projects` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:24:24.428944 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705adc7e-82d2-48f9-8797-92290c2f0295 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:24:24.429957 dv-cinder-849143-14-smb devstack@keystone.service[81362]: WARNING py.warnings [None req-705adc7e-82d2-48f9-8797-92290c2f0295 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 12 02:24:24.429957 dv-cinder-849143-14-smb devstack@keystone.service[81362]: warnings.warn(msg) Oct 12 02:24:24.429957 dv-cinder-849143-14-smb devstack@keystone.service[81362]: Oct 12 02:24:24.431079 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705adc7e-82d2-48f9-8797-92290c2f0295 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:24:24.452331 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 577/1155] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Oct 12 02:24:24 2022] GET /identity/v3/projects => generated 2553 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 02:24:26.671192 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab552043-f390-49c3-ad06-270fe359f163 None None] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:24:26.671801 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab552043-f390-49c3-ad06-270fe359f163 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:24:26.671801 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab552043-f390-49c3-ad06-270fe359f163 None None] PATH_INFO: `/` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:24:26.673115 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 579/1156] 10.222.0.18 () {54 vars in 927 bytes} [Wed Oct 12 02:24:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 02:24:26.678334 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb10956a-669d-4835-a2f3-94ee78674c49 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:24:26.678793 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb10956a-669d-4835-a2f3-94ee78674c49 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:24:26.678901 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb10956a-669d-4835-a2f3-94ee78674c49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:24:26.745760 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-eb10956a-669d-4835-a2f3-94ee78674c49 None None] MFA Rules not processed for user `a326a5bb7364479382f528a592371656`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:24:26.746958 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-eb10956a-669d-4835-a2f3-94ee78674c49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:24:26.842196 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 578/1157] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Oct 12 02:24:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 02:24:27.135702 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab552043-f390-49c3-ad06-270fe359f163 None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:24:27.137320 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-ab552043-f390-49c3-ad06-270fe359f163 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:24:27.147072 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:24:27.282643 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab552043-f390-49c3-ad06-270fe359f163 None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:24:27.363899 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:24:27.397198 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a3be81-ed11-46be-82bd-2bd1500742a8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fca96c111b45b795fb757f77908ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'beb6def6fcad45959e56425bb8bff4d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:24:27.397796 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a3be81-ed11-46be-82bd-2bd1500742a8 service nova] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:24:27.398073 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a3be81-ed11-46be-82bd-2bd1500742a8 service nova] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:24:27.398342 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a3be81-ed11-46be-82bd-2bd1500742a8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:24:27.399919 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-01a3be81-ed11-46be-82bd-2bd1500742a8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:24:27.487991 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a3be81-ed11-46be-82bd-2bd1500742a8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:24:27.489614 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a3be81-ed11-46be-82bd-2bd1500742a8 service nova] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:24:27.507290 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 580/1158] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 02:24:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 02:24:29.835396 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c9f57c-8610-43dc-9ba5-da5c55dd3c81 None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:24:29.835919 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c9f57c-8610-43dc-9ba5-da5c55dd3c81 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:24:29.835919 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c9f57c-8610-43dc-9ba5-da5c55dd3c81 None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:24:29.837244 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 579/1159] 10.222.0.18 () {54 vars in 927 bytes} [Wed Oct 12 02:24:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 02:24:29.842856 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cb6578-51b1-47d2-ba40-09b650439fd5 None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:24:29.843287 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cb6578-51b1-47d2-ba40-09b650439fd5 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:24:29.843390 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cb6578-51b1-47d2-ba40-09b650439fd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:24:29.908161 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-76cb6578-51b1-47d2-ba40-09b650439fd5 None None] MFA Rules not processed for user `a326a5bb7364479382f528a592371656`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:24:29.909382 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-76cb6578-51b1-47d2-ba40-09b650439fd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:24:29.955271 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:24:30.006109 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 581/1160] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Oct 12 02:24:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 02:24:30.301032 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c9f57c-8610-43dc-9ba5-da5c55dd3c81 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:24:30.302620 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-81c9f57c-8610-43dc-9ba5-da5c55dd3c81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:24:30.328615 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:24:30.407684 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c9f57c-8610-43dc-9ba5-da5c55dd3c81 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:24:30.479885 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfee370-44c2-4ae1-9b87-0fc785139ecc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5223b5cab3114e9b9a13c582f8ef8386', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'beb6def6fcad45959e56425bb8bff4d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:24:30.480502 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfee370-44c2-4ae1-9b87-0fc785139ecc service neutron] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:24:30.480778 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfee370-44c2-4ae1-9b87-0fc785139ecc service neutron] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:24:30.481047 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfee370-44c2-4ae1-9b87-0fc785139ecc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:24:30.482621 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-1bfee370-44c2-4ae1-9b87-0fc785139ecc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:24:30.563463 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:24:30.598515 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfee370-44c2-4ae1-9b87-0fc785139ecc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:24:30.599938 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfee370-44c2-4ae1-9b87-0fc785139ecc service neutron] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:24:30.618123 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 580/1161] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 02:24:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 02:24:32.852611 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c1b969-8eb1-48d3-abb3-8978e830e965 None None] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:24:32.853396 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c1b969-8eb1-48d3-abb3-8978e830e965 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:24:32.853396 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c1b969-8eb1-48d3-abb3-8978e830e965 None None] PATH_INFO: `/` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:24:32.855135 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 582/1162] 10.222.0.18 () {54 vars in 927 bytes} [Wed Oct 12 02:24:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 02:24:32.860323 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a36118-49e6-4b94-87eb-cc966204dd3a None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:24:32.860784 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a36118-49e6-4b94-87eb-cc966204dd3a None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:24:32.860909 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a36118-49e6-4b94-87eb-cc966204dd3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:24:32.926071 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-05a36118-49e6-4b94-87eb-cc966204dd3a None None] MFA Rules not processed for user `a326a5bb7364479382f528a592371656`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:24:32.927258 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-05a36118-49e6-4b94-87eb-cc966204dd3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:24:33.024258 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 581/1163] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Oct 12 02:24:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 02:24:33.313899 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c1b969-8eb1-48d3-abb3-8978e830e965 None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:24:33.315473 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-00c1b969-8eb1-48d3-abb3-8978e830e965 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:24:33.418776 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c1b969-8eb1-48d3-abb3-8978e830e965 None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:24:33.490503 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:24:33.492142 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e8b3c2-c2b0-495d-bb67-72d920c8d111 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5223b5cab3114e9b9a13c582f8ef8386', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'beb6def6fcad45959e56425bb8bff4d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:24:33.492952 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e8b3c2-c2b0-495d-bb67-72d920c8d111 service neutron] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:24:33.493430 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e8b3c2-c2b0-495d-bb67-72d920c8d111 service neutron] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:24:33.493917 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e8b3c2-c2b0-495d-bb67-72d920c8d111 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:24:33.495832 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-96e8b3c2-c2b0-495d-bb67-72d920c8d111 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:24:33.609959 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e8b3c2-c2b0-495d-bb67-72d920c8d111 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:24:33.611330 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e8b3c2-c2b0-495d-bb67-72d920c8d111 service neutron] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:24:33.629223 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 583/1164] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 02:24:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 02:24:35.897812 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4015ab50-47a4-49da-8798-1e93ef56b7d0 None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:24:35.898353 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4015ab50-47a4-49da-8798-1e93ef56b7d0 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:24:35.898353 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4015ab50-47a4-49da-8798-1e93ef56b7d0 None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:24:35.899670 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 582/1165] 10.222.0.18 () {54 vars in 927 bytes} [Wed Oct 12 02:24:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 02:24:35.905080 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649285d8-ed76-4181-b882-a3f23bea260f None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:24:35.905533 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649285d8-ed76-4181-b882-a3f23bea260f None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:24:35.905641 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649285d8-ed76-4181-b882-a3f23bea260f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:24:35.971335 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-649285d8-ed76-4181-b882-a3f23bea260f None None] MFA Rules not processed for user `a326a5bb7364479382f528a592371656`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:24:35.972589 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-649285d8-ed76-4181-b882-a3f23bea260f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:24:36.025400 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:24:36.069883 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 584/1166] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Oct 12 02:24:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 02:24:36.366241 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4015ab50-47a4-49da-8798-1e93ef56b7d0 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:24:36.367787 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-4015ab50-47a4-49da-8798-1e93ef56b7d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:24:36.404186 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:24:36.472420 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4015ab50-47a4-49da-8798-1e93ef56b7d0 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:24:36.549387 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478b85e3-3eb9-47fb-a8a9-a5daaa58ccb0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5223b5cab3114e9b9a13c582f8ef8386', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'beb6def6fcad45959e56425bb8bff4d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:24:36.549989 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478b85e3-3eb9-47fb-a8a9-a5daaa58ccb0 service neutron] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:24:36.550266 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478b85e3-3eb9-47fb-a8a9-a5daaa58ccb0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:24:36.550538 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478b85e3-3eb9-47fb-a8a9-a5daaa58ccb0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:24:36.552147 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-478b85e3-3eb9-47fb-a8a9-a5daaa58ccb0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:24:36.632152 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:24:36.662795 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478b85e3-3eb9-47fb-a8a9-a5daaa58ccb0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:24:36.664237 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478b85e3-3eb9-47fb-a8a9-a5daaa58ccb0 service neutron] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:24:36.682907 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 583/1167] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 02:24:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 02:24:39.016136 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b8f06f-1034-4460-af16-26eac4da8c12 None None] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:24:39.016720 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b8f06f-1034-4460-af16-26eac4da8c12 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:24:39.016720 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b8f06f-1034-4460-af16-26eac4da8c12 None None] PATH_INFO: `/` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:24:39.018047 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 585/1168] 10.222.0.18 () {54 vars in 927 bytes} [Wed Oct 12 02:24:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 02:24:39.023329 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37615c9-2ec9-41ff-aa7b-92e5156370f1 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:24:39.023784 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37615c9-2ec9-41ff-aa7b-92e5156370f1 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:24:39.023897 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37615c9-2ec9-41ff-aa7b-92e5156370f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:24:39.090905 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-d37615c9-2ec9-41ff-aa7b-92e5156370f1 None None] MFA Rules not processed for user `a326a5bb7364479382f528a592371656`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:24:39.092118 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-d37615c9-2ec9-41ff-aa7b-92e5156370f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:24:39.190107 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 584/1169] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Oct 12 02:24:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 02:24:39.478899 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b8f06f-1034-4460-af16-26eac4da8c12 None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:24:39.480452 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-18b8f06f-1034-4460-af16-26eac4da8c12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:24:39.582227 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b8f06f-1034-4460-af16-26eac4da8c12 None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:24:39.655166 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff91b6aa-d568-4352-a494-10af963c802b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5223b5cab3114e9b9a13c582f8ef8386', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'beb6def6fcad45959e56425bb8bff4d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:24:39.655762 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff91b6aa-d568-4352-a494-10af963c802b service neutron] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:24:39.656039 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff91b6aa-d568-4352-a494-10af963c802b service neutron] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:24:39.656308 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff91b6aa-d568-4352-a494-10af963c802b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:24:39.657944 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-ff91b6aa-d568-4352-a494-10af963c802b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:24:39.666245 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:24:39.771720 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff91b6aa-d568-4352-a494-10af963c802b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:24:39.773123 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff91b6aa-d568-4352-a494-10af963c802b service neutron] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:24:39.790909 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 586/1170] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 02:24:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 02:24:49.188456 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=82 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:24:49.788663 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=50 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:25:53.442139 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df8de7b-a635-49db-b984-80a20b863517 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:25:53.442743 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df8de7b-a635-49db-b984-80a20b863517 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:25:53.442743 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df8de7b-a635-49db-b984-80a20b863517 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:25:53.519507 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-2df8de7b-a635-49db-b984-80a20b863517 None None] MFA Rules not processed for user `a326a5bb7364479382f528a592371656`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:25:53.520740 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-2df8de7b-a635-49db-b984-80a20b863517 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:25:53.616992 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 585/1171] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 02:25:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 02:25:53.625561 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fb26c6-2d42-45b0-9bf4-7aa4248ff820 None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:25:53.626058 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fb26c6-2d42-45b0-9bf4-7aa4248ff820 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:25:53.626186 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fb26c6-2d42-45b0-9bf4-7aa4248ff820 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:25:53.703205 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-00fb26c6-2d42-45b0-9bf4-7aa4248ff820 None None] MFA Rules not processed for user `a326a5bb7364479382f528a592371656`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:25:53.704315 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-00fb26c6-2d42-45b0-9bf4-7aa4248ff820 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:25:53.798136 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 587/1172] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 02:25:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 02:25:53.802745 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df8de7b-a635-49db-b984-80a20b863517 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:25:53.803967 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-2df8de7b-a635-49db-b984-80a20b863517 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:25:53.815721 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df8de7b-a635-49db-b984-80a20b863517 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:25:53.876955 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:25:53.910663 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89deb20c-bb18-452f-bc11-65cf84afd26e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:25:53.911260 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89deb20c-bb18-452f-bc11-65cf84afd26e admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:25:53.911536 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89deb20c-bb18-452f-bc11-65cf84afd26e admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:25:53.911805 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89deb20c-bb18-452f-bc11-65cf84afd26e admin admin] PATH_INFO: `/v3/domains` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:25:53.912448 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89deb20c-bb18-452f-bc11-65cf84afd26e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 02:25:53.912777 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89deb20c-bb18-452f-bc11-65cf84afd26e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:25:53.913778 dv-cinder-849143-14-smb devstack@keystone.service[81362]: WARNING py.warnings [None req-89deb20c-bb18-452f-bc11-65cf84afd26e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 12 02:25:53.913778 dv-cinder-849143-14-smb devstack@keystone.service[81362]: warnings.warn(msg) Oct 12 02:25:53.913778 dv-cinder-849143-14-smb devstack@keystone.service[81362]: Oct 12 02:25:53.914661 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89deb20c-bb18-452f-bc11-65cf84afd26e admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:25:53.925755 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 586/1173] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Oct 12 02:25:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 02:25:53.935753 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fb26c6-2d42-45b0-9bf4-7aa4248ff820 None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:25:53.944875 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fb26c6-2d42-45b0-9bf4-7aa4248ff820 None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:25:54.007309 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:25:54.040612 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04115c58-35b2-45d6-99e1-4edc9633a44f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:25:54.041218 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04115c58-35b2-45d6-99e1-4edc9633a44f admin admin] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:25:54.041496 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04115c58-35b2-45d6-99e1-4edc9633a44f admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:25:54.041767 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04115c58-35b2-45d6-99e1-4edc9633a44f admin admin] PATH_INFO: `/v3/projects` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:25:54.042386 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04115c58-35b2-45d6-99e1-4edc9633a44f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:25:54.044118 dv-cinder-849143-14-smb devstack@keystone.service[81361]: WARNING py.warnings [None req-04115c58-35b2-45d6-99e1-4edc9633a44f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 12 02:25:54.044118 dv-cinder-849143-14-smb devstack@keystone.service[81361]: warnings.warn(msg) Oct 12 02:25:54.044118 dv-cinder-849143-14-smb devstack@keystone.service[81361]: Oct 12 02:25:54.045338 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04115c58-35b2-45d6-99e1-4edc9633a44f admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:25:54.099487 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 588/1174] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Oct 12 02:25:53 2022] POST /identity/v3/projects => generated 379 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 02:25:54.103707 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89deb20c-bb18-452f-bc11-65cf84afd26e admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:25:54.105296 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-89deb20c-bb18-452f-bc11-65cf84afd26e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:25:54.139714 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89deb20c-bb18-452f-bc11-65cf84afd26e admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:25:54.234422 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d18dea8-2e0d-4745-a6eb-b8c56824e500 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:25:54.235018 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d18dea8-2e0d-4745-a6eb-b8c56824e500 admin admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:25:54.235288 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d18dea8-2e0d-4745-a6eb-b8c56824e500 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:25:54.235551 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d18dea8-2e0d-4745-a6eb-b8c56824e500 admin admin] PATH_INFO: `/v3/users` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:25:54.236238 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d18dea8-2e0d-4745-a6eb-b8c56824e500 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:25:54.237262 dv-cinder-849143-14-smb devstack@keystone.service[81362]: WARNING py.warnings [None req-0d18dea8-2e0d-4745-a6eb-b8c56824e500 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 12 02:25:54.237262 dv-cinder-849143-14-smb devstack@keystone.service[81362]: warnings.warn(msg) Oct 12 02:25:54.237262 dv-cinder-849143-14-smb devstack@keystone.service[81362]: Oct 12 02:25:54.238455 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d18dea8-2e0d-4745-a6eb-b8c56824e500 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:25:54.281329 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 587/1175] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Oct 12 02:25:54 2022] POST /identity/v3/users => generated 290 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 02:25:54.285468 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04115c58-35b2-45d6-99e1-4edc9633a44f admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:25:54.287021 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-04115c58-35b2-45d6-99e1-4edc9633a44f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:25:54.347283 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04115c58-35b2-45d6-99e1-4edc9633a44f admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:25:54.429033 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:25:54.440553 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade8a48b-d8c5-44ae-8a0d-45e64aac7eec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:25:54.441154 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade8a48b-d8c5-44ae-8a0d-45e64aac7eec admin admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:25:54.441425 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade8a48b-d8c5-44ae-8a0d-45e64aac7eec admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:25:54.441693 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade8a48b-d8c5-44ae-8a0d-45e64aac7eec admin admin] PATH_INFO: `/v3/roles` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:25:54.442320 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade8a48b-d8c5-44ae-8a0d-45e64aac7eec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:25:54.443914 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade8a48b-d8c5-44ae-8a0d-45e64aac7eec admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:25:54.458414 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 589/1176] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Oct 12 02:25:54 2022] GET /identity/v3/roles => generated 1420 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 02:25:54.462477 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d18dea8-2e0d-4745-a6eb-b8c56824e500 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:25:54.463992 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-0d18dea8-2e0d-4745-a6eb-b8c56824e500 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:25:54.475701 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d18dea8-2e0d-4745-a6eb-b8c56824e500 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:25:54.500936 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:25:54.571418 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b898ae37-3372-4bc0-a2ca-ca1e760856b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:25:54.572021 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b898ae37-3372-4bc0-a2ca-ca1e760856b2 admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:25:54.572298 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b898ae37-3372-4bc0-a2ca-ca1e760856b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:25:54.572600 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b898ae37-3372-4bc0-a2ca-ca1e760856b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:25:54.573239 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b898ae37-3372-4bc0-a2ca-ca1e760856b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:25:54.575501 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b898ae37-3372-4bc0-a2ca-ca1e760856b2 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:25:54.587494 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 588/1177] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Oct 12 02:25:54 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 02:25:54.592155 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade8a48b-d8c5-44ae-8a0d-45e64aac7eec admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:25:54.593739 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-ade8a48b-d8c5-44ae-8a0d-45e64aac7eec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:25:54.626821 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade8a48b-d8c5-44ae-8a0d-45e64aac7eec admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:25:54.720676 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf00411-688a-4ae2-83f5-dca9b456994b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:25:54.721330 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf00411-688a-4ae2-83f5-dca9b456994b admin admin] REQUEST_METHOD: `PUT` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:25:54.721606 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf00411-688a-4ae2-83f5-dca9b456994b admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:25:54.721874 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf00411-688a-4ae2-83f5-dca9b456994b admin admin] PATH_INFO: `/v3/projects/88e3ed5b405f43c6a6d11a274134ce83/users/9f36c66f0f2c4a8b8ed8e14346fe6d95/roles/3d75c4d7f1a849b9a771504d1583ab28` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:25:54.744875 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf00411-688a-4ae2-83f5-dca9b456994b admin admin] RBAC: Authorizing `identity:create_grant(project_id=88e3ed5b405f43c6a6d11a274134ce83, user_id=9f36c66f0f2c4a8b8ed8e14346fe6d95, role_id=3d75c4d7f1a849b9a771504d1583ab28)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:25:54.748547 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf00411-688a-4ae2-83f5-dca9b456994b admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:25:54.772887 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 590/1178] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Oct 12 02:25:54 2022] PUT /identity/v3/projects/88e3ed5b405f43c6a6d11a274134ce83/users/9f36c66f0f2c4a8b8ed8e14346fe6d95/roles/3d75c4d7f1a849b9a771504d1583ab28 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 02:25:54.784526 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d021a06-069f-40e6-8b93-a8706c654ea6 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:25:54.784822 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d021a06-069f-40e6-8b93-a8706c654ea6 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:25:54.785098 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d021a06-069f-40e6-8b93-a8706c654ea6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:25:54.843811 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-9d021a06-069f-40e6-8b93-a8706c654ea6 None None] MFA Rules not processed for user `9f36c66f0f2c4a8b8ed8e14346fe6d95`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:25:54.845036 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-9d021a06-069f-40e6-8b93-a8706c654ea6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:25:54.921318 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 589/1179] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 02:25:54 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 02:25:54.935111 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4cd2f3-c6c3-4132-bdbd-3ca803ae968c None None] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:25:54.935395 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4cd2f3-c6c3-4132-bdbd-3ca803ae968c None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:25:54.935666 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4cd2f3-c6c3-4132-bdbd-3ca803ae968c None None] PATH_INFO: `/` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:25:54.937179 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 591/1180] 10.222.0.18 () {54 vars in 963 bytes} [Wed Oct 12 02:25:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 02:25:54.942041 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d4b29e-ec09-4105-94cd-214b73ca70a9 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:25:54.942334 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d4b29e-ec09-4105-94cd-214b73ca70a9 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:25:54.942643 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d4b29e-ec09-4105-94cd-214b73ca70a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:25:54.974195 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:25:55.020308 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-10d4b29e-ec09-4105-94cd-214b73ca70a9 None None] MFA Rules not processed for user `9ba688e0c4d44d13898539ee886f95fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:25:55.021550 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-10d4b29e-ec09-4105-94cd-214b73ca70a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:25:55.096705 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 590/1181] 10.222.0.18 () {58 vars in 1060 bytes} [Wed Oct 12 02:25:54 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 02:25:55.104243 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4cd2f3-c6c3-4132-bdbd-3ca803ae968c None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:25:55.105796 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-1b4cd2f3-c6c3-4132-bdbd-3ca803ae968c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:25:55.156344 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:25:55.210618 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4cd2f3-c6c3-4132-bdbd-3ca803ae968c None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:25:55.283851 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea78675-1d79-46aa-babe-339dfc64adb4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ba688e0c4d44d13898539ee886f95fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'beb6def6fcad45959e56425bb8bff4d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:25:55.284446 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea78675-1d79-46aa-babe-339dfc64adb4 service cinder] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:25:55.284751 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea78675-1d79-46aa-babe-339dfc64adb4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:25:55.285018 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea78675-1d79-46aa-babe-339dfc64adb4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:25:55.286594 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-fea78675-1d79-46aa-babe-339dfc64adb4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:25:55.385873 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea78675-1d79-46aa-babe-339dfc64adb4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:25:55.387283 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea78675-1d79-46aa-babe-339dfc64adb4 service cinder] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:25:55.390753 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:25:55.405876 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 592/1182] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 02:25:55 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 02:25:55.451464 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21c8fe3-69e3-4291-bce5-3221b177b6e0 None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:25:55.451751 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21c8fe3-69e3-4291-bce5-3221b177b6e0 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:25:55.452054 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21c8fe3-69e3-4291-bce5-3221b177b6e0 None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:25:55.453351 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 591/1183] 10.222.0.18 () {52 vars in 830 bytes} [Wed Oct 12 02:25:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 02:25:55.456982 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea78675-1d79-46aa-babe-339dfc64adb4 service cinder] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:25:55.458223 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-fea78675-1d79-46aa-babe-339dfc64adb4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:25:55.559870 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea78675-1d79-46aa-babe-339dfc64adb4 service cinder] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:25:55.652425 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe0074a-7050-44a4-9c6e-10d2b9edeb0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:25:55.653092 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe0074a-7050-44a4-9c6e-10d2b9edeb0c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:25:55.653276 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe0074a-7050-44a4-9c6e-10d2b9edeb0c admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:25:55.653550 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe0074a-7050-44a4-9c6e-10d2b9edeb0c admin admin] PATH_INFO: `/v3/users/9f36c66f0f2c4a8b8ed8e14346fe6d95` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:25:55.666640 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe0074a-7050-44a4-9c6e-10d2b9edeb0c admin admin] RBAC: Authorizing `identity:delete_user(user_id=9f36c66f0f2c4a8b8ed8e14346fe6d95)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:25:55.667719 dv-cinder-849143-14-smb devstack@keystone.service[81361]: WARNING py.warnings [None req-dbe0074a-7050-44a4-9c6e-10d2b9edeb0c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 12 02:25:55.667719 dv-cinder-849143-14-smb devstack@keystone.service[81361]: warnings.warn(msg) Oct 12 02:25:55.667719 dv-cinder-849143-14-smb devstack@keystone.service[81361]: Oct 12 02:25:55.668960 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe0074a-7050-44a4-9c6e-10d2b9edeb0c admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:25:55.678591 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:25:55.734264 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-dbe0074a-7050-44a4-9c6e-10d2b9edeb0c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9f36c66f0f2c4a8b8ed8e14346fe6d95'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:25:55.743906 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-dbe0074a-7050-44a4-9c6e-10d2b9edeb0c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9f36c66f0f2c4a8b8ed8e14346fe6d95'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:25:55.768080 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-dbe0074a-7050-44a4-9c6e-10d2b9edeb0c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9f36c66f0f2c4a8b8ed8e14346fe6d95'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:25:55.782519 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-dbe0074a-7050-44a4-9c6e-10d2b9edeb0c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9f36c66f0f2c4a8b8ed8e14346fe6d95'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:25:55.783079 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-dbe0074a-7050-44a4-9c6e-10d2b9edeb0c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9f36c66f0f2c4a8b8ed8e14346fe6d95'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:25:55.788955 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 593/1184] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Oct 12 02:25:55 2022] DELETE /identity/v3/users/9f36c66f0f2c4a8b8ed8e14346fe6d95 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 02:25:55.793331 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7aae3bf-38e3-48cf-a26c-d893071fa7a4 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:25:55.793782 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7aae3bf-38e3-48cf-a26c-d893071fa7a4 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:25:55.793874 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7aae3bf-38e3-48cf-a26c-d893071fa7a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:25:55.850338 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-c7aae3bf-38e3-48cf-a26c-d893071fa7a4 None None] MFA Rules not processed for user `a326a5bb7364479382f528a592371656`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:25:55.851522 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-c7aae3bf-38e3-48cf-a26c-d893071fa7a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:25:55.925896 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:25:55.939038 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 592/1185] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 02:25:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 02:25:55.949588 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe0074a-7050-44a4-9c6e-10d2b9edeb0c admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:25:55.951579 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-dbe0074a-7050-44a4-9c6e-10d2b9edeb0c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:25:56.049082 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe0074a-7050-44a4-9c6e-10d2b9edeb0c admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:25:56.105258 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:25:56.127566 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400aa20b-1728-4c1a-9ea0-1210f48401e3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5223b5cab3114e9b9a13c582f8ef8386', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'beb6def6fcad45959e56425bb8bff4d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:25:56.128173 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400aa20b-1728-4c1a-9ea0-1210f48401e3 service neutron] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:25:56.128450 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400aa20b-1728-4c1a-9ea0-1210f48401e3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:25:56.128755 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400aa20b-1728-4c1a-9ea0-1210f48401e3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:25:56.130362 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-400aa20b-1728-4c1a-9ea0-1210f48401e3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:25:56.240999 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400aa20b-1728-4c1a-9ea0-1210f48401e3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:25:56.242365 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400aa20b-1728-4c1a-9ea0-1210f48401e3 service neutron] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:25:56.261488 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 594/1186] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 02:25:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 02:25:56.636099 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7aae3bf-38e3-48cf-a26c-d893071fa7a4 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:25:56.637365 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-c7aae3bf-38e3-48cf-a26c-d893071fa7a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:25:56.648935 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7aae3bf-38e3-48cf-a26c-d893071fa7a4 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:25:56.747466 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fd34f3-7cc1-4a0d-a4f9-c1e860eeef91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:25:56.748139 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fd34f3-7cc1-4a0d-a4f9-c1e860eeef91 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:25:56.748424 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fd34f3-7cc1-4a0d-a4f9-c1e860eeef91 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:25:56.748729 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fd34f3-7cc1-4a0d-a4f9-c1e860eeef91 admin admin] PATH_INFO: `/v3/projects/88e3ed5b405f43c6a6d11a274134ce83` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:25:56.758851 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64fd34f3-7cc1-4a0d-a4f9-c1e860eeef91 admin admin] RBAC: Authorizing `identity:delete_project(project_id=88e3ed5b405f43c6a6d11a274134ce83)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:25:56.759816 dv-cinder-849143-14-smb devstack@keystone.service[81362]: WARNING py.warnings [None req-64fd34f3-7cc1-4a0d-a4f9-c1e860eeef91 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 12 02:25:56.759816 dv-cinder-849143-14-smb devstack@keystone.service[81362]: warnings.warn(msg) Oct 12 02:25:56.759816 dv-cinder-849143-14-smb devstack@keystone.service[81362]: Oct 12 02:25:56.761067 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64fd34f3-7cc1-4a0d-a4f9-c1e860eeef91 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:25:56.820802 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-64fd34f3-7cc1-4a0d-a4f9-c1e860eeef91 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '88e3ed5b405f43c6a6d11a274134ce83', 'request_id': 'req-64fd34f3-7cc1-4a0d-a4f9-c1e860eeef91'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:25:56.826892 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-64fd34f3-7cc1-4a0d-a4f9-c1e860eeef91 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '88e3ed5b405f43c6a6d11a274134ce83', 'request_id': 'req-64fd34f3-7cc1-4a0d-a4f9-c1e860eeef91'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:25:56.841252 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-64fd34f3-7cc1-4a0d-a4f9-c1e860eeef91 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '88e3ed5b405f43c6a6d11a274134ce83', 'request_id': 'req-64fd34f3-7cc1-4a0d-a4f9-c1e860eeef91'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:25:56.868633 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-64fd34f3-7cc1-4a0d-a4f9-c1e860eeef91 admin admin] The token cache is being invalidate because project 88e3ed5b405f43c6a6d11a274134ce83 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81362) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 02:25:56.868946 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-64fd34f3-7cc1-4a0d-a4f9-c1e860eeef91 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:25:56.869373 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-64fd34f3-7cc1-4a0d-a4f9-c1e860eeef91 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:25:56.870815 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 593/1187] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Oct 12 02:25:56 2022] DELETE /identity/v3/projects/88e3ed5b405f43c6a6d11a274134ce83 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 02:26:06.259240 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=62 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:26:06.866637 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:27:29.389554 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a6f4aa-f400-49bc-9034-53e719243e93 None None] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:27:29.390171 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a6f4aa-f400-49bc-9034-53e719243e93 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:27:29.390171 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a6f4aa-f400-49bc-9034-53e719243e93 None None] PATH_INFO: `/` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:27:29.391476 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 595/1188] 127.0.0.1 () {54 vars in 901 bytes} [Wed Oct 12 02:27:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 02:27:29.396254 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8266ae-6457-4901-a469-137b90fb7bc3 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:27:29.396698 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8266ae-6457-4901-a469-137b90fb7bc3 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:27:29.396835 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8266ae-6457-4901-a469-137b90fb7bc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:27:29.476312 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-5c8266ae-6457-4901-a469-137b90fb7bc3 None None] MFA Rules not processed for user `a326a5bb7364479382f528a592371656`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:27:29.477568 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-5c8266ae-6457-4901-a469-137b90fb7bc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:27:29.584514 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 594/1189] 127.0.0.1 () {58 vars in 998 bytes} [Wed Oct 12 02:27:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 02:27:29.740452 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a6f4aa-f400-49bc-9034-53e719243e93 None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:27:29.742571 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-a9a6f4aa-f400-49bc-9034-53e719243e93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:27:29.865580 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a6f4aa-f400-49bc-9034-53e719243e93 None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:27:29.870983 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16efc7a3-43f1-4648-afb3-818b47850f7c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fca96c111b45b795fb757f77908ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'beb6def6fcad45959e56425bb8bff4d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:27:29.871584 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16efc7a3-43f1-4648-afb3-818b47850f7c service nova] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:27:29.871863 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16efc7a3-43f1-4648-afb3-818b47850f7c service nova] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:27:29.872132 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16efc7a3-43f1-4648-afb3-818b47850f7c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:27:29.880797 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16efc7a3-43f1-4648-afb3-818b47850f7c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:27:29.882377 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16efc7a3-43f1-4648-afb3-818b47850f7c service nova] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:27:29.891581 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 596/1190] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 02:27:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 02:27:30.799219 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a2d2f0-a1c6-4416-a607-c307fa2f27d7 None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:27:30.799744 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a2d2f0-a1c6-4416-a607-c307fa2f27d7 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:27:30.799744 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a2d2f0-a1c6-4416-a607-c307fa2f27d7 None None] PATH_INFO: `/v3` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:27:30.800973 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 595/1191] 10.222.0.27 () {54 vars in 925 bytes} [Wed Oct 12 02:27:30 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 02:27:30.807180 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48adf196-4de7-4c95-bbce-5c43eaedd9e6 None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:27:30.807580 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48adf196-4de7-4c95-bbce-5c43eaedd9e6 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:27:30.807723 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48adf196-4de7-4c95-bbce-5c43eaedd9e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:27:30.867083 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-48adf196-4de7-4c95-bbce-5c43eaedd9e6 None None] MFA Rules not processed for user `a58b9e0467c040638c3d43e3ac9c0495`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:27:30.868335 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-48adf196-4de7-4c95-bbce-5c43eaedd9e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:27:30.937465 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:27:30.943647 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 597/1192] 10.222.0.27 () {58 vars in 1015 bytes} [Wed Oct 12 02:27:30 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 02:27:31.004665 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51863c6-b907-4d22-b493-b2e1abebce84 None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:27:31.004954 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51863c6-b907-4d22-b493-b2e1abebce84 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:27:31.005282 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51863c6-b907-4d22-b493-b2e1abebce84 None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:27:31.006702 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 596/1193] 127.0.0.1 () {54 vars in 901 bytes} [Wed Oct 12 02:27:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 02:27:31.013080 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68af5d2a-e3db-4ac2-a914-6de389cd70c1 None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:27:31.013371 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68af5d2a-e3db-4ac2-a914-6de389cd70c1 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:27:31.013645 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68af5d2a-e3db-4ac2-a914-6de389cd70c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:27:31.033850 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-68af5d2a-e3db-4ac2-a914-6de389cd70c1 None None] MFA Rules not processed for user `a326a5bb7364479382f528a592371656`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:27:31.035040 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-68af5d2a-e3db-4ac2-a914-6de389cd70c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:27:31.042838 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 598/1194] 127.0.0.1 () {58 vars in 998 bytes} [Wed Oct 12 02:27:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 02:27:31.193206 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51863c6-b907-4d22-b493-b2e1abebce84 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:27:31.207725 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51863c6-b907-4d22-b493-b2e1abebce84 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:27:31.213231 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2655f3-1826-4100-9254-5e1270261247 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fca96c111b45b795fb757f77908ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'beb6def6fcad45959e56425bb8bff4d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:27:31.213827 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2655f3-1826-4100-9254-5e1270261247 service nova] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:27:31.214107 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2655f3-1826-4100-9254-5e1270261247 service nova] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:27:31.214382 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2655f3-1826-4100-9254-5e1270261247 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:27:31.222457 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2655f3-1826-4100-9254-5e1270261247 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:27:31.224050 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2655f3-1826-4100-9254-5e1270261247 service nova] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:27:31.233299 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 597/1195] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 02:27:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 02:27:39.567056 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c1c62f-b444-49aa-9818-e79e84bd855f None None] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:27:39.567519 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c1c62f-b444-49aa-9818-e79e84bd855f None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:27:39.567629 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c1c62f-b444-49aa-9818-e79e84bd855f None None] PATH_INFO: `/` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:27:39.568997 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 599/1196] 10.222.0.18 () {54 vars in 961 bytes} [Wed Oct 12 02:27:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 02:27:39.573993 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbb658b-1be4-4f77-8485-c2350829b18a None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:27:39.574456 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbb658b-1be4-4f77-8485-c2350829b18a None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:27:39.574565 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbb658b-1be4-4f77-8485-c2350829b18a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:27:39.595267 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-fcbb658b-1be4-4f77-8485-c2350829b18a None None] MFA Rules not processed for user `a58b9e0467c040638c3d43e3ac9c0495`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:27:39.596492 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-fcbb658b-1be4-4f77-8485-c2350829b18a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:27:39.604879 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 598/1197] 10.222.0.18 () {58 vars in 1058 bytes} [Wed Oct 12 02:27:39 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 02:27:39.612965 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c1c62f-b444-49aa-9818-e79e84bd855f None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:27:39.626963 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c1c62f-b444-49aa-9818-e79e84bd855f None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:27:39.631847 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e571cf53-85eb-4e25-be6d-788fa0e41615 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a58b9e0467c040638c3d43e3ac9c0495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'beb6def6fcad45959e56425bb8bff4d1', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:27:39.632428 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e571cf53-85eb-4e25-be6d-788fa0e41615 service placement] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:27:39.632735 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e571cf53-85eb-4e25-be6d-788fa0e41615 service placement] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:27:39.633007 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e571cf53-85eb-4e25-be6d-788fa0e41615 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:27:39.642084 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e571cf53-85eb-4e25-be6d-788fa0e41615 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:27:39.643677 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e571cf53-85eb-4e25-be6d-788fa0e41615 service placement] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:27:39.653399 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 600/1198] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 02:27:39 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 02:27:42.695898 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7711e181-749e-4f7f-af9a-56f42e1939b4 None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:27:42.696532 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7711e181-749e-4f7f-af9a-56f42e1939b4 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:27:42.696532 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7711e181-749e-4f7f-af9a-56f42e1939b4 None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:27:42.697791 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 599/1199] 127.0.0.1 () {54 vars in 901 bytes} [Wed Oct 12 02:27:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 02:27:42.705538 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d7eb52-6cc0-4bc7-83cf-384681a68faf None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:27:42.706001 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d7eb52-6cc0-4bc7-83cf-384681a68faf None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:27:42.706108 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d7eb52-6cc0-4bc7-83cf-384681a68faf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:27:42.726527 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-b6d7eb52-6cc0-4bc7-83cf-384681a68faf None None] MFA Rules not processed for user `a326a5bb7364479382f528a592371656`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:27:42.727739 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-b6d7eb52-6cc0-4bc7-83cf-384681a68faf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:27:42.736005 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 601/1200] 127.0.0.1 () {58 vars in 998 bytes} [Wed Oct 12 02:27:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 02:27:42.893257 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7711e181-749e-4f7f-af9a-56f42e1939b4 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:27:42.908101 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7711e181-749e-4f7f-af9a-56f42e1939b4 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:27:42.913514 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b761b97-d9b7-41cf-b8df-a4c89909ae96 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fca96c111b45b795fb757f77908ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'beb6def6fcad45959e56425bb8bff4d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:27:42.914114 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b761b97-d9b7-41cf-b8df-a4c89909ae96 service nova] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:27:42.914392 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b761b97-d9b7-41cf-b8df-a4c89909ae96 service nova] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:27:42.914665 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b761b97-d9b7-41cf-b8df-a4c89909ae96 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:27:42.922869 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b761b97-d9b7-41cf-b8df-a4c89909ae96 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:27:42.924433 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b761b97-d9b7-41cf-b8df-a4c89909ae96 service nova] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:27:42.933680 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 600/1201] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 02:27:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 02:27:44.008381 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69eff6e-ed9c-4fc3-a948-4e8039b13568 None None] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:27:44.008981 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69eff6e-ed9c-4fc3-a948-4e8039b13568 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:27:44.008981 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69eff6e-ed9c-4fc3-a948-4e8039b13568 None None] PATH_INFO: `/` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:27:44.010322 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 602/1202] 127.0.0.1 () {54 vars in 901 bytes} [Wed Oct 12 02:27:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 02:27:44.017199 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69648802-db3e-4578-aab1-1b55c7a7f1a6 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:27:44.017673 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69648802-db3e-4578-aab1-1b55c7a7f1a6 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:27:44.017775 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69648802-db3e-4578-aab1-1b55c7a7f1a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:27:44.037558 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-69648802-db3e-4578-aab1-1b55c7a7f1a6 None None] MFA Rules not processed for user `a326a5bb7364479382f528a592371656`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:27:44.038743 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-69648802-db3e-4578-aab1-1b55c7a7f1a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:27:44.046488 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 601/1203] 127.0.0.1 () {58 vars in 998 bytes} [Wed Oct 12 02:27:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 02:27:44.196529 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69eff6e-ed9c-4fc3-a948-4e8039b13568 None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:27:44.211275 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69eff6e-ed9c-4fc3-a948-4e8039b13568 None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:27:44.216634 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8caa0596-a4fe-4ee6-916e-c80c380407a5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fca96c111b45b795fb757f77908ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'beb6def6fcad45959e56425bb8bff4d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:27:44.217215 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8caa0596-a4fe-4ee6-916e-c80c380407a5 service nova] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:27:44.217488 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8caa0596-a4fe-4ee6-916e-c80c380407a5 service nova] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:27:44.217753 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8caa0596-a4fe-4ee6-916e-c80c380407a5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:27:44.226000 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8caa0596-a4fe-4ee6-916e-c80c380407a5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:27:44.227586 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8caa0596-a4fe-4ee6-916e-c80c380407a5 service nova] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:27:44.237245 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 603/1204] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 02:27:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 02:27:48.344045 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a257cd00-3b58-40c9-a02b-e116b79c941a None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:27:48.344627 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a257cd00-3b58-40c9-a02b-e116b79c941a None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:27:48.344627 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a257cd00-3b58-40c9-a02b-e116b79c941a None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:27:48.345957 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 602/1205] 127.0.0.1 () {54 vars in 917 bytes} [Wed Oct 12 02:27:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 02:27:48.351126 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0606b3-65b2-4f1a-bb33-212317f1c592 None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:27:48.351508 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0606b3-65b2-4f1a-bb33-212317f1c592 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:27:48.351743 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0606b3-65b2-4f1a-bb33-212317f1c592 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:27:48.371177 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-cd0606b3-65b2-4f1a-bb33-212317f1c592 None None] MFA Rules not processed for user `a326a5bb7364479382f528a592371656`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:27:48.372409 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-cd0606b3-65b2-4f1a-bb33-212317f1c592 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:27:48.380605 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 604/1206] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Oct 12 02:27:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 02:27:48.671048 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a257cd00-3b58-40c9-a02b-e116b79c941a None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:27:48.673514 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-a257cd00-3b58-40c9-a02b-e116b79c941a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:27:48.708297 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:27:48.754447 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a257cd00-3b58-40c9-a02b-e116b79c941a None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:27:48.757969 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9b1a1a-89a2-4b38-ad9b-0f59abbef132 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5223b5cab3114e9b9a13c582f8ef8386', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'beb6def6fcad45959e56425bb8bff4d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:27:48.758558 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9b1a1a-89a2-4b38-ad9b-0f59abbef132 service neutron] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:27:48.758831 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9b1a1a-89a2-4b38-ad9b-0f59abbef132 service neutron] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:27:48.759098 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9b1a1a-89a2-4b38-ad9b-0f59abbef132 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:27:48.767878 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9b1a1a-89a2-4b38-ad9b-0f59abbef132 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:27:48.769320 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9b1a1a-89a2-4b38-ad9b-0f59abbef132 service neutron] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:27:48.778403 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 603/1207] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 02:27:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 02:27:50.921368 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e2ee3a-60bb-44cc-82ba-e82f1e0aaf6d None None] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:27:50.922516 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e2ee3a-60bb-44cc-82ba-e82f1e0aaf6d None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:27:50.922516 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e2ee3a-60bb-44cc-82ba-e82f1e0aaf6d None None] PATH_INFO: `/` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:27:50.923720 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 605/1208] 127.0.0.1 () {54 vars in 917 bytes} [Wed Oct 12 02:27:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 02:27:50.929070 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5ce714-2506-4a5c-b0b7-5ac996e1988a None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:27:50.929507 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5ce714-2506-4a5c-b0b7-5ac996e1988a None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:27:50.929610 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5ce714-2506-4a5c-b0b7-5ac996e1988a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:27:50.949341 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-db5ce714-2506-4a5c-b0b7-5ac996e1988a None None] MFA Rules not processed for user `a326a5bb7364479382f528a592371656`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:27:50.950545 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-db5ce714-2506-4a5c-b0b7-5ac996e1988a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:27:50.958836 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 604/1209] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Oct 12 02:27:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 02:27:51.250447 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e2ee3a-60bb-44cc-82ba-e82f1e0aaf6d None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:27:51.261230 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e2ee3a-60bb-44cc-82ba-e82f1e0aaf6d None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:27:51.264729 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9e9617-4389-43de-900d-aec20c889b6a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5223b5cab3114e9b9a13c582f8ef8386', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'beb6def6fcad45959e56425bb8bff4d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:27:51.265941 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9e9617-4389-43de-900d-aec20c889b6a service neutron] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:27:51.266209 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9e9617-4389-43de-900d-aec20c889b6a service neutron] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:27:51.266474 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9e9617-4389-43de-900d-aec20c889b6a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:27:51.275145 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9e9617-4389-43de-900d-aec20c889b6a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:27:51.276587 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9e9617-4389-43de-900d-aec20c889b6a service neutron] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:27:51.285860 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 606/1210] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 02:27:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 02:27:54.954234 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad9dcc0-dc7b-4a42-b711-91d3996fbc77 None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:27:54.954851 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad9dcc0-dc7b-4a42-b711-91d3996fbc77 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:27:54.954851 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad9dcc0-dc7b-4a42-b711-91d3996fbc77 None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:27:54.956739 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 605/1211] 127.0.0.1 () {54 vars in 917 bytes} [Wed Oct 12 02:27:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 02:27:54.961905 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d05a41-e9f6-4d85-bffe-fd7658bb4797 None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:27:54.962356 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d05a41-e9f6-4d85-bffe-fd7658bb4797 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:27:54.962468 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d05a41-e9f6-4d85-bffe-fd7658bb4797 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:27:54.981611 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-49d05a41-e9f6-4d85-bffe-fd7658bb4797 None None] MFA Rules not processed for user `a326a5bb7364479382f528a592371656`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:27:54.982792 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-49d05a41-e9f6-4d85-bffe-fd7658bb4797 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:27:54.991155 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 607/1212] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Oct 12 02:27:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 02:27:55.304524 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad9dcc0-dc7b-4a42-b711-91d3996fbc77 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:27:55.306298 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-cad9dcc0-dc7b-4a42-b711-91d3996fbc77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:27:55.385846 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad9dcc0-dc7b-4a42-b711-91d3996fbc77 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:27:55.389366 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc08bdf-965a-478e-ac4b-0bc5aa5cfbc8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ba688e0c4d44d13898539ee886f95fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'beb6def6fcad45959e56425bb8bff4d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:27:55.389963 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc08bdf-965a-478e-ac4b-0bc5aa5cfbc8 service cinder] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:27:55.390237 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc08bdf-965a-478e-ac4b-0bc5aa5cfbc8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:27:55.390505 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc08bdf-965a-478e-ac4b-0bc5aa5cfbc8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:27:55.399975 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc08bdf-965a-478e-ac4b-0bc5aa5cfbc8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:27:55.401415 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc08bdf-965a-478e-ac4b-0bc5aa5cfbc8 service cinder] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:27:55.410598 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 606/1213] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 02:27:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 02:27:57.559515 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b26900-9fa9-4e49-9485-2f8544b09ef7 None None] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:27:57.560001 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b26900-9fa9-4e49-9485-2f8544b09ef7 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:27:57.560103 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b26900-9fa9-4e49-9485-2f8544b09ef7 None None] PATH_INFO: `/` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:27:57.561450 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 608/1214] 127.0.0.1 () {54 vars in 917 bytes} [Wed Oct 12 02:27:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 02:27:57.566824 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abf94ee-279c-4a81-9b00-c56daaf96716 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:27:57.567266 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abf94ee-279c-4a81-9b00-c56daaf96716 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:27:57.567376 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abf94ee-279c-4a81-9b00-c56daaf96716 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:27:57.586931 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-1abf94ee-279c-4a81-9b00-c56daaf96716 None None] MFA Rules not processed for user `a326a5bb7364479382f528a592371656`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:27:57.588108 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-1abf94ee-279c-4a81-9b00-c56daaf96716 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:27:57.596559 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 607/1215] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Oct 12 02:27:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 02:27:57.896877 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b26900-9fa9-4e49-9485-2f8544b09ef7 None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:27:57.898603 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-d3b26900-9fa9-4e49-9485-2f8544b09ef7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:27:57.911545 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b26900-9fa9-4e49-9485-2f8544b09ef7 None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:27:57.915015 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472a61a3-20fb-4966-8b72-d8b04071870b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ba688e0c4d44d13898539ee886f95fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'beb6def6fcad45959e56425bb8bff4d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:27:57.915601 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472a61a3-20fb-4966-8b72-d8b04071870b service cinder] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:27:57.915881 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472a61a3-20fb-4966-8b72-d8b04071870b service cinder] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:27:57.916151 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472a61a3-20fb-4966-8b72-d8b04071870b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:27:57.924894 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472a61a3-20fb-4966-8b72-d8b04071870b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:27:57.926309 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472a61a3-20fb-4966-8b72-d8b04071870b service cinder] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:27:57.935612 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 609/1216] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 02:27:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 02:28:07.582129 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=63 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:28:07.931381 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=37 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:29:24.535207 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bab8c65-82fb-4bb9-998f-a75f95c362e5 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:29:24.536969 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bab8c65-82fb-4bb9-998f-a75f95c362e5 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:29:24.536969 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bab8c65-82fb-4bb9-998f-a75f95c362e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:29:24.570329 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-7bab8c65-82fb-4bb9-998f-a75f95c362e5 None None] MFA Rules not processed for user `a326a5bb7364479382f528a592371656`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:29:24.571601 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-7bab8c65-82fb-4bb9-998f-a75f95c362e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:29:24.585524 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 608/1217] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 02:29:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 02:29:24.597103 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee99c6c-00bf-453e-9c20-84d742d83986 None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:29:24.597731 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee99c6c-00bf-453e-9c20-84d742d83986 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:29:24.597731 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee99c6c-00bf-453e-9c20-84d742d83986 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:29:24.628325 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-3ee99c6c-00bf-453e-9c20-84d742d83986 None None] MFA Rules not processed for user `a326a5bb7364479382f528a592371656`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:29:24.629603 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-3ee99c6c-00bf-453e-9c20-84d742d83986 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:29:24.646318 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 610/1218] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 02:29:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 02:29:24.651561 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bab8c65-82fb-4bb9-998f-a75f95c362e5 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:29:24.667250 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bab8c65-82fb-4bb9-998f-a75f95c362e5 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:29:24.677132 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c88c5e-5cc2-4401-adac-b40843909211 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:29:24.677762 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c88c5e-5cc2-4401-adac-b40843909211 admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:29:24.678043 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c88c5e-5cc2-4401-adac-b40843909211 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:29:24.678390 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c88c5e-5cc2-4401-adac-b40843909211 admin admin] PATH_INFO: `/v3/domains` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:29:24.679047 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c88c5e-5cc2-4401-adac-b40843909211 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 02:29:24.679347 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c88c5e-5cc2-4401-adac-b40843909211 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:29:24.681056 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c88c5e-5cc2-4401-adac-b40843909211 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:29:24.688894 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab03f2d5-f82f-41f3-b421-c0db9f8f81d3 None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:29:24.689184 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab03f2d5-f82f-41f3-b421-c0db9f8f81d3 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:29:24.689475 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab03f2d5-f82f-41f3-b421-c0db9f8f81d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:29:24.696434 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 609/1219] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Oct 12 02:29:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 02:29:24.706286 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c88c5e-5cc2-4401-adac-b40843909211 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:29:24.719576 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c88c5e-5cc2-4401-adac-b40843909211 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:29:24.726675 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88b6a22-1f1f-4384-ac82-52f4299e58d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:29:24.727291 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88b6a22-1f1f-4384-ac82-52f4299e58d3 admin admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:29:24.727569 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88b6a22-1f1f-4384-ac82-52f4299e58d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:29:24.727837 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88b6a22-1f1f-4384-ac82-52f4299e58d3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:29:24.728503 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88b6a22-1f1f-4384-ac82-52f4299e58d3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:29:24.729516 dv-cinder-849143-14-smb devstack@keystone.service[81362]: WARNING py.warnings [None req-c88b6a22-1f1f-4384-ac82-52f4299e58d3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 12 02:29:24.729516 dv-cinder-849143-14-smb devstack@keystone.service[81362]: warnings.warn(msg) Oct 12 02:29:24.729516 dv-cinder-849143-14-smb devstack@keystone.service[81362]: Oct 12 02:29:24.730689 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88b6a22-1f1f-4384-ac82-52f4299e58d3 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:29:24.732084 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-ab03f2d5-f82f-41f3-b421-c0db9f8f81d3 None None] MFA Rules not processed for user `a326a5bb7364479382f528a592371656`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:29:24.733500 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-ab03f2d5-f82f-41f3-b421-c0db9f8f81d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:29:24.762958 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 611/1220] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 02:29:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 02:29:24.774283 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1c976f-0344-48ba-bcfc-c1b9489a0f0d None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:29:24.774626 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1c976f-0344-48ba-bcfc-c1b9489a0f0d None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:29:24.774822 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1c976f-0344-48ba-bcfc-c1b9489a0f0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:29:24.802197 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 610/1221] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Oct 12 02:29:24 2022] POST /identity/v3/projects => generated 393 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 02:29:24.803478 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4e85e6-bbce-457d-b7fc-2365f6505d08 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:29:24.803765 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4e85e6-bbce-457d-b7fc-2365f6505d08 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:29:24.804085 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4e85e6-bbce-457d-b7fc-2365f6505d08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:29:24.815168 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-1b1c976f-0344-48ba-bcfc-c1b9489a0f0d None None] MFA Rules not processed for user `a326a5bb7364479382f528a592371656`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:29:24.816937 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-1b1c976f-0344-48ba-bcfc-c1b9489a0f0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:29:24.839801 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-4e4e85e6-bbce-457d-b7fc-2365f6505d08 None None] MFA Rules not processed for user `a326a5bb7364479382f528a592371656`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:29:24.841114 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-4e4e85e6-bbce-457d-b7fc-2365f6505d08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:29:24.912698 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 612/1222] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 02:29:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 02:29:24.914083 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1c976f-0344-48ba-bcfc-c1b9489a0f0d None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:29:24.928872 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1c976f-0344-48ba-bcfc-c1b9489a0f0d None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:29:24.944782 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164dec23-8d31-4fe5-a19c-c55fe6dc8807 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:29:24.945332 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164dec23-8d31-4fe5-a19c-c55fe6dc8807 admin admin] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:29:24.945616 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164dec23-8d31-4fe5-a19c-c55fe6dc8807 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:29:24.945896 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164dec23-8d31-4fe5-a19c-c55fe6dc8807 admin admin] PATH_INFO: `/v3/users` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:29:24.946548 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164dec23-8d31-4fe5-a19c-c55fe6dc8807 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:29:24.948061 dv-cinder-849143-14-smb devstack@keystone.service[81361]: WARNING py.warnings [None req-164dec23-8d31-4fe5-a19c-c55fe6dc8807 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 12 02:29:24.948061 dv-cinder-849143-14-smb devstack@keystone.service[81361]: warnings.warn(msg) Oct 12 02:29:24.948061 dv-cinder-849143-14-smb devstack@keystone.service[81361]: Oct 12 02:29:24.949438 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164dec23-8d31-4fe5-a19c-c55fe6dc8807 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:29:24.993246 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 611/1223] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 02:29:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 02:29:24.994508 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a91ef1-97af-41b2-ab19-6fdf5a2ba961 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:29:24.994792 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a91ef1-97af-41b2-ab19-6fdf5a2ba961 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:29:24.995064 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a91ef1-97af-41b2-ab19-6fdf5a2ba961 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:29:24.995576 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 613/1224] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Oct 12 02:29:24 2022] POST /identity/v3/users => generated 297 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 02:29:24.996421 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164dec23-8d31-4fe5-a19c-c55fe6dc8807 admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:29:25.009906 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164dec23-8d31-4fe5-a19c-c55fe6dc8807 admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:29:25.017969 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f8474c-552b-4366-b50d-515adb5a052c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:29:25.018594 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f8474c-552b-4366-b50d-515adb5a052c admin admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:29:25.018875 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f8474c-552b-4366-b50d-515adb5a052c admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:29:25.019414 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f8474c-552b-4366-b50d-515adb5a052c admin admin] PATH_INFO: `/v3/domains` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:29:25.020209 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f8474c-552b-4366-b50d-515adb5a052c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 02:29:25.020545 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f8474c-552b-4366-b50d-515adb5a052c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:29:25.021128 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-f3a91ef1-97af-41b2-ab19-6fdf5a2ba961 None None] MFA Rules not processed for user `a326a5bb7364479382f528a592371656`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:29:25.021626 dv-cinder-849143-14-smb devstack@keystone.service[81361]: WARNING py.warnings [None req-32f8474c-552b-4366-b50d-515adb5a052c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 12 02:29:25.021626 dv-cinder-849143-14-smb devstack@keystone.service[81361]: warnings.warn(msg) Oct 12 02:29:25.021626 dv-cinder-849143-14-smb devstack@keystone.service[81361]: Oct 12 02:29:25.022330 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-f3a91ef1-97af-41b2-ab19-6fdf5a2ba961 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:29:25.022523 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f8474c-552b-4366-b50d-515adb5a052c admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:29:25.031434 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 612/1225] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 02:29:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 02:29:25.033175 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ad5912-b47b-4731-93a7-f1aba99daf8c None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:29:25.033510 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ad5912-b47b-4731-93a7-f1aba99daf8c None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:29:25.033780 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ad5912-b47b-4731-93a7-f1aba99daf8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:29:25.042794 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 614/1226] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Oct 12 02:29:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 02:29:25.044266 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77049ef3-ffbb-4640-998b-11b76ef249c2 None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:29:25.046067 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77049ef3-ffbb-4640-998b-11b76ef249c2 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:29:25.046380 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77049ef3-ffbb-4640-998b-11b76ef249c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:29:25.063867 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-58ad5912-b47b-4731-93a7-f1aba99daf8c None None] MFA Rules not processed for user `a326a5bb7364479382f528a592371656`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:29:25.065024 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-58ad5912-b47b-4731-93a7-f1aba99daf8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:29:25.070437 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-77049ef3-ffbb-4640-998b-11b76ef249c2 None None] MFA Rules not processed for user `a326a5bb7364479382f528a592371656`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:29:25.071599 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-77049ef3-ffbb-4640-998b-11b76ef249c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:29:25.073507 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 613/1227] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 02:29:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 02:29:25.074377 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ad5912-b47b-4731-93a7-f1aba99daf8c None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:29:25.084523 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 615/1228] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 02:29:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 02:29:25.084523 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219f86ed-3dc1-428c-a038-70a25aec519b None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:29:25.084523 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219f86ed-3dc1-428c-a038-70a25aec519b None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:29:25.084523 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219f86ed-3dc1-428c-a038-70a25aec519b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:29:25.089386 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ad5912-b47b-4731-93a7-f1aba99daf8c None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:29:25.094948 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a99728-c2f2-4b10-ba0c-d09ac99dac78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:29:25.095550 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a99728-c2f2-4b10-ba0c-d09ac99dac78 admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:29:25.095826 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a99728-c2f2-4b10-ba0c-d09ac99dac78 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:29:25.096094 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a99728-c2f2-4b10-ba0c-d09ac99dac78 admin admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:29:25.096759 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a99728-c2f2-4b10-ba0c-d09ac99dac78 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:29:25.098347 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a99728-c2f2-4b10-ba0c-d09ac99dac78 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:29:25.106842 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-219f86ed-3dc1-428c-a038-70a25aec519b None None] MFA Rules not processed for user `a326a5bb7364479382f528a592371656`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:29:25.108075 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-219f86ed-3dc1-428c-a038-70a25aec519b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:29:25.108381 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 614/1229] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Oct 12 02:29:25 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 02:29:25.109575 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0840e5af-3473-40c9-8842-6df284859c52 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:29:25.110422 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0840e5af-3473-40c9-8842-6df284859c52 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:29:25.110681 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0840e5af-3473-40c9-8842-6df284859c52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:29:25.118098 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 616/1230] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 02:29:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 02:29:25.119496 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eba1a6d-179a-4894-b65d-f9257d1aad95 None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:29:25.119978 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eba1a6d-179a-4894-b65d-f9257d1aad95 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:29:25.120252 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eba1a6d-179a-4894-b65d-f9257d1aad95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:29:25.130274 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-0840e5af-3473-40c9-8842-6df284859c52 None None] MFA Rules not processed for user `a326a5bb7364479382f528a592371656`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:29:25.131462 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-0840e5af-3473-40c9-8842-6df284859c52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:29:25.139415 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 615/1231] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 02:29:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 02:29:25.140153 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0840e5af-3473-40c9-8842-6df284859c52 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:29:25.140278 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-5eba1a6d-179a-4894-b65d-f9257d1aad95 None None] MFA Rules not processed for user `a326a5bb7364479382f528a592371656`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:29:25.141970 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-5eba1a6d-179a-4894-b65d-f9257d1aad95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:29:25.150067 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 617/1232] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 02:29:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 02:29:25.150367 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0840e5af-3473-40c9-8842-6df284859c52 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:29:25.151244 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4a6a7c-3dd7-4f2a-84df-36437c17cbea None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:29:25.151534 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4a6a7c-3dd7-4f2a-84df-36437c17cbea None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:29:25.151799 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4a6a7c-3dd7-4f2a-84df-36437c17cbea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:29:25.155247 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73425c2c-26b9-4616-9ab0-a630f4ba8027 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:29:25.155841 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73425c2c-26b9-4616-9ab0-a630f4ba8027 admin admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:29:25.156118 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73425c2c-26b9-4616-9ab0-a630f4ba8027 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:29:25.156391 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73425c2c-26b9-4616-9ab0-a630f4ba8027 admin admin] PATH_INFO: `/v3/projects` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:29:25.157113 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73425c2c-26b9-4616-9ab0-a630f4ba8027 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:29:25.159004 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73425c2c-26b9-4616-9ab0-a630f4ba8027 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:29:25.171162 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-fe4a6a7c-3dd7-4f2a-84df-36437c17cbea None None] MFA Rules not processed for user `a326a5bb7364479382f528a592371656`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:29:25.173342 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-fe4a6a7c-3dd7-4f2a-84df-36437c17cbea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:29:25.182077 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 618/1233] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 02:29:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 02:29:25.183447 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a7e0ae-9cc0-4ebe-b5e1-3b999ac8281e None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:29:25.183718 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a7e0ae-9cc0-4ebe-b5e1-3b999ac8281e None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:29:25.183994 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a7e0ae-9cc0-4ebe-b5e1-3b999ac8281e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:29:25.186527 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 616/1234] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Oct 12 02:29:25 2022] POST /identity/v3/projects => generated 379 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 02:29:25.187859 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f173f06-694f-46be-ad8a-aaa03833bb66 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:29:25.188784 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f173f06-694f-46be-ad8a-aaa03833bb66 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:29:25.189340 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f173f06-694f-46be-ad8a-aaa03833bb66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:29:25.209056 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-f4a7e0ae-9cc0-4ebe-b5e1-3b999ac8281e None None] MFA Rules not processed for user `a326a5bb7364479382f528a592371656`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:29:25.210271 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-f4a7e0ae-9cc0-4ebe-b5e1-3b999ac8281e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:29:25.211024 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-0f173f06-694f-46be-ad8a-aaa03833bb66 None None] MFA Rules not processed for user `a326a5bb7364479382f528a592371656`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:29:25.212228 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-0f173f06-694f-46be-ad8a-aaa03833bb66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:29:25.264095 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:29:25.273476 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 619/1235] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 02:29:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 02:29:25.274376 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a7e0ae-9cc0-4ebe-b5e1-3b999ac8281e None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:29:25.278083 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 617/1236] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 02:29:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 02:29:25.278083 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f173f06-694f-46be-ad8a-aaa03833bb66 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:29:25.287181 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f173f06-694f-46be-ad8a-aaa03833bb66 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:29:25.287358 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a7e0ae-9cc0-4ebe-b5e1-3b999ac8281e None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:29:25.291844 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e418e7-ac77-48ba-9a9b-c18fe3c14eb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:29:25.292025 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17292a73-b55f-4efa-9d4e-5970520e013e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:29:25.292443 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e418e7-ac77-48ba-9a9b-c18fe3c14eb7 admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:29:25.292574 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17292a73-b55f-4efa-9d4e-5970520e013e admin admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:29:25.292742 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e418e7-ac77-48ba-9a9b-c18fe3c14eb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:29:25.292860 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17292a73-b55f-4efa-9d4e-5970520e013e admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:29:25.293011 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e418e7-ac77-48ba-9a9b-c18fe3c14eb7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:29:25.293110 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17292a73-b55f-4efa-9d4e-5970520e013e admin admin] PATH_INFO: `/v3/roles` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:29:25.293655 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e418e7-ac77-48ba-9a9b-c18fe3c14eb7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 02:29:25.293766 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17292a73-b55f-4efa-9d4e-5970520e013e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:29:25.293951 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e418e7-ac77-48ba-9a9b-c18fe3c14eb7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:29:25.295507 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17292a73-b55f-4efa-9d4e-5970520e013e admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:29:25.297048 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e418e7-ac77-48ba-9a9b-c18fe3c14eb7 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:29:25.306433 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 620/1237] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Oct 12 02:29:25 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 02:29:25.307063 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17292a73-b55f-4efa-9d4e-5970520e013e admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:29:25.318059 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 618/1238] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Oct 12 02:29:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 02:29:25.318059 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c1f7a8-6aaf-4900-ac7d-d6bdaaad0e73 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:29:25.318059 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c1f7a8-6aaf-4900-ac7d-d6bdaaad0e73 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:29:25.318059 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c1f7a8-6aaf-4900-ac7d-d6bdaaad0e73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:29:25.318518 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17292a73-b55f-4efa-9d4e-5970520e013e admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:29:25.324843 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c6c54c-418f-4191-b3f6-b2e2c44ab465 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:29:25.325601 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c6c54c-418f-4191-b3f6-b2e2c44ab465 admin admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:29:25.325875 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c6c54c-418f-4191-b3f6-b2e2c44ab465 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:29:25.326160 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c6c54c-418f-4191-b3f6-b2e2c44ab465 admin admin] PATH_INFO: `/v3/domains` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:29:25.326789 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c6c54c-418f-4191-b3f6-b2e2c44ab465 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 02:29:25.327086 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c6c54c-418f-4191-b3f6-b2e2c44ab465 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:29:25.329298 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c6c54c-418f-4191-b3f6-b2e2c44ab465 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:29:25.333599 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-c6c1f7a8-6aaf-4900-ac7d-d6bdaaad0e73 None None] MFA Rules not processed for user `a326a5bb7364479382f528a592371656`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:29:25.334805 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-c6c1f7a8-6aaf-4900-ac7d-d6bdaaad0e73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:29:25.341660 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 621/1239] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Oct 12 02:29:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 02:29:25.342521 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c6c54c-418f-4191-b3f6-b2e2c44ab465 admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:29:25.348275 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 619/1240] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 02:29:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 02:29:25.349665 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8313ca1f-6875-40a6-9635-e823207ef181 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:29:25.349989 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8313ca1f-6875-40a6-9635-e823207ef181 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:29:25.350269 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8313ca1f-6875-40a6-9635-e823207ef181 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:29:25.361692 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c6c54c-418f-4191-b3f6-b2e2c44ab465 admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:29:25.366457 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c21b8e3-7476-4547-b9a8-1befe89edc2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:29:25.367139 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c21b8e3-7476-4547-b9a8-1befe89edc2a admin admin] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:29:25.367490 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c21b8e3-7476-4547-b9a8-1befe89edc2a admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:29:25.367830 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c21b8e3-7476-4547-b9a8-1befe89edc2a admin admin] PATH_INFO: `/v3/users` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:29:25.368563 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c21b8e3-7476-4547-b9a8-1befe89edc2a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:29:25.369856 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-8313ca1f-6875-40a6-9635-e823207ef181 None None] MFA Rules not processed for user `a326a5bb7364479382f528a592371656`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:29:25.371063 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-8313ca1f-6875-40a6-9635-e823207ef181 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:29:25.377339 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c21b8e3-7476-4547-b9a8-1befe89edc2a admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:29:25.381384 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 620/1241] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 02:29:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 02:29:25.382328 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8313ca1f-6875-40a6-9635-e823207ef181 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:29:25.386520 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:29:25.394727 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8313ca1f-6875-40a6-9635-e823207ef181 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:29:25.399529 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811ed7cf-ce64-4466-b53a-3fb4509a07c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:29:25.400134 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811ed7cf-ce64-4466-b53a-3fb4509a07c3 admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:29:25.400412 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811ed7cf-ce64-4466-b53a-3fb4509a07c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:29:25.400711 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811ed7cf-ce64-4466-b53a-3fb4509a07c3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:29:25.401378 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811ed7cf-ce64-4466-b53a-3fb4509a07c3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 02:29:25.401678 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811ed7cf-ce64-4466-b53a-3fb4509a07c3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:29:25.405682 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 622/1242] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Oct 12 02:29:25 2022] POST /identity/v3/users => generated 290 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 02:29:25.405836 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811ed7cf-ce64-4466-b53a-3fb4509a07c3 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:29:25.405949 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c21b8e3-7476-4547-b9a8-1befe89edc2a admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:29:25.414542 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c21b8e3-7476-4547-b9a8-1befe89edc2a admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:29:25.416032 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 621/1243] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Oct 12 02:29:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 02:29:25.416822 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811ed7cf-ce64-4466-b53a-3fb4509a07c3 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:29:25.426308 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811ed7cf-ce64-4466-b53a-3fb4509a07c3 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:29:25.426717 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a149e566-770e-4d27-8977-d32630bc9376 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:29:25.427325 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a149e566-770e-4d27-8977-d32630bc9376 admin admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:29:25.427587 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a149e566-770e-4d27-8977-d32630bc9376 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:29:25.427872 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a149e566-770e-4d27-8977-d32630bc9376 admin admin] PATH_INFO: `/v3/domains` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:29:25.428630 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a149e566-770e-4d27-8977-d32630bc9376 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 02:29:25.428991 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a149e566-770e-4d27-8977-d32630bc9376 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:29:25.430526 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a149e566-770e-4d27-8977-d32630bc9376 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:29:25.430847 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e09ad5-ad70-4029-b207-76bf3dbf8a01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:29:25.431470 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e09ad5-ad70-4029-b207-76bf3dbf8a01 admin admin] REQUEST_METHOD: `PUT` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:29:25.431745 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e09ad5-ad70-4029-b207-76bf3dbf8a01 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:29:25.432016 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e09ad5-ad70-4029-b207-76bf3dbf8a01 admin admin] PATH_INFO: `/v3/projects/72777ca3c2f04605b9eaf0ae7dbdfb2d/users/e5a8c753a1c54dddaac24b5faaaf197a/roles/3d75c4d7f1a849b9a771504d1583ab28` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:29:25.444098 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 623/1244] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Oct 12 02:29:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 02:29:25.444983 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a149e566-770e-4d27-8977-d32630bc9376 admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:29:25.450840 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e09ad5-ad70-4029-b207-76bf3dbf8a01 admin admin] RBAC: Authorizing `identity:create_grant(project_id=72777ca3c2f04605b9eaf0ae7dbdfb2d, user_id=e5a8c753a1c54dddaac24b5faaaf197a, role_id=3d75c4d7f1a849b9a771504d1583ab28)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:29:25.453666 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e09ad5-ad70-4029-b207-76bf3dbf8a01 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:29:25.454680 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a149e566-770e-4d27-8977-d32630bc9376 admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:29:25.459552 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f9d11e-fd28-4281-b97c-c41dfba70ece admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:29:25.460172 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f9d11e-fd28-4281-b97c-c41dfba70ece admin admin] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:29:25.460445 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f9d11e-fd28-4281-b97c-c41dfba70ece admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:29:25.460741 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f9d11e-fd28-4281-b97c-c41dfba70ece admin admin] PATH_INFO: `/v3/projects` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:29:25.461475 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f9d11e-fd28-4281-b97c-c41dfba70ece admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:29:25.463344 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f9d11e-fd28-4281-b97c-c41dfba70ece admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:29:25.467116 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 622/1245] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Oct 12 02:29:25 2022] PUT /identity/v3/projects/72777ca3c2f04605b9eaf0ae7dbdfb2d/users/e5a8c753a1c54dddaac24b5faaaf197a/roles/3d75c4d7f1a849b9a771504d1583ab28 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 02:29:25.467997 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e09ad5-ad70-4029-b207-76bf3dbf8a01 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:29:25.491710 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 624/1246] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Oct 12 02:29:25 2022] POST /identity/v3/projects => generated 387 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 02:29:25.492743 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f9d11e-fd28-4281-b97c-c41dfba70ece admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:29:25.533889 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e09ad5-ad70-4029-b207-76bf3dbf8a01 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:29:25.557076 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f9d11e-fd28-4281-b97c-c41dfba70ece admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:29:25.561808 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06fd64d-6d5d-4c7c-871e-2a1de77174bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:29:25.562413 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06fd64d-6d5d-4c7c-871e-2a1de77174bc admin admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:29:25.562690 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06fd64d-6d5d-4c7c-871e-2a1de77174bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:29:25.563025 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06fd64d-6d5d-4c7c-871e-2a1de77174bc admin admin] PATH_INFO: `/v3/domains` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:29:25.563797 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06fd64d-6d5d-4c7c-871e-2a1de77174bc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 02:29:25.564102 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06fd64d-6d5d-4c7c-871e-2a1de77174bc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:29:25.565731 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06fd64d-6d5d-4c7c-871e-2a1de77174bc admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:29:25.577410 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 625/1247] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Oct 12 02:29:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 02:29:25.583956 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06fd64d-6d5d-4c7c-871e-2a1de77174bc admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:29:25.593729 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06fd64d-6d5d-4c7c-871e-2a1de77174bc admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:29:25.595803 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d356c85d-8f16-4c52-9c5d-633d3b7f9fc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:29:25.596429 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d356c85d-8f16-4c52-9c5d-633d3b7f9fc3 admin admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:29:25.596740 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d356c85d-8f16-4c52-9c5d-633d3b7f9fc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:29:25.597014 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d356c85d-8f16-4c52-9c5d-633d3b7f9fc3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:29:25.597647 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d356c85d-8f16-4c52-9c5d-633d3b7f9fc3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:29:25.599564 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d356c85d-8f16-4c52-9c5d-633d3b7f9fc3 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:29:25.599722 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c3a908-ad69-483f-8d36-f9c9c47094ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:29:25.600308 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c3a908-ad69-483f-8d36-f9c9c47094ec admin admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:29:25.600618 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c3a908-ad69-483f-8d36-f9c9c47094ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:29:25.600893 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c3a908-ad69-483f-8d36-f9c9c47094ec admin admin] PATH_INFO: `/v3/domains` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:29:25.601527 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c3a908-ad69-483f-8d36-f9c9c47094ec admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 02:29:25.601826 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c3a908-ad69-483f-8d36-f9c9c47094ec admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:29:25.603394 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c3a908-ad69-483f-8d36-f9c9c47094ec admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:29:25.616240 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 626/1248] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Oct 12 02:29:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 02:29:25.617072 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c3a908-ad69-483f-8d36-f9c9c47094ec admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:29:25.628675 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c3a908-ad69-483f-8d36-f9c9c47094ec admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:29:25.633514 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfb6def-9bbc-495d-9070-fadfa977bf60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:29:25.634133 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfb6def-9bbc-495d-9070-fadfa977bf60 admin admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:29:25.634413 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfb6def-9bbc-495d-9070-fadfa977bf60 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:29:25.637721 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 623/1249] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Oct 12 02:29:25 2022] POST /identity/v3/projects => generated 377 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 02:29:25.637850 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfb6def-9bbc-495d-9070-fadfa977bf60 admin admin] PATH_INFO: `/v3/roles` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:29:25.637945 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d356c85d-8f16-4c52-9c5d-633d3b7f9fc3 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:29:25.638045 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbfb6def-9bbc-495d-9070-fadfa977bf60 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:29:25.638045 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbfb6def-9bbc-495d-9070-fadfa977bf60 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:29:25.656324 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 627/1250] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Oct 12 02:29:25 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 02:29:25.656324 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfb6def-9bbc-495d-9070-fadfa977bf60 admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:29:25.665281 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:29:25.665438 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfb6def-9bbc-495d-9070-fadfa977bf60 admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:29:25.698544 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d356c85d-8f16-4c52-9c5d-633d3b7f9fc3 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:29:25.704012 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8dae56e-3510-4c7c-91ea-5dd5c8eceaf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:29:25.704662 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dae56e-3510-4c7c-91ea-5dd5c8eceaf2 admin admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:29:25.704946 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dae56e-3510-4c7c-91ea-5dd5c8eceaf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:29:25.705220 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dae56e-3510-4c7c-91ea-5dd5c8eceaf2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:29:25.705854 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8dae56e-3510-4c7c-91ea-5dd5c8eceaf2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:29:25.707770 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8dae56e-3510-4c7c-91ea-5dd5c8eceaf2 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:29:25.724581 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d37fbb7-1a8d-4461-bc33-7456b432bb61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:29:25.725198 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d37fbb7-1a8d-4461-bc33-7456b432bb61 admin admin] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:29:25.725539 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d37fbb7-1a8d-4461-bc33-7456b432bb61 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:29:25.725818 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d37fbb7-1a8d-4461-bc33-7456b432bb61 admin admin] PATH_INFO: `/v3/projects` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:29:25.726528 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d37fbb7-1a8d-4461-bc33-7456b432bb61 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:29:25.728550 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d37fbb7-1a8d-4461-bc33-7456b432bb61 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:29:25.734502 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 624/1251] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Oct 12 02:29:25 2022] POST /identity/v3/projects => generated 387 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 02:29:25.738144 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90c8e20-a720-47af-b502-fff329986863 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:29:25.738583 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90c8e20-a720-47af-b502-fff329986863 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:29:25.739326 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90c8e20-a720-47af-b502-fff329986863 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:29:25.758790 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 628/1252] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Oct 12 02:29:25 2022] POST /identity/v3/projects => generated 377 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 02:29:25.759252 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-c90c8e20-a720-47af-b502-fff329986863 None None] MFA Rules not processed for user `a326a5bb7364479382f528a592371656`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:29:25.760058 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d37fbb7-1a8d-4461-bc33-7456b432bb61 admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:29:25.760537 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-c90c8e20-a720-47af-b502-fff329986863 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:29:25.771304 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:29:25.821936 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 625/1253] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 02:29:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 02:29:25.822993 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90c8e20-a720-47af-b502-fff329986863 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:29:25.826062 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d37fbb7-1a8d-4461-bc33-7456b432bb61 admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:29:25.832123 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f476d7-d0be-45b5-8942-91f1bc39b561 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:29:25.832347 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90c8e20-a720-47af-b502-fff329986863 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:29:25.832711 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f476d7-d0be-45b5-8942-91f1bc39b561 admin admin] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:29:25.832995 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f476d7-d0be-45b5-8942-91f1bc39b561 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:29:25.833269 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f476d7-d0be-45b5-8942-91f1bc39b561 admin admin] PATH_INFO: `/v3/users` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:29:25.833934 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f476d7-d0be-45b5-8942-91f1bc39b561 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:29:25.835903 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f476d7-d0be-45b5-8942-91f1bc39b561 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:29:25.836910 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7580366-de2b-49bd-aec0-eac80ebcef1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:29:25.837510 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7580366-de2b-49bd-aec0-eac80ebcef1e admin admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:29:25.837790 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7580366-de2b-49bd-aec0-eac80ebcef1e admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:29:25.838061 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7580366-de2b-49bd-aec0-eac80ebcef1e admin admin] PATH_INFO: `/v3/projects` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:29:25.838689 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7580366-de2b-49bd-aec0-eac80ebcef1e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:29:25.840624 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7580366-de2b-49bd-aec0-eac80ebcef1e admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:29:25.858802 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 629/1254] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Oct 12 02:29:25 2022] POST /identity/v3/users => generated 294 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 02:29:25.861092 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f476d7-d0be-45b5-8942-91f1bc39b561 admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:29:25.870933 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f476d7-d0be-45b5-8942-91f1bc39b561 admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:29:25.872627 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 626/1255] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Oct 12 02:29:25 2022] POST /identity/v3/projects => generated 365 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 02:29:25.873489 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7580366-de2b-49bd-aec0-eac80ebcef1e admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:29:25.929662 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1471a654-e291-46cf-91db-35b225a056ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:29:25.930370 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1471a654-e291-46cf-91db-35b225a056ae admin admin] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:29:25.930549 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1471a654-e291-46cf-91db-35b225a056ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:29:25.930820 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1471a654-e291-46cf-91db-35b225a056ae admin admin] PATH_INFO: `/v3/projects` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:29:25.931447 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1471a654-e291-46cf-91db-35b225a056ae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:29:25.933429 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1471a654-e291-46cf-91db-35b225a056ae admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:29:25.935391 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7580366-de2b-49bd-aec0-eac80ebcef1e admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:29:25.940377 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1047e6-d643-46ea-b86c-6f8e567d9fcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:29:25.941101 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1047e6-d643-46ea-b86c-6f8e567d9fcc admin admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:29:25.941382 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1047e6-d643-46ea-b86c-6f8e567d9fcc admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:29:25.941654 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1047e6-d643-46ea-b86c-6f8e567d9fcc admin admin] PATH_INFO: `/v3/users` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:29:25.942281 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1047e6-d643-46ea-b86c-6f8e567d9fcc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:29:25.944190 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1047e6-d643-46ea-b86c-6f8e567d9fcc admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:29:25.963774 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 630/1256] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Oct 12 02:29:25 2022] POST /identity/v3/projects => generated 383 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 02:29:25.964799 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1471a654-e291-46cf-91db-35b225a056ae admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:29:25.967262 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 627/1257] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Oct 12 02:29:25 2022] POST /identity/v3/users => generated 289 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 02:29:25.968204 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1047e6-d643-46ea-b86c-6f8e567d9fcc admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:29:25.979321 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1047e6-d643-46ea-b86c-6f8e567d9fcc admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:29:25.996318 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:29:26.029228 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1471a654-e291-46cf-91db-35b225a056ae admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:29:26.033919 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac68210-bb21-40bc-b2b3-d1451a1d6f91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:29:26.034525 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac68210-bb21-40bc-b2b3-d1451a1d6f91 admin admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:29:26.034801 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac68210-bb21-40bc-b2b3-d1451a1d6f91 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:29:26.035071 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac68210-bb21-40bc-b2b3-d1451a1d6f91 admin admin] PATH_INFO: `/v3/roles` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:29:26.035709 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac68210-bb21-40bc-b2b3-d1451a1d6f91 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:29:26.037415 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac68210-bb21-40bc-b2b3-d1451a1d6f91 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:29:26.037674 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aec221d-8350-412a-8d84-a438ef9d9d19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:29:26.038298 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aec221d-8350-412a-8d84-a438ef9d9d19 admin admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:29:26.038587 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aec221d-8350-412a-8d84-a438ef9d9d19 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:29:26.038859 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aec221d-8350-412a-8d84-a438ef9d9d19 admin admin] PATH_INFO: `/v3/users` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:29:26.039495 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aec221d-8350-412a-8d84-a438ef9d9d19 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:29:26.041440 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aec221d-8350-412a-8d84-a438ef9d9d19 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:29:26.048074 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 631/1258] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Oct 12 02:29:25 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 02:29:26.049204 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac68210-bb21-40bc-b2b3-d1451a1d6f91 admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:29:26.061141 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac68210-bb21-40bc-b2b3-d1451a1d6f91 admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:29:26.064836 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 628/1259] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Oct 12 02:29:25 2022] POST /identity/v3/users => generated 294 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 02:29:26.065685 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aec221d-8350-412a-8d84-a438ef9d9d19 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:29:26.069843 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdce797b-0b06-443a-865d-bd00c10d8c2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:29:26.070450 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdce797b-0b06-443a-865d-bd00c10d8c2d admin admin] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:29:26.070725 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdce797b-0b06-443a-865d-bd00c10d8c2d admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:29:26.070996 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdce797b-0b06-443a-865d-bd00c10d8c2d admin admin] PATH_INFO: `/v3/users` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:29:26.071615 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdce797b-0b06-443a-865d-bd00c10d8c2d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:29:26.073886 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdce797b-0b06-443a-865d-bd00c10d8c2d admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:29:26.100369 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 632/1260] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Oct 12 02:29:26 2022] POST /identity/v3/users => generated 289 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 02:29:26.100369 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdce797b-0b06-443a-865d-bd00c10d8c2d admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:29:26.103205 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:29:26.109641 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdce797b-0b06-443a-865d-bd00c10d8c2d admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:29:26.115695 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528bce01-a84a-4ced-8bc9-f4c87703205b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:29:26.116501 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528bce01-a84a-4ced-8bc9-f4c87703205b admin admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:29:26.116939 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528bce01-a84a-4ced-8bc9-f4c87703205b admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:29:26.117209 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528bce01-a84a-4ced-8bc9-f4c87703205b admin admin] PATH_INFO: `/v3/roles` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:29:26.117843 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528bce01-a84a-4ced-8bc9-f4c87703205b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:29:26.119417 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528bce01-a84a-4ced-8bc9-f4c87703205b admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:29:26.125088 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aec221d-8350-412a-8d84-a438ef9d9d19 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:29:26.128864 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e5052e-8dcd-4a03-a5c6-423974eb97f4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5223b5cab3114e9b9a13c582f8ef8386', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'beb6def6fcad45959e56425bb8bff4d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:29:26.129471 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e5052e-8dcd-4a03-a5c6-423974eb97f4 service neutron] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:29:26.129750 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e5052e-8dcd-4a03-a5c6-423974eb97f4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:29:26.130021 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e5052e-8dcd-4a03-a5c6-423974eb97f4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:29:26.130240 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 633/1261] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Oct 12 02:29:26 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 02:29:26.131074 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528bce01-a84a-4ced-8bc9-f4c87703205b admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:29:26.140881 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e5052e-8dcd-4a03-a5c6-423974eb97f4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:29:26.142347 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e5052e-8dcd-4a03-a5c6-423974eb97f4 service neutron] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:29:26.142793 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528bce01-a84a-4ced-8bc9-f4c87703205b admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:29:26.147264 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6bdada-37ab-42ee-961d-e551e0a04811 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:29:26.147875 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6bdada-37ab-42ee-961d-e551e0a04811 admin admin] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:29:26.148141 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6bdada-37ab-42ee-961d-e551e0a04811 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:29:26.148411 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6bdada-37ab-42ee-961d-e551e0a04811 admin admin] PATH_INFO: `/v3/users` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:29:26.149055 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6bdada-37ab-42ee-961d-e551e0a04811 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:29:26.150908 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6bdada-37ab-42ee-961d-e551e0a04811 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:29:26.152206 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 629/1262] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 02:29:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 02:29:26.153020 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e5052e-8dcd-4a03-a5c6-423974eb97f4 service neutron] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:29:26.164870 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e5052e-8dcd-4a03-a5c6-423974eb97f4 service neutron] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:29:26.171253 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0178c361-55fd-48e8-80aa-3097cc78ab0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:29:26.171869 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0178c361-55fd-48e8-80aa-3097cc78ab0e admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:29:26.172235 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0178c361-55fd-48e8-80aa-3097cc78ab0e admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:29:26.172742 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0178c361-55fd-48e8-80aa-3097cc78ab0e admin admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:29:26.173344 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0178c361-55fd-48e8-80aa-3097cc78ab0e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:29:26.174921 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0178c361-55fd-48e8-80aa-3097cc78ab0e admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:29:26.179226 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 634/1263] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Oct 12 02:29:26 2022] POST /identity/v3/users => generated 283 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 02:29:26.183142 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6bdada-37ab-42ee-961d-e551e0a04811 admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:29:26.193041 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 630/1264] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Oct 12 02:29:26 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 02:29:26.193761 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6bdada-37ab-42ee-961d-e551e0a04811 admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:29:26.193879 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0178c361-55fd-48e8-80aa-3097cc78ab0e admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:29:26.198339 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d272f9af-f93d-47d6-99a9-c413ffe4860b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:29:26.198942 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d272f9af-f93d-47d6-99a9-c413ffe4860b admin admin] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:29:26.199217 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d272f9af-f93d-47d6-99a9-c413ffe4860b admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:29:26.199484 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d272f9af-f93d-47d6-99a9-c413ffe4860b admin admin] PATH_INFO: `/v3/users` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:29:26.200108 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d272f9af-f93d-47d6-99a9-c413ffe4860b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:29:26.202050 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d272f9af-f93d-47d6-99a9-c413ffe4860b admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:29:26.204584 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0178c361-55fd-48e8-80aa-3097cc78ab0e admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:29:26.209469 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810c7fd8-74d8-4ad9-a0d4-ea28cd16d327 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:29:26.210158 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810c7fd8-74d8-4ad9-a0d4-ea28cd16d327 admin admin] REQUEST_METHOD: `PUT` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:29:26.210490 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810c7fd8-74d8-4ad9-a0d4-ea28cd16d327 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:29:26.210772 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810c7fd8-74d8-4ad9-a0d4-ea28cd16d327 admin admin] PATH_INFO: `/v3/projects/67fa408f8459449cad4d87b5209ba810/users/ea459e1bb9a543d5aa41f288ab49c7da/roles/3d75c4d7f1a849b9a771504d1583ab28` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:29:26.225058 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 635/1265] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Oct 12 02:29:26 2022] POST /identity/v3/users => generated 292 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 02:29:26.226287 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d272f9af-f93d-47d6-99a9-c413ffe4860b admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:29:26.232423 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810c7fd8-74d8-4ad9-a0d4-ea28cd16d327 admin admin] RBAC: Authorizing `identity:create_grant(project_id=67fa408f8459449cad4d87b5209ba810, user_id=ea459e1bb9a543d5aa41f288ab49c7da, role_id=3d75c4d7f1a849b9a771504d1583ab28)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:29:26.235878 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810c7fd8-74d8-4ad9-a0d4-ea28cd16d327 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:29:26.238864 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d272f9af-f93d-47d6-99a9-c413ffe4860b admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:29:26.245463 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb85b86a-659d-42a8-8c9a-e24ee2804763 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:29:26.246536 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb85b86a-659d-42a8-8c9a-e24ee2804763 admin admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:29:26.246883 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb85b86a-659d-42a8-8c9a-e24ee2804763 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:29:26.247363 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb85b86a-659d-42a8-8c9a-e24ee2804763 admin admin] PATH_INFO: `/v3/roles` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:29:26.248025 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb85b86a-659d-42a8-8c9a-e24ee2804763 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:29:26.249673 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb85b86a-659d-42a8-8c9a-e24ee2804763 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:29:26.253398 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 631/1266] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Oct 12 02:29:26 2022] PUT /identity/v3/projects/67fa408f8459449cad4d87b5209ba810/users/ea459e1bb9a543d5aa41f288ab49c7da/roles/3d75c4d7f1a849b9a771504d1583ab28 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 02:29:26.254849 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810c7fd8-74d8-4ad9-a0d4-ea28cd16d327 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:29:26.267767 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 636/1267] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Oct 12 02:29:26 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 02:29:26.268669 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb85b86a-659d-42a8-8c9a-e24ee2804763 admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:29:26.280067 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb85b86a-659d-42a8-8c9a-e24ee2804763 admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:29:26.328870 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810c7fd8-74d8-4ad9-a0d4-ea28cd16d327 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:29:26.334895 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545217cb-c2d3-4f9c-88ed-cc9d11f589fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:29:26.336100 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545217cb-c2d3-4f9c-88ed-cc9d11f589fb admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:29:26.336447 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545217cb-c2d3-4f9c-88ed-cc9d11f589fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:29:26.336770 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545217cb-c2d3-4f9c-88ed-cc9d11f589fb admin admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:29:26.338119 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545217cb-c2d3-4f9c-88ed-cc9d11f589fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:29:26.339451 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545217cb-c2d3-4f9c-88ed-cc9d11f589fb admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:29:26.346707 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6cadc3-442e-4433-9379-a5612e5e1926 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:29:26.348169 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6cadc3-442e-4433-9379-a5612e5e1926 admin admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:29:26.348657 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6cadc3-442e-4433-9379-a5612e5e1926 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:29:26.348983 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6cadc3-442e-4433-9379-a5612e5e1926 admin admin] PATH_INFO: `/v3/roles` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:29:26.350114 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6cadc3-442e-4433-9379-a5612e5e1926 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:29:26.351798 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6cadc3-442e-4433-9379-a5612e5e1926 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:29:26.353736 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 632/1268] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Oct 12 02:29:26 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 02:29:26.354544 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545217cb-c2d3-4f9c-88ed-cc9d11f589fb admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:29:26.369357 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 637/1269] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Oct 12 02:29:26 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 02:29:26.369697 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545217cb-c2d3-4f9c-88ed-cc9d11f589fb admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:29:26.370119 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6cadc3-442e-4433-9379-a5612e5e1926 admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:29:26.375028 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3953c1-3a38-4c72-80e8-2ec9af0de7bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:29:26.376938 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3953c1-3a38-4c72-80e8-2ec9af0de7bf admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:29:26.377454 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3953c1-3a38-4c72-80e8-2ec9af0de7bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:29:26.378462 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3953c1-3a38-4c72-80e8-2ec9af0de7bf admin admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:29:26.379614 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3953c1-3a38-4c72-80e8-2ec9af0de7bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:29:26.381530 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3953c1-3a38-4c72-80e8-2ec9af0de7bf admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:29:26.381671 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6cadc3-442e-4433-9379-a5612e5e1926 admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:29:26.386435 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bef335-30a6-43d7-bfde-0e81db704a71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:29:26.387055 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bef335-30a6-43d7-bfde-0e81db704a71 admin admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:29:26.387361 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bef335-30a6-43d7-bfde-0e81db704a71 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:29:26.387637 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bef335-30a6-43d7-bfde-0e81db704a71 admin admin] PATH_INFO: `/v3/roles` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:29:26.388275 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54bef335-30a6-43d7-bfde-0e81db704a71 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:29:26.389946 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54bef335-30a6-43d7-bfde-0e81db704a71 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:29:26.394999 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 633/1270] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Oct 12 02:29:26 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 02:29:26.396479 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3953c1-3a38-4c72-80e8-2ec9af0de7bf admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:29:26.401611 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:29:26.402994 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 638/1271] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Oct 12 02:29:26 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 02:29:26.404439 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf66ca20-1d40-4d9b-8120-a0e4be67c86a None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:29:26.404802 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf66ca20-1d40-4d9b-8120-a0e4be67c86a None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:29:26.405086 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf66ca20-1d40-4d9b-8120-a0e4be67c86a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:29:26.412155 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3953c1-3a38-4c72-80e8-2ec9af0de7bf admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:29:26.419021 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7a4e9f-f52d-482b-b435-40e313174281 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:29:26.419735 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7a4e9f-f52d-482b-b435-40e313174281 admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:29:26.420703 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7a4e9f-f52d-482b-b435-40e313174281 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:29:26.421055 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7a4e9f-f52d-482b-b435-40e313174281 admin admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:29:26.422057 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7a4e9f-f52d-482b-b435-40e313174281 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:29:26.423875 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7a4e9f-f52d-482b-b435-40e313174281 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:29:26.425890 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-cf66ca20-1d40-4d9b-8120-a0e4be67c86a None None] MFA Rules not processed for user `a326a5bb7364479382f528a592371656`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:29:26.427123 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-cf66ca20-1d40-4d9b-8120-a0e4be67c86a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:29:26.435866 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 639/1272] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 02:29:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 02:29:26.436555 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf66ca20-1d40-4d9b-8120-a0e4be67c86a None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:29:26.444796 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 634/1273] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Oct 12 02:29:26 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 02:29:26.446042 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7a4e9f-f52d-482b-b435-40e313174281 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:29:26.447808 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf66ca20-1d40-4d9b-8120-a0e4be67c86a None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:29:26.452603 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4541f3b0-86d4-4e09-b479-0a168fa63511 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:29:26.453211 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4541f3b0-86d4-4e09-b479-0a168fa63511 admin admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:29:26.453613 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4541f3b0-86d4-4e09-b479-0a168fa63511 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:29:26.454103 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4541f3b0-86d4-4e09-b479-0a168fa63511 admin admin] PATH_INFO: `/v3/roles` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:29:26.454736 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4541f3b0-86d4-4e09-b479-0a168fa63511 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:29:26.456442 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4541f3b0-86d4-4e09-b479-0a168fa63511 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:29:26.457441 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7a4e9f-f52d-482b-b435-40e313174281 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:29:26.462923 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd52d7e5-cbc8-4304-be4b-d8f4da3bbeae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:29:26.463564 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd52d7e5-cbc8-4304-be4b-d8f4da3bbeae admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:29:26.463800 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd52d7e5-cbc8-4304-be4b-d8f4da3bbeae admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:29:26.464161 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd52d7e5-cbc8-4304-be4b-d8f4da3bbeae admin admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:29:26.464961 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd52d7e5-cbc8-4304-be4b-d8f4da3bbeae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:29:26.466695 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd52d7e5-cbc8-4304-be4b-d8f4da3bbeae admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:29:26.467895 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 640/1274] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Oct 12 02:29:26 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 02:29:26.472170 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4541f3b0-86d4-4e09-b479-0a168fa63511 admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:29:26.481344 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 635/1275] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Oct 12 02:29:26 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 02:29:26.481344 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd52d7e5-cbc8-4304-be4b-d8f4da3bbeae admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:29:26.483527 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4541f3b0-86d4-4e09-b479-0a168fa63511 admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:29:26.490295 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fcee84-e49a-4f0a-971c-ceab3d5c01b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:29:26.490961 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fcee84-e49a-4f0a-971c-ceab3d5c01b5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:29:26.491242 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fcee84-e49a-4f0a-971c-ceab3d5c01b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:29:26.491516 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fcee84-e49a-4f0a-971c-ceab3d5c01b5 admin admin] PATH_INFO: `/v3/projects/2e2fb888df73480d9f4ffd3258e80eec/users/284716d2cebb4a50b702bd12eb432e0b/roles/3d75c4d7f1a849b9a771504d1583ab28` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:29:26.491876 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd52d7e5-cbc8-4304-be4b-d8f4da3bbeae admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:29:26.496436 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291b859b-da44-45cc-90c5-c0627e0e2cff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:29:26.497054 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291b859b-da44-45cc-90c5-c0627e0e2cff admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:29:26.497328 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291b859b-da44-45cc-90c5-c0627e0e2cff admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:29:26.497598 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291b859b-da44-45cc-90c5-c0627e0e2cff admin admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:29:26.498256 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291b859b-da44-45cc-90c5-c0627e0e2cff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:29:26.499816 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291b859b-da44-45cc-90c5-c0627e0e2cff admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:29:26.506819 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75fcee84-e49a-4f0a-971c-ceab3d5c01b5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2e2fb888df73480d9f4ffd3258e80eec, user_id=284716d2cebb4a50b702bd12eb432e0b, role_id=3d75c4d7f1a849b9a771504d1583ab28)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:29:26.509550 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75fcee84-e49a-4f0a-971c-ceab3d5c01b5 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:29:26.511651 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 636/1276] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Oct 12 02:29:26 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 02:29:26.515063 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291b859b-da44-45cc-90c5-c0627e0e2cff admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:29:26.532499 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 641/1277] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Oct 12 02:29:26 2022] PUT /identity/v3/projects/2e2fb888df73480d9f4ffd3258e80eec/users/284716d2cebb4a50b702bd12eb432e0b/roles/3d75c4d7f1a849b9a771504d1583ab28 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 02:29:26.532499 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fcee84-e49a-4f0a-971c-ceab3d5c01b5 admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:29:26.532792 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291b859b-da44-45cc-90c5-c0627e0e2cff admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:29:26.603803 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:29:26.607518 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3204d34-4e86-456d-9d4f-e0d42559de35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:29:26.608315 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3204d34-4e86-456d-9d4f-e0d42559de35 admin admin] REQUEST_METHOD: `PUT` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:29:26.608625 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3204d34-4e86-456d-9d4f-e0d42559de35 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:29:26.608932 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3204d34-4e86-456d-9d4f-e0d42559de35 admin admin] PATH_INFO: `/v3/projects/be232e59a17f46d3bde790b2034b3a14/users/1428126dc8754da5887c6d49bbacb009/roles/3d75c4d7f1a849b9a771504d1583ab28` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:29:26.625209 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fcee84-e49a-4f0a-971c-ceab3d5c01b5 admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:29:26.631795 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3204d34-4e86-456d-9d4f-e0d42559de35 admin admin] RBAC: Authorizing `identity:create_grant(project_id=be232e59a17f46d3bde790b2034b3a14, user_id=1428126dc8754da5887c6d49bbacb009, role_id=3d75c4d7f1a849b9a771504d1583ab28)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:29:26.632911 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5a5778-94ff-4154-8f18-b6192cb6941b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:29:26.633754 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5a5778-94ff-4154-8f18-b6192cb6941b admin admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:29:26.634222 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5a5778-94ff-4154-8f18-b6192cb6941b admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:29:26.634673 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3204d34-4e86-456d-9d4f-e0d42559de35 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:29:26.634856 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5a5778-94ff-4154-8f18-b6192cb6941b admin admin] PATH_INFO: `/v3/roles` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:29:26.635791 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5a5778-94ff-4154-8f18-b6192cb6941b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:29:26.638553 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5a5778-94ff-4154-8f18-b6192cb6941b admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:29:26.654004 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 637/1278] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Oct 12 02:29:26 2022] PUT /identity/v3/projects/be232e59a17f46d3bde790b2034b3a14/users/1428126dc8754da5887c6d49bbacb009/roles/3d75c4d7f1a849b9a771504d1583ab28 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 02:29:26.654004 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3204d34-4e86-456d-9d4f-e0d42559de35 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:29:26.654650 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-c3204d34-4e86-456d-9d4f-e0d42559de35 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:29:26.654872 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 642/1279] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Oct 12 02:29:26 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 02:29:26.656034 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5a5778-94ff-4154-8f18-b6192cb6941b admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:29:26.669140 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5a5778-94ff-4154-8f18-b6192cb6941b admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:29:26.726190 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3204d34-4e86-456d-9d4f-e0d42559de35 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:29:26.730054 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11523b11-51fd-41c3-b732-0ad2cb93e0b3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5223b5cab3114e9b9a13c582f8ef8386', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'beb6def6fcad45959e56425bb8bff4d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:29:26.730668 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11523b11-51fd-41c3-b732-0ad2cb93e0b3 service neutron] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:29:26.730956 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11523b11-51fd-41c3-b732-0ad2cb93e0b3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:29:26.731231 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11523b11-51fd-41c3-b732-0ad2cb93e0b3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:29:26.743738 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160000dd-5b50-45bf-a0fe-4d3c2728fb21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:29:26.744743 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160000dd-5b50-45bf-a0fe-4d3c2728fb21 admin admin] REQUEST_METHOD: `PUT` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:29:26.745433 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160000dd-5b50-45bf-a0fe-4d3c2728fb21 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:29:26.746297 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160000dd-5b50-45bf-a0fe-4d3c2728fb21 admin admin] PATH_INFO: `/v3/projects/1eff676e44134d7d8b2049ad864793d9/users/961c8dd429784f79ae70fe961c9e4dcb/roles/3d75c4d7f1a849b9a771504d1583ab28` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:29:26.763119 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160000dd-5b50-45bf-a0fe-4d3c2728fb21 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1eff676e44134d7d8b2049ad864793d9, user_id=961c8dd429784f79ae70fe961c9e4dcb, role_id=3d75c4d7f1a849b9a771504d1583ab28)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:29:26.766610 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160000dd-5b50-45bf-a0fe-4d3c2728fb21 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:29:26.781220 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 643/1280] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Oct 12 02:29:26 2022] PUT /identity/v3/projects/1eff676e44134d7d8b2049ad864793d9/users/961c8dd429784f79ae70fe961c9e4dcb/roles/3d75c4d7f1a849b9a771504d1583ab28 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 02:29:26.782843 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160000dd-5b50-45bf-a0fe-4d3c2728fb21 admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:29:26.812009 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11523b11-51fd-41c3-b732-0ad2cb93e0b3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:29:26.814229 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11523b11-51fd-41c3-b732-0ad2cb93e0b3 service neutron] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:29:26.825439 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 638/1281] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 02:29:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 02:29:26.826249 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11523b11-51fd-41c3-b732-0ad2cb93e0b3 service neutron] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:29:26.831440 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:29:26.837580 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11523b11-51fd-41c3-b732-0ad2cb93e0b3 service neutron] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:29:26.861936 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160000dd-5b50-45bf-a0fe-4d3c2728fb21 admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:29:26.867969 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f958d1a6-c8f6-4d4a-8956-78138508584f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:29:26.868943 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f958d1a6-c8f6-4d4a-8956-78138508584f admin admin] REQUEST_METHOD: `PUT` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:29:26.869166 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f958d1a6-c8f6-4d4a-8956-78138508584f admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:29:26.869518 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f958d1a6-c8f6-4d4a-8956-78138508584f admin admin] PATH_INFO: `/v3/projects/23861c9a343c4b95b71a2415d0a28f37/users/4f91d4dca41d45ff8b6e96c3594e851b/roles/3d75c4d7f1a849b9a771504d1583ab28` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:29:26.888233 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f958d1a6-c8f6-4d4a-8956-78138508584f admin admin] RBAC: Authorizing `identity:create_grant(project_id=23861c9a343c4b95b71a2415d0a28f37, user_id=4f91d4dca41d45ff8b6e96c3594e851b, role_id=3d75c4d7f1a849b9a771504d1583ab28)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:29:26.891777 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f958d1a6-c8f6-4d4a-8956-78138508584f admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:29:26.903826 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b7934f-9e67-4e84-9632-6167d2ef7b18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:29:26.904530 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b7934f-9e67-4e84-9632-6167d2ef7b18 admin admin] REQUEST_METHOD: `PUT` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:29:26.904818 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b7934f-9e67-4e84-9632-6167d2ef7b18 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:29:26.905718 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b7934f-9e67-4e84-9632-6167d2ef7b18 admin admin] PATH_INFO: `/v3/projects/11200aad5c8b40e888ede3464d78cf32/users/3ded765f2c0f4389ad874d786f1c752c/roles/3d75c4d7f1a849b9a771504d1583ab28` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:29:26.905812 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 644/1282] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Oct 12 02:29:26 2022] PUT /identity/v3/projects/23861c9a343c4b95b71a2415d0a28f37/users/4f91d4dca41d45ff8b6e96c3594e851b/roles/3d75c4d7f1a849b9a771504d1583ab28 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 02:29:26.907697 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d5d31c-3694-4b0e-99f8-f6a6b41886f2 None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:29:26.908125 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d5d31c-3694-4b0e-99f8-f6a6b41886f2 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:29:26.908400 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d5d31c-3694-4b0e-99f8-f6a6b41886f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:29:26.924078 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b7934f-9e67-4e84-9632-6167d2ef7b18 admin admin] RBAC: Authorizing `identity:create_grant(project_id=11200aad5c8b40e888ede3464d78cf32, user_id=3ded765f2c0f4389ad874d786f1c752c, role_id=3d75c4d7f1a849b9a771504d1583ab28)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:29:26.926956 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b7934f-9e67-4e84-9632-6167d2ef7b18 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:29:26.943048 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-b7d5d31c-3694-4b0e-99f8-f6a6b41886f2 None None] MFA Rules not processed for user `284716d2cebb4a50b702bd12eb432e0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:29:26.944522 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-b7d5d31c-3694-4b0e-99f8-f6a6b41886f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:29:26.946423 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 639/1283] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Oct 12 02:29:26 2022] PUT /identity/v3/projects/11200aad5c8b40e888ede3464d78cf32/users/3ded765f2c0f4389ad874d786f1c752c/roles/3d75c4d7f1a849b9a771504d1583ab28 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 02:29:26.947527 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b7934f-9e67-4e84-9632-6167d2ef7b18 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:29:27.012034 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:29:27.018030 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b7934f-9e67-4e84-9632-6167d2ef7b18 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:29:27.022998 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5935cd5-c08a-4164-a7e8-ad7abe9ee224 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:29:27.023829 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5935cd5-c08a-4164-a7e8-ad7abe9ee224 admin admin] REQUEST_METHOD: `PUT` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:29:27.024183 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5935cd5-c08a-4164-a7e8-ad7abe9ee224 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:29:27.024549 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5935cd5-c08a-4164-a7e8-ad7abe9ee224 admin admin] PATH_INFO: `/v3/projects/6ef772a2e3634ebaa8869f4047ad8dd4/users/91a4e3a72b1947d7bf6f16e24e6fce14/roles/3d75c4d7f1a849b9a771504d1583ab28` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:29:27.048798 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5935cd5-c08a-4164-a7e8-ad7abe9ee224 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6ef772a2e3634ebaa8869f4047ad8dd4, user_id=91a4e3a72b1947d7bf6f16e24e6fce14, role_id=3d75c4d7f1a849b9a771504d1583ab28)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:29:27.052955 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5935cd5-c08a-4164-a7e8-ad7abe9ee224 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:29:27.064856 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 645/1284] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 02:29:26 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 02:29:27.066890 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1387086-9813-494f-9f54-462f33b99341 None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:29:27.069866 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1387086-9813-494f-9f54-462f33b99341 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:29:27.070347 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1387086-9813-494f-9f54-462f33b99341 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:29:27.081227 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 640/1285] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Oct 12 02:29:26 2022] PUT /identity/v3/projects/6ef772a2e3634ebaa8869f4047ad8dd4/users/91a4e3a72b1947d7bf6f16e24e6fce14/roles/3d75c4d7f1a849b9a771504d1583ab28 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 02:29:27.081227 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f46dab-4134-4a51-a326-8ebd224c4d45 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:29:27.081227 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f46dab-4134-4a51-a326-8ebd224c4d45 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:29:27.081686 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f46dab-4134-4a51-a326-8ebd224c4d45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:29:27.127797 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-f6f46dab-4134-4a51-a326-8ebd224c4d45 None None] MFA Rules not processed for user `a326a5bb7364479382f528a592371656`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:29:27.130430 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-f6f46dab-4134-4a51-a326-8ebd224c4d45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:29:27.133711 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-e1387086-9813-494f-9f54-462f33b99341 None None] MFA Rules not processed for user `1428126dc8754da5887c6d49bbacb009`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:29:27.134982 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-e1387086-9813-494f-9f54-462f33b99341 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:29:27.240119 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 641/1286] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 02:29:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 02:29:27.241979 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abafd76f-48cb-4938-a7e0-97dbaff15e0b None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:29:27.242452 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abafd76f-48cb-4938-a7e0-97dbaff15e0b None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:29:27.242940 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abafd76f-48cb-4938-a7e0-97dbaff15e0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:29:27.260959 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 646/1287] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 02:29:27 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 02:29:27.262469 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6847326c-b728-4c68-a77d-ec1c9c01152e None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:29:27.262764 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6847326c-b728-4c68-a77d-ec1c9c01152e None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:29:27.263040 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6847326c-b728-4c68-a77d-ec1c9c01152e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:29:27.280506 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-abafd76f-48cb-4938-a7e0-97dbaff15e0b None None] MFA Rules not processed for user `a326a5bb7364479382f528a592371656`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:29:27.285285 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-abafd76f-48cb-4938-a7e0-97dbaff15e0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:29:27.319714 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-6847326c-b728-4c68-a77d-ec1c9c01152e None None] MFA Rules not processed for user `3ded765f2c0f4389ad874d786f1c752c`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:29:27.321196 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-6847326c-b728-4c68-a77d-ec1c9c01152e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:29:27.321552 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 642/1288] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 02:29:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 02:29:27.323392 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abafd76f-48cb-4938-a7e0-97dbaff15e0b None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:29:27.333783 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:29:27.352691 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abafd76f-48cb-4938-a7e0-97dbaff15e0b None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:29:27.362461 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755e8443-663c-4e28-acc4-d747e3d66d27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:29:27.364966 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755e8443-663c-4e28-acc4-d747e3d66d27 admin admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:29:27.365857 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755e8443-663c-4e28-acc4-d747e3d66d27 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:29:27.367256 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755e8443-663c-4e28-acc4-d747e3d66d27 admin admin] PATH_INFO: `/v3/projects` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:29:27.370227 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755e8443-663c-4e28-acc4-d747e3d66d27 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:29:27.376023 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755e8443-663c-4e28-acc4-d747e3d66d27 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:29:27.438603 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 643/1289] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Oct 12 02:29:27 2022] POST /identity/v3/projects => generated 387 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 02:29:27.445794 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0b529d-37cf-40e7-8b30-55051b391285 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:29:27.446261 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0b529d-37cf-40e7-8b30-55051b391285 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:29:27.447636 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0b529d-37cf-40e7-8b30-55051b391285 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:29:27.481558 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 647/1290] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 02:29:27 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 02:29:27.488376 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6847326c-b728-4c68-a77d-ec1c9c01152e None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:29:27.516320 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-fa0b529d-37cf-40e7-8b30-55051b391285 None None] MFA Rules not processed for user `91a4e3a72b1947d7bf6f16e24e6fce14`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:29:27.518886 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-fa0b529d-37cf-40e7-8b30-55051b391285 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:29:27.526624 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6847326c-b728-4c68-a77d-ec1c9c01152e None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:29:27.612077 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 644/1291] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 02:29:27 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 02:29:27.612077 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0b529d-37cf-40e7-8b30-55051b391285 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:29:27.680118 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cabb7c-fc10-4c49-84d6-35f684a80fe8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:29:27.682555 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cabb7c-fc10-4c49-84d6-35f684a80fe8 admin admin] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:29:27.683200 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cabb7c-fc10-4c49-84d6-35f684a80fe8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:29:27.684020 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cabb7c-fc10-4c49-84d6-35f684a80fe8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:29:27.686859 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4cabb7c-fc10-4c49-84d6-35f684a80fe8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:29:27.690332 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4cabb7c-fc10-4c49-84d6-35f684a80fe8 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:29:27.699946 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:29:27.706453 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0b529d-37cf-40e7-8b30-55051b391285 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:29:27.712063 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f1a042-df9d-48d7-8680-d94613ad2f66 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5223b5cab3114e9b9a13c582f8ef8386', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'beb6def6fcad45959e56425bb8bff4d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:29:27.713530 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f1a042-df9d-48d7-8680-d94613ad2f66 service neutron] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:29:27.713739 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f1a042-df9d-48d7-8680-d94613ad2f66 service neutron] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:29:27.713949 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f1a042-df9d-48d7-8680-d94613ad2f66 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:29:27.725715 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f1a042-df9d-48d7-8680-d94613ad2f66 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:29:27.727373 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f1a042-df9d-48d7-8680-d94613ad2f66 service neutron] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:29:27.742773 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 645/1292] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 02:29:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 02:29:27.744017 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f1a042-df9d-48d7-8680-d94613ad2f66 service neutron] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:29:27.755535 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 648/1293] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Oct 12 02:29:27 2022] POST /identity/v3/projects => generated 377 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 02:29:27.756421 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cabb7c-fc10-4c49-84d6-35f684a80fe8 admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:29:27.759302 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f1a042-df9d-48d7-8680-d94613ad2f66 service neutron] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:29:27.834035 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8058f194-3f4c-4d0c-86d3-3154f41551f5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5223b5cab3114e9b9a13c582f8ef8386', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'beb6def6fcad45959e56425bb8bff4d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:29:27.834858 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8058f194-3f4c-4d0c-86d3-3154f41551f5 service neutron] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:29:27.835198 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8058f194-3f4c-4d0c-86d3-3154f41551f5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:29:27.835478 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8058f194-3f4c-4d0c-86d3-3154f41551f5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:29:27.870124 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:29:27.926860 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cabb7c-fc10-4c49-84d6-35f684a80fe8 admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:29:27.928851 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8058f194-3f4c-4d0c-86d3-3154f41551f5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:29:27.930757 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8058f194-3f4c-4d0c-86d3-3154f41551f5 service neutron] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:29:27.940577 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3f5526-2cad-4911-935d-7d741534ea75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:29:27.941964 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3f5526-2cad-4911-935d-7d741534ea75 admin admin] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:29:27.941964 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3f5526-2cad-4911-935d-7d741534ea75 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:29:27.942186 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3f5526-2cad-4911-935d-7d741534ea75 admin admin] PATH_INFO: `/v3/users` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:29:27.943784 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3f5526-2cad-4911-935d-7d741534ea75 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:29:27.947074 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3f5526-2cad-4911-935d-7d741534ea75 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:29:27.953473 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 646/1294] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 02:29:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 02:29:27.955011 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8058f194-3f4c-4d0c-86d3-3154f41551f5 service neutron] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:29:27.995457 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 649/1295] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Oct 12 02:29:27 2022] POST /identity/v3/users => generated 300 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 02:29:27.996827 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d00affd-cb21-408e-af2f-9b4ce413f603 None None] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:29:27.997115 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d00affd-cb21-408e-af2f-9b4ce413f603 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:29:27.997392 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d00affd-cb21-408e-af2f-9b4ce413f603 None None] PATH_INFO: `/` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:29:28.002529 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 650/1296] 10.222.0.18 () {54 vars in 961 bytes} [Wed Oct 12 02:29:27 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 02:29:28.003488 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d00affd-cb21-408e-af2f-9b4ce413f603 None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:29:28.034213 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d00affd-cb21-408e-af2f-9b4ce413f603 None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:29:28.048810 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d627ede6-34bc-49a8-8c8a-3a0470622e87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:29:28.050590 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d627ede6-34bc-49a8-8c8a-3a0470622e87 admin admin] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:29:28.050873 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d627ede6-34bc-49a8-8c8a-3a0470622e87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:29:28.052976 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d627ede6-34bc-49a8-8c8a-3a0470622e87 admin admin] PATH_INFO: `/v3/users` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:29:28.053659 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d627ede6-34bc-49a8-8c8a-3a0470622e87 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:29:28.057820 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d627ede6-34bc-49a8-8c8a-3a0470622e87 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:29:28.089632 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8058f194-3f4c-4d0c-86d3-3154f41551f5 service neutron] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:29:28.103737 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114af7ca-f686-48a8-9795-2721ad65c1ea service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ba688e0c4d44d13898539ee886f95fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'beb6def6fcad45959e56425bb8bff4d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:29:28.104395 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114af7ca-f686-48a8-9795-2721ad65c1ea service cinder] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:29:28.104760 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114af7ca-f686-48a8-9795-2721ad65c1ea service cinder] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:29:28.104933 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114af7ca-f686-48a8-9795-2721ad65c1ea service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:29:28.115458 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 651/1297] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Oct 12 02:29:28 2022] POST /identity/v3/users => generated 295 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 02:29:28.115458 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d627ede6-34bc-49a8-8c8a-3a0470622e87 admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:29:28.139137 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d627ede6-34bc-49a8-8c8a-3a0470622e87 admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:29:28.146739 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606e6356-002a-48c9-a828-432043f93fd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:29:28.147686 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606e6356-002a-48c9-a828-432043f93fd5 admin admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:29:28.148152 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606e6356-002a-48c9-a828-432043f93fd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:29:28.148598 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606e6356-002a-48c9-a828-432043f93fd5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:29:28.149443 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606e6356-002a-48c9-a828-432043f93fd5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:29:28.151608 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606e6356-002a-48c9-a828-432043f93fd5 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:29:28.165817 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 652/1298] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Oct 12 02:29:28 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 02:29:28.167563 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33634961-5265-4489-9cb6-0c7ed6d5a544 None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:29:28.167953 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33634961-5265-4489-9cb6-0c7ed6d5a544 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:29:28.168295 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33634961-5265-4489-9cb6-0c7ed6d5a544 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:29:28.216965 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-33634961-5265-4489-9cb6-0c7ed6d5a544 None None] MFA Rules not processed for user `f2fca96c111b45b795fb757f77908ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:29:28.218349 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-33634961-5265-4489-9cb6-0c7ed6d5a544 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:29:28.264389 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114af7ca-f686-48a8-9795-2721ad65c1ea service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:29:28.267925 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114af7ca-f686-48a8-9795-2721ad65c1ea service cinder] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:29:28.304048 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 647/1299] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 02:29:27 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 02:29:28.308829 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114af7ca-f686-48a8-9795-2721ad65c1ea service cinder] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:29:28.345430 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114af7ca-f686-48a8-9795-2721ad65c1ea service cinder] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:29:28.351686 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 653/1300] 10.222.0.18 () {58 vars in 1058 bytes} [Wed Oct 12 02:29:28 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 02:29:28.352079 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33634961-5265-4489-9cb6-0c7ed6d5a544 None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:29:28.369260 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33634961-5265-4489-9cb6-0c7ed6d5a544 None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:29:28.373828 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f6001c-ea12-408f-ab30-c034231d246c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:29:28.374394 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f6001c-ea12-408f-ab30-c034231d246c admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:29:28.374670 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f6001c-ea12-408f-ab30-c034231d246c admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:29:28.374946 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f6001c-ea12-408f-ab30-c034231d246c admin admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:29:28.377255 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f6001c-ea12-408f-ab30-c034231d246c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:29:28.378895 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f6001c-ea12-408f-ab30-c034231d246c admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:29:28.384820 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d9bffa-f722-4678-a903-a3e69f446434 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:29:28.384820 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d9bffa-f722-4678-a903-a3e69f446434 admin admin] REQUEST_METHOD: `PUT` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:29:28.385348 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d9bffa-f722-4678-a903-a3e69f446434 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:29:28.385628 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d9bffa-f722-4678-a903-a3e69f446434 admin admin] PATH_INFO: `/v3/projects/d76d0b531ca84c34b721f128c90419df/users/a52de96133f54824bdc280f50ff6abe6/roles/39b1e8108dff402383def3c559f48189` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:29:28.409056 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 648/1301] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Oct 12 02:29:28 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 02:29:28.409937 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f6001c-ea12-408f-ab30-c034231d246c admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:29:28.428173 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d9bffa-f722-4678-a903-a3e69f446434 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d76d0b531ca84c34b721f128c90419df, user_id=a52de96133f54824bdc280f50ff6abe6, role_id=39b1e8108dff402383def3c559f48189)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:29:28.431625 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d9bffa-f722-4678-a903-a3e69f446434 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:29:28.439303 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f6001c-ea12-408f-ab30-c034231d246c admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:29:28.444692 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:29:28.455124 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 654/1302] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Oct 12 02:29:28 2022] PUT /identity/v3/projects/d76d0b531ca84c34b721f128c90419df/users/a52de96133f54824bdc280f50ff6abe6/roles/39b1e8108dff402383def3c559f48189 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 02:29:28.456766 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d9bffa-f722-4678-a903-a3e69f446434 admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:29:28.457217 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94da23da-cde6-466d-82d1-a963356dfab7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fca96c111b45b795fb757f77908ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'beb6def6fcad45959e56425bb8bff4d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:29:28.458127 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94da23da-cde6-466d-82d1-a963356dfab7 service nova] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:29:28.458417 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94da23da-cde6-466d-82d1-a963356dfab7 service nova] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:29:28.458689 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94da23da-cde6-466d-82d1-a963356dfab7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:29:28.558062 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d9bffa-f722-4678-a903-a3e69f446434 admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:29:28.563774 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26ec830-0a4f-4bca-a52a-f30fcde6f03a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:29:28.564449 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26ec830-0a4f-4bca-a52a-f30fcde6f03a admin admin] REQUEST_METHOD: `PUT` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:29:28.565430 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26ec830-0a4f-4bca-a52a-f30fcde6f03a admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:29:28.565726 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26ec830-0a4f-4bca-a52a-f30fcde6f03a admin admin] PATH_INFO: `/v3/projects/63c8324fb15d4b1bb6d17447a5e7638b/users/3f63d9ac0b6c4fe885b82a80e42a6d86/roles/39b1e8108dff402383def3c559f48189` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:29:28.663300 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94da23da-cde6-466d-82d1-a963356dfab7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:29:28.663300 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94da23da-cde6-466d-82d1-a963356dfab7 service nova] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:29:28.697333 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26ec830-0a4f-4bca-a52a-f30fcde6f03a admin admin] RBAC: Authorizing `identity:create_grant(project_id=63c8324fb15d4b1bb6d17447a5e7638b, user_id=3f63d9ac0b6c4fe885b82a80e42a6d86, role_id=39b1e8108dff402383def3c559f48189)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:29:28.697333 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26ec830-0a4f-4bca-a52a-f30fcde6f03a admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:29:28.698180 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 649/1304] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 02:29:28 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 248 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 02:29:28.698180 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94da23da-cde6-466d-82d1-a963356dfab7 service nova] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:29:28.698490 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 655/1304] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Oct 12 02:29:28 2022] PUT /identity/v3/projects/63c8324fb15d4b1bb6d17447a5e7638b/users/3f63d9ac0b6c4fe885b82a80e42a6d86/roles/39b1e8108dff402383def3c559f48189 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 02:29:28.698490 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26ec830-0a4f-4bca-a52a-f30fcde6f03a admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:29:28.698660 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:29:28.698660 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94da23da-cde6-466d-82d1-a963356dfab7 service nova] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:29:28.801907 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26ec830-0a4f-4bca-a52a-f30fcde6f03a admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:29:28.808171 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2382b3c-c2d5-462a-9a3d-b6772661c243 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:29:28.810481 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2382b3c-c2d5-462a-9a3d-b6772661c243 admin admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:29:28.811021 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2382b3c-c2d5-462a-9a3d-b6772661c243 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:29:28.811527 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2382b3c-c2d5-462a-9a3d-b6772661c243 admin admin] PATH_INFO: `/v3/roles` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:29:28.813725 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2382b3c-c2d5-462a-9a3d-b6772661c243 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:29:28.815984 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2382b3c-c2d5-462a-9a3d-b6772661c243 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:29:28.852363 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 656/1305] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Oct 12 02:29:28 2022] GET /identity/v3/roles => generated 1420 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 02:29:28.854001 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2382b3c-c2d5-462a-9a3d-b6772661c243 admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:29:28.858613 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c07579-e8cf-464c-a822-9fcb990c1efb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:29:28.859255 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c07579-e8cf-464c-a822-9fcb990c1efb admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:29:28.861236 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c07579-e8cf-464c-a822-9fcb990c1efb admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:29:28.874110 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2382b3c-c2d5-462a-9a3d-b6772661c243 admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:29:28.880839 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c07579-e8cf-464c-a822-9fcb990c1efb admin admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:29:28.881609 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c07579-e8cf-464c-a822-9fcb990c1efb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:29:28.883822 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f5340b-6a08-404a-9a6d-e3da7f77efda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:29:28.884032 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c07579-e8cf-464c-a822-9fcb990c1efb admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:29:28.884798 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f5340b-6a08-404a-9a6d-e3da7f77efda admin admin] REQUEST_METHOD: `PUT` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:29:28.885171 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f5340b-6a08-404a-9a6d-e3da7f77efda admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:29:28.885788 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f5340b-6a08-404a-9a6d-e3da7f77efda admin admin] PATH_INFO: `/v3/projects/63c8324fb15d4b1bb6d17447a5e7638b/users/3f63d9ac0b6c4fe885b82a80e42a6d86/roles/39b1e8108dff402383def3c559f48189` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:29:28.897101 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f5340b-6a08-404a-9a6d-e3da7f77efda admin admin] RBAC: Authorizing `identity:create_grant(project_id=63c8324fb15d4b1bb6d17447a5e7638b, user_id=3f63d9ac0b6c4fe885b82a80e42a6d86, role_id=39b1e8108dff402383def3c559f48189)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:29:28.900380 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f5340b-6a08-404a-9a6d-e3da7f77efda admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:29:28.908272 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 650/1306] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Oct 12 02:29:28 2022] GET /identity/v3/roles => generated 1420 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 02:29:28.916384 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c07579-e8cf-464c-a822-9fcb990c1efb admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:29:28.930392 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 657/1307] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Oct 12 02:29:28 2022] PUT /identity/v3/projects/63c8324fb15d4b1bb6d17447a5e7638b/users/3f63d9ac0b6c4fe885b82a80e42a6d86/roles/39b1e8108dff402383def3c559f48189 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 02:29:28.943248 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bb8bae-fef1-4e66-8a84-ffe8fe552ce9 None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:29:28.944510 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bb8bae-fef1-4e66-8a84-ffe8fe552ce9 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:29:28.944892 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bb8bae-fef1-4e66-8a84-ffe8fe552ce9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:29:28.947808 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c07579-e8cf-464c-a822-9fcb990c1efb admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:29:29.050933 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-e1bb8bae-fef1-4e66-8a84-ffe8fe552ce9 None None] MFA Rules not processed for user `3f63d9ac0b6c4fe885b82a80e42a6d86`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:29:29.052193 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-e1bb8bae-fef1-4e66-8a84-ffe8fe552ce9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:29:29.067346 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877e93d4-8d7b-4742-af1b-82621734ea4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:29:29.068320 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877e93d4-8d7b-4742-af1b-82621734ea4b admin admin] REQUEST_METHOD: `PUT` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:29:29.068819 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877e93d4-8d7b-4742-af1b-82621734ea4b admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:29:29.069175 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877e93d4-8d7b-4742-af1b-82621734ea4b admin admin] PATH_INFO: `/v3/projects/d76d0b531ca84c34b721f128c90419df/users/a52de96133f54824bdc280f50ff6abe6/roles/39b1e8108dff402383def3c559f48189` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:29:29.071957 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877e93d4-8d7b-4742-af1b-82621734ea4b admin admin] RBAC: Authorizing `identity:create_grant(project_id=d76d0b531ca84c34b721f128c90419df, user_id=a52de96133f54824bdc280f50ff6abe6, role_id=39b1e8108dff402383def3c559f48189)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:29:29.075415 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877e93d4-8d7b-4742-af1b-82621734ea4b admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:29:29.102289 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 651/1308] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Oct 12 02:29:28 2022] PUT /identity/v3/projects/d76d0b531ca84c34b721f128c90419df/users/a52de96133f54824bdc280f50ff6abe6/roles/39b1e8108dff402383def3c559f48189 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 02:29:29.108158 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73acbecf-b2ea-4e6c-b78d-cc5139ea1b21 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:29:29.108659 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73acbecf-b2ea-4e6c-b78d-cc5139ea1b21 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:29:29.109217 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73acbecf-b2ea-4e6c-b78d-cc5139ea1b21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:29:29.162622 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:29:29.175532 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-73acbecf-b2ea-4e6c-b78d-cc5139ea1b21 None None] MFA Rules not processed for user `a52de96133f54824bdc280f50ff6abe6`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:29:29.176945 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-73acbecf-b2ea-4e6c-b78d-cc5139ea1b21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:29:29.208077 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 658/1309] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 02:29:28 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 02:29:29.219959 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bb8bae-fef1-4e66-8a84-ffe8fe552ce9 None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:29:29.354091 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 652/1310] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 02:29:29 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 02:29:29.354091 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b33bf09-82e0-4756-92be-2bf65ca6d95a None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:29:29.354091 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b33bf09-82e0-4756-92be-2bf65ca6d95a None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:29:29.354091 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b33bf09-82e0-4756-92be-2bf65ca6d95a None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:29:29.362205 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 653/1311] 10.222.0.18 () {54 vars in 912 bytes} [Wed Oct 12 02:29:29 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 02:29:29.365236 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b4a22a-d0f1-4040-8dac-62ad508ff2b5 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:29:29.365411 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b4a22a-d0f1-4040-8dac-62ad508ff2b5 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:29:29.365859 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b4a22a-d0f1-4040-8dac-62ad508ff2b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:29:29.408967 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bb8bae-fef1-4e66-8a84-ffe8fe552ce9 None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:29:29.411676 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-b7b4a22a-d0f1-4040-8dac-62ad508ff2b5 None None] MFA Rules not processed for user `f2fca96c111b45b795fb757f77908ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:29:29.413980 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-b7b4a22a-d0f1-4040-8dac-62ad508ff2b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:29:29.485723 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:29:29.555569 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7104e12f-a370-4d23-a877-41762a3264c8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ba688e0c4d44d13898539ee886f95fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'beb6def6fcad45959e56425bb8bff4d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:29:29.556426 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7104e12f-a370-4d23-a877-41762a3264c8 service cinder] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:29:29.556883 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7104e12f-a370-4d23-a877-41762a3264c8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:29:29.557309 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7104e12f-a370-4d23-a877-41762a3264c8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:29:29.625417 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 654/1312] 10.222.0.18 () {58 vars in 1009 bytes} [Wed Oct 12 02:29:29 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 02:29:29.632675 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b4a22a-d0f1-4040-8dac-62ad508ff2b5 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:29:29.664044 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b4a22a-d0f1-4040-8dac-62ad508ff2b5 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:29:29.675459 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7182488d-2efb-4c33-bbde-b91bd963138b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ba688e0c4d44d13898539ee886f95fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'beb6def6fcad45959e56425bb8bff4d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:29:29.677185 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7182488d-2efb-4c33-bbde-b91bd963138b service cinder] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:29:29.677652 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7182488d-2efb-4c33-bbde-b91bd963138b service cinder] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:29:29.678118 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7182488d-2efb-4c33-bbde-b91bd963138b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:29:29.705373 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7182488d-2efb-4c33-bbde-b91bd963138b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:29:29.707575 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7182488d-2efb-4c33-bbde-b91bd963138b service cinder] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:29:29.728301 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7104e12f-a370-4d23-a877-41762a3264c8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:29:29.732207 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7104e12f-a370-4d23-a877-41762a3264c8 service cinder] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:29:29.737654 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 655/1313] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 02:29:29 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 02:29:29.766741 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 659/1314] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 02:29:29 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 548 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 02:29:30.065971 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7182488d-2efb-4c33-bbde-b91bd963138b service cinder] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:29:30.087989 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7182488d-2efb-4c33-bbde-b91bd963138b service cinder] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:29:30.092713 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3a0c76-fde5-412e-9a50-3914a076c8ad service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ba688e0c4d44d13898539ee886f95fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'beb6def6fcad45959e56425bb8bff4d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:29:30.093339 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3a0c76-fde5-412e-9a50-3914a076c8ad service cinder] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:29:30.093622 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3a0c76-fde5-412e-9a50-3914a076c8ad service cinder] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:29:30.094078 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3a0c76-fde5-412e-9a50-3914a076c8ad service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:29:30.115999 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3a0c76-fde5-412e-9a50-3914a076c8ad service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:29:30.117484 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3a0c76-fde5-412e-9a50-3914a076c8ad service cinder] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:29:30.131671 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 656/1315] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 02:29:30 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 02:29:30.821745 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7104e12f-a370-4d23-a877-41762a3264c8 service cinder] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:29:30.951240 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7104e12f-a370-4d23-a877-41762a3264c8 service cinder] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:29:30.961502 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9efccfa-2868-4873-a723-8450023757c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:29:30.962217 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9efccfa-2868-4873-a723-8450023757c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:29:30.962772 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9efccfa-2868-4873-a723-8450023757c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:29:30.963070 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9efccfa-2868-4873-a723-8450023757c1 admin admin] PATH_INFO: `/v3/users/284716d2cebb4a50b702bd12eb432e0b` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:29:30.964708 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9efccfa-2868-4873-a723-8450023757c1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=284716d2cebb4a50b702bd12eb432e0b)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:29:30.966673 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9efccfa-2868-4873-a723-8450023757c1 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:29:30.971590 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:29:31.101890 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-a9efccfa-2868-4873-a723-8450023757c1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '284716d2cebb4a50b702bd12eb432e0b'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:29:31.125369 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-a9efccfa-2868-4873-a723-8450023757c1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '284716d2cebb4a50b702bd12eb432e0b'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:29:31.154757 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-a9efccfa-2868-4873-a723-8450023757c1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '284716d2cebb4a50b702bd12eb432e0b'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:29:31.173866 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-a9efccfa-2868-4873-a723-8450023757c1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '284716d2cebb4a50b702bd12eb432e0b'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:29:31.176561 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-a9efccfa-2868-4873-a723-8450023757c1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '284716d2cebb4a50b702bd12eb432e0b'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:29:31.204586 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 660/1316] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Oct 12 02:29:30 2022] DELETE /identity/v3/users/284716d2cebb4a50b702bd12eb432e0b => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 02:29:31.206987 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76211434-5a93-4d8a-9e75-ba524e5f9755 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:29:31.207885 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76211434-5a93-4d8a-9e75-ba524e5f9755 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:29:31.208394 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76211434-5a93-4d8a-9e75-ba524e5f9755 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:29:31.249655 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-76211434-5a93-4d8a-9e75-ba524e5f9755 None None] MFA Rules not processed for user `a326a5bb7364479382f528a592371656`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:29:31.254886 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-76211434-5a93-4d8a-9e75-ba524e5f9755 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:29:31.306326 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610b647b-2bdc-4d38-8f62-6a63e199ce93 None None] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:29:31.307066 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610b647b-2bdc-4d38-8f62-6a63e199ce93 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:29:31.307502 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610b647b-2bdc-4d38-8f62-6a63e199ce93 None None] PATH_INFO: `/` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:29:31.309326 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 661/1317] 10.222.0.18 () {54 vars in 961 bytes} [Wed Oct 12 02:29:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 02:29:31.323113 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d023db9-cba2-4a30-bc70-4bb80384d659 None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:29:31.323709 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d023db9-cba2-4a30-bc70-4bb80384d659 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:29:31.324182 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d023db9-cba2-4a30-bc70-4bb80384d659 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:29:31.369608 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-4d023db9-cba2-4a30-bc70-4bb80384d659 None None] MFA Rules not processed for user `f2fca96c111b45b795fb757f77908ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:29:31.370866 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-4d023db9-cba2-4a30-bc70-4bb80384d659 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:29:31.418334 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 657/1318] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 02:29:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 02:29:31.454257 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76211434-5a93-4d8a-9e75-ba524e5f9755 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:29:31.456988 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-76211434-5a93-4d8a-9e75-ba524e5f9755 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:29:31.598072 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 662/1319] 10.222.0.18 () {58 vars in 1058 bytes} [Wed Oct 12 02:29:31 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 276 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 02:29:31.601671 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c8eaa5-1707-4773-94c9-163290e88310 None None] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:29:31.603903 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c8eaa5-1707-4773-94c9-163290e88310 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:29:31.604968 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c8eaa5-1707-4773-94c9-163290e88310 None None] PATH_INFO: `/` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:29:31.623487 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 663/1320] 10.222.0.18 () {54 vars in 912 bytes} [Wed Oct 12 02:29:31 2022] GET /identity => generated 270 bytes in 25 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 02:29:31.627469 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef25a5ed-1c64-4e07-9b8e-557e1190f5b6 None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:29:31.627955 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef25a5ed-1c64-4e07-9b8e-557e1190f5b6 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:29:31.628235 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef25a5ed-1c64-4e07-9b8e-557e1190f5b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:29:31.657450 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76211434-5a93-4d8a-9e75-ba524e5f9755 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:29:31.663001 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-ef25a5ed-1c64-4e07-9b8e-557e1190f5b6 None None] MFA Rules not processed for user `f2fca96c111b45b795fb757f77908ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:29:31.668116 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-ef25a5ed-1c64-4e07-9b8e-557e1190f5b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:29:31.670253 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36e226d-007f-4723-b10e-20330b57f8ff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5223b5cab3114e9b9a13c582f8ef8386', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'beb6def6fcad45959e56425bb8bff4d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:29:31.670906 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36e226d-007f-4723-b10e-20330b57f8ff service neutron] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:29:31.671190 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36e226d-007f-4723-b10e-20330b57f8ff service neutron] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:29:31.671485 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36e226d-007f-4723-b10e-20330b57f8ff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:29:31.694963 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 664/1321] 10.222.0.18 () {58 vars in 1009 bytes} [Wed Oct 12 02:29:31 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 02:29:31.698887 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36e226d-007f-4723-b10e-20330b57f8ff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:29:31.700375 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36e226d-007f-4723-b10e-20330b57f8ff service neutron] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:29:31.702987 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef25a5ed-1c64-4e07-9b8e-557e1190f5b6 None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:29:31.706636 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-ef25a5ed-1c64-4e07-9b8e-557e1190f5b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:29:31.724460 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 658/1322] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 02:29:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 272 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 02:29:31.892795 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef25a5ed-1c64-4e07-9b8e-557e1190f5b6 None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:29:31.900688 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3679a41d-f703-4ca6-a5f4-db1e75a7ac68 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ba688e0c4d44d13898539ee886f95fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'beb6def6fcad45959e56425bb8bff4d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:29:31.901332 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3679a41d-f703-4ca6-a5f4-db1e75a7ac68 service cinder] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:29:31.903799 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3679a41d-f703-4ca6-a5f4-db1e75a7ac68 service cinder] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:29:31.904763 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3679a41d-f703-4ca6-a5f4-db1e75a7ac68 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:29:31.934089 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3679a41d-f703-4ca6-a5f4-db1e75a7ac68 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:29:31.940603 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3679a41d-f703-4ca6-a5f4-db1e75a7ac68 service cinder] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:29:31.959811 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 665/1323] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 02:29:31 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 258 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 02:29:33.404716 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36e226d-007f-4723-b10e-20330b57f8ff service neutron] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:29:33.408756 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-c36e226d-007f-4723-b10e-20330b57f8ff service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:29:33.441674 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36e226d-007f-4723-b10e-20330b57f8ff service neutron] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:29:33.466540 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b04af04-938a-49ec-b94a-643576ec9b3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:29:33.467106 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b04af04-938a-49ec-b94a-643576ec9b3a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:29:33.467396 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b04af04-938a-49ec-b94a-643576ec9b3a admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:29:33.468133 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b04af04-938a-49ec-b94a-643576ec9b3a admin admin] PATH_INFO: `/v3/projects/2e2fb888df73480d9f4ffd3258e80eec` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:29:33.473663 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b04af04-938a-49ec-b94a-643576ec9b3a admin admin] RBAC: Authorizing `identity:delete_project(project_id=2e2fb888df73480d9f4ffd3258e80eec)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:29:33.475893 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b04af04-938a-49ec-b94a-643576ec9b3a admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:29:33.559710 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:29:33.667803 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-9b04af04-938a-49ec-b94a-643576ec9b3a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2e2fb888df73480d9f4ffd3258e80eec', 'request_id': 'req-9b04af04-938a-49ec-b94a-643576ec9b3a'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:29:33.691715 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-9b04af04-938a-49ec-b94a-643576ec9b3a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2e2fb888df73480d9f4ffd3258e80eec', 'request_id': 'req-9b04af04-938a-49ec-b94a-643576ec9b3a'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:29:33.708330 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-9b04af04-938a-49ec-b94a-643576ec9b3a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2e2fb888df73480d9f4ffd3258e80eec', 'request_id': 'req-9b04af04-938a-49ec-b94a-643576ec9b3a'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:29:33.757776 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-9b04af04-938a-49ec-b94a-643576ec9b3a admin admin] The token cache is being invalidate because project 2e2fb888df73480d9f4ffd3258e80eec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81362) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 02:29:33.758087 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-9b04af04-938a-49ec-b94a-643576ec9b3a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:29:33.758810 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-9b04af04-938a-49ec-b94a-643576ec9b3a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:29:33.775879 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 659/1324] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Oct 12 02:29:33 2022] DELETE /identity/v3/projects/2e2fb888df73480d9f4ffd3258e80eec => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 02:29:33.779719 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3679a41d-f703-4ca6-a5f4-db1e75a7ac68 service cinder] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:29:33.809137 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3679a41d-f703-4ca6-a5f4-db1e75a7ac68 service cinder] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:29:33.815007 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b04af04-938a-49ec-b94a-643576ec9b3a admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:29:33.820259 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-9b04af04-938a-49ec-b94a-643576ec9b3a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:29:33.858871 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:29:34.042827 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b04af04-938a-49ec-b94a-643576ec9b3a admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:29:34.055722 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b27bd1-30b0-4e53-a297-742e93744ff3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ba688e0c4d44d13898539ee886f95fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'beb6def6fcad45959e56425bb8bff4d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:29:34.056192 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b27bd1-30b0-4e53-a297-742e93744ff3 service cinder] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:29:34.056524 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b27bd1-30b0-4e53-a297-742e93744ff3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:29:34.056832 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b27bd1-30b0-4e53-a297-742e93744ff3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:29:34.058848 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855cb558-9675-4b06-8bcc-daf839c234b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:29:34.061649 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855cb558-9675-4b06-8bcc-daf839c234b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:29:34.061786 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-e4b27bd1-30b0-4e53-a297-742e93744ff3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:29:34.064422 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855cb558-9675-4b06-8bcc-daf839c234b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:29:34.064919 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855cb558-9675-4b06-8bcc-daf839c234b8 admin admin] PATH_INFO: `/v3/users/a52de96133f54824bdc280f50ff6abe6` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:29:34.066482 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855cb558-9675-4b06-8bcc-daf839c234b8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a52de96133f54824bdc280f50ff6abe6)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:29:34.072105 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855cb558-9675-4b06-8bcc-daf839c234b8 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:29:34.174783 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-855cb558-9675-4b06-8bcc-daf839c234b8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a52de96133f54824bdc280f50ff6abe6'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:29:34.190839 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-855cb558-9675-4b06-8bcc-daf839c234b8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a52de96133f54824bdc280f50ff6abe6'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:29:34.223003 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-855cb558-9675-4b06-8bcc-daf839c234b8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a52de96133f54824bdc280f50ff6abe6'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:29:34.243211 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-855cb558-9675-4b06-8bcc-daf839c234b8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a52de96133f54824bdc280f50ff6abe6'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:29:34.243975 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-855cb558-9675-4b06-8bcc-daf839c234b8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a52de96133f54824bdc280f50ff6abe6'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:29:34.253359 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b27bd1-30b0-4e53-a297-742e93744ff3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:29:34.256006 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b27bd1-30b0-4e53-a297-742e93744ff3 service cinder] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:29:34.258163 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 666/1325] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Oct 12 02:29:33 2022] DELETE /identity/v3/users/a52de96133f54824bdc280f50ff6abe6 => generated 0 bytes in 479 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 02:29:34.270372 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 660/1326] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 02:29:33 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 456 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 02:29:34.970233 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855cb558-9675-4b06-8bcc-daf839c234b8 admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:29:34.972387 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-855cb558-9675-4b06-8bcc-daf839c234b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:29:35.178647 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855cb558-9675-4b06-8bcc-daf839c234b8 admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:29:35.193633 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede6d8c8-b8cd-4633-9552-245027972399 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:29:35.195200 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede6d8c8-b8cd-4633-9552-245027972399 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:29:35.195767 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede6d8c8-b8cd-4633-9552-245027972399 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:29:35.196449 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede6d8c8-b8cd-4633-9552-245027972399 admin admin] PATH_INFO: `/v3/projects/d76d0b531ca84c34b721f128c90419df` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:29:35.197847 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede6d8c8-b8cd-4633-9552-245027972399 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d76d0b531ca84c34b721f128c90419df)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:29:35.199066 dv-cinder-849143-14-smb devstack@keystone.service[81361]: WARNING py.warnings [None req-ede6d8c8-b8cd-4633-9552-245027972399 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 12 02:29:35.199066 dv-cinder-849143-14-smb devstack@keystone.service[81361]: warnings.warn(msg) Oct 12 02:29:35.199066 dv-cinder-849143-14-smb devstack@keystone.service[81361]: Oct 12 02:29:35.204526 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede6d8c8-b8cd-4633-9552-245027972399 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:29:35.290317 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:29:35.364396 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-ede6d8c8-b8cd-4633-9552-245027972399 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd76d0b531ca84c34b721f128c90419df', 'request_id': 'req-ede6d8c8-b8cd-4633-9552-245027972399'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:29:35.395380 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-ede6d8c8-b8cd-4633-9552-245027972399 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd76d0b531ca84c34b721f128c90419df', 'request_id': 'req-ede6d8c8-b8cd-4633-9552-245027972399'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:29:35.447507 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-ede6d8c8-b8cd-4633-9552-245027972399 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd76d0b531ca84c34b721f128c90419df', 'request_id': 'req-ede6d8c8-b8cd-4633-9552-245027972399'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:29:35.496065 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-ede6d8c8-b8cd-4633-9552-245027972399 admin admin] The token cache is being invalidate because project d76d0b531ca84c34b721f128c90419df was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81361) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 02:29:35.496065 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-ede6d8c8-b8cd-4633-9552-245027972399 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:29:35.496950 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-ede6d8c8-b8cd-4633-9552-245027972399 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:29:35.499252 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 667/1327] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Oct 12 02:29:34 2022] DELETE /identity/v3/projects/d76d0b531ca84c34b721f128c90419df => generated 0 bytes in 529 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 02:29:35.504992 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8f873c-b929-429f-b690-ce73431e1f26 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:29:35.505939 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8f873c-b929-429f-b690-ce73431e1f26 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:29:35.506394 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8f873c-b929-429f-b690-ce73431e1f26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:29:35.551329 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-7e8f873c-b929-429f-b690-ce73431e1f26 None None] MFA Rules not processed for user `a326a5bb7364479382f528a592371656`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:29:35.552611 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-7e8f873c-b929-429f-b690-ce73431e1f26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:29:35.778677 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 661/1328] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 02:29:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 02:29:35.787794 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e57a259-d9e9-4b43-b718-7ac44d495a56 None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:29:35.788081 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e57a259-d9e9-4b43-b718-7ac44d495a56 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:29:35.788361 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e57a259-d9e9-4b43-b718-7ac44d495a56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:29:35.842866 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-9e57a259-d9e9-4b43-b718-7ac44d495a56 None None] MFA Rules not processed for user `a326a5bb7364479382f528a592371656`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:29:35.848124 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-9e57a259-d9e9-4b43-b718-7ac44d495a56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:29:35.880926 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 668/1329] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 02:29:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 02:29:35.886089 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8f873c-b929-429f-b690-ce73431e1f26 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:29:35.892723 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:29:35.907016 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8f873c-b929-429f-b690-ce73431e1f26 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:29:35.923126 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ebf90d-02a3-45d4-952d-3bca9aee4244 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:29:35.925625 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ebf90d-02a3-45d4-952d-3bca9aee4244 admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:29:35.926559 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ebf90d-02a3-45d4-952d-3bca9aee4244 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:29:35.928503 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ebf90d-02a3-45d4-952d-3bca9aee4244 admin admin] PATH_INFO: `/v3/domains` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:29:35.929394 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ebf90d-02a3-45d4-952d-3bca9aee4244 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 02:29:35.932074 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ebf90d-02a3-45d4-952d-3bca9aee4244 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:29:35.939736 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ebf90d-02a3-45d4-952d-3bca9aee4244 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:29:35.984006 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 662/1330] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Oct 12 02:29:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 02:29:35.988822 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e57a259-d9e9-4b43-b718-7ac44d495a56 None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:29:36.009826 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e57a259-d9e9-4b43-b718-7ac44d495a56 None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:29:36.042789 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e5daca-a95c-4f50-8e8d-eba85e1b5774 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:29:36.043596 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e5daca-a95c-4f50-8e8d-eba85e1b5774 admin admin] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:29:36.043963 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e5daca-a95c-4f50-8e8d-eba85e1b5774 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:29:36.044621 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e5daca-a95c-4f50-8e8d-eba85e1b5774 admin admin] PATH_INFO: `/v3/projects` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:29:36.046708 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e5daca-a95c-4f50-8e8d-eba85e1b5774 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:29:36.054269 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e5daca-a95c-4f50-8e8d-eba85e1b5774 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:29:36.134525 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 669/1331] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Oct 12 02:29:35 2022] POST /identity/v3/projects => generated 383 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 02:29:36.139627 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ebf90d-02a3-45d4-952d-3bca9aee4244 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:29:36.157378 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ebf90d-02a3-45d4-952d-3bca9aee4244 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:29:36.338901 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c42a7b-faf1-48a4-b847-558839f4a5d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:29:36.339571 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c42a7b-faf1-48a4-b847-558839f4a5d8 admin admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:29:36.339851 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c42a7b-faf1-48a4-b847-558839f4a5d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:29:36.340126 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c42a7b-faf1-48a4-b847-558839f4a5d8 admin admin] PATH_INFO: `/v3/users` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:29:36.340824 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c42a7b-faf1-48a4-b847-558839f4a5d8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:29:36.342776 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c42a7b-faf1-48a4-b847-558839f4a5d8 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:29:36.420007 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 663/1332] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Oct 12 02:29:36 2022] POST /identity/v3/users => generated 292 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 02:29:36.425174 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e5daca-a95c-4f50-8e8d-eba85e1b5774 admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:29:36.461122 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e5daca-a95c-4f50-8e8d-eba85e1b5774 admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:29:36.495294 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcc3ca0-3965-442f-8a65-42af897e6714 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:29:36.499313 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcc3ca0-3965-442f-8a65-42af897e6714 admin admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:29:36.502630 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcc3ca0-3965-442f-8a65-42af897e6714 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:29:36.503164 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcc3ca0-3965-442f-8a65-42af897e6714 admin admin] PATH_INFO: `/v3/roles` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:29:36.507685 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bcc3ca0-3965-442f-8a65-42af897e6714 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:29:36.510404 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bcc3ca0-3965-442f-8a65-42af897e6714 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:29:36.560185 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 670/1333] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Oct 12 02:29:36 2022] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 02:29:36.561737 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c42a7b-faf1-48a4-b847-558839f4a5d8 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:29:36.582633 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c42a7b-faf1-48a4-b847-558839f4a5d8 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:29:36.599319 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20c5ce7-dc1e-476f-87f9-db2a63d55f74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:29:36.599960 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20c5ce7-dc1e-476f-87f9-db2a63d55f74 admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:29:36.600239 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20c5ce7-dc1e-476f-87f9-db2a63d55f74 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:29:36.607248 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20c5ce7-dc1e-476f-87f9-db2a63d55f74 admin admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:29:36.611500 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20c5ce7-dc1e-476f-87f9-db2a63d55f74 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:29:36.614658 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20c5ce7-dc1e-476f-87f9-db2a63d55f74 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:29:36.656879 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 664/1334] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Oct 12 02:29:36 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 02:29:36.660495 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcc3ca0-3965-442f-8a65-42af897e6714 admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:29:36.677519 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcc3ca0-3965-442f-8a65-42af897e6714 admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:29:36.691993 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778ff012-b072-4857-a7eb-2ac106185ec2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:29:36.692711 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778ff012-b072-4857-a7eb-2ac106185ec2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:29:36.692991 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778ff012-b072-4857-a7eb-2ac106185ec2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:29:36.693269 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778ff012-b072-4857-a7eb-2ac106185ec2 admin admin] PATH_INFO: `/v3/projects/36cd61ede65c4e3d961e169e1b2a2593/users/d452bfbc1cf840e7afcf17a4f31c9de0/roles/3d75c4d7f1a849b9a771504d1583ab28` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:29:36.751370 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778ff012-b072-4857-a7eb-2ac106185ec2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=36cd61ede65c4e3d961e169e1b2a2593, user_id=d452bfbc1cf840e7afcf17a4f31c9de0, role_id=3d75c4d7f1a849b9a771504d1583ab28)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:29:36.754480 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778ff012-b072-4857-a7eb-2ac106185ec2 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:29:36.809695 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 671/1335] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Oct 12 02:29:36 2022] PUT /identity/v3/projects/36cd61ede65c4e3d961e169e1b2a2593/users/d452bfbc1cf840e7afcf17a4f31c9de0/roles/3d75c4d7f1a849b9a771504d1583ab28 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 02:29:36.811013 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5179b2-7860-410e-a4ce-c2955b3b10db None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:29:36.811314 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5179b2-7860-410e-a4ce-c2955b3b10db None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:29:36.811742 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5179b2-7860-410e-a4ce-c2955b3b10db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:29:36.894497 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-fa5179b2-7860-410e-a4ce-c2955b3b10db None None] MFA Rules not processed for user `d452bfbc1cf840e7afcf17a4f31c9de0`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:29:36.897313 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-fa5179b2-7860-410e-a4ce-c2955b3b10db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:29:37.169041 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778ff012-b072-4857-a7eb-2ac106185ec2 admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:29:37.172398 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-778ff012-b072-4857-a7eb-2ac106185ec2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:29:37.220863 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 665/1336] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 02:29:36 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 411 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 02:29:37.240600 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5179b2-7860-410e-a4ce-c2955b3b10db None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:29:37.244644 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-fa5179b2-7860-410e-a4ce-c2955b3b10db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:29:37.403043 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778ff012-b072-4857-a7eb-2ac106185ec2 admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:29:37.421774 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a587d0e8-a35c-44be-943a-60c93d49feb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:29:37.422627 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a587d0e8-a35c-44be-943a-60c93d49feb5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:29:37.423062 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a587d0e8-a35c-44be-943a-60c93d49feb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:29:37.423423 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a587d0e8-a35c-44be-943a-60c93d49feb5 admin admin] PATH_INFO: `/v3/users/91a4e3a72b1947d7bf6f16e24e6fce14` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:29:37.430102 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a587d0e8-a35c-44be-943a-60c93d49feb5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=91a4e3a72b1947d7bf6f16e24e6fce14)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:29:37.432302 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a587d0e8-a35c-44be-943a-60c93d49feb5 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:29:37.549945 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5179b2-7860-410e-a4ce-c2955b3b10db None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:29:37.558675 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524fd009-a1f5-458e-88cf-462d085167ae service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ba688e0c4d44d13898539ee886f95fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'beb6def6fcad45959e56425bb8bff4d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:29:37.559271 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-a587d0e8-a35c-44be-943a-60c93d49feb5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '91a4e3a72b1947d7bf6f16e24e6fce14'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:29:37.560065 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524fd009-a1f5-458e-88cf-462d085167ae service cinder] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:29:37.560560 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524fd009-a1f5-458e-88cf-462d085167ae service cinder] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:29:37.563314 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524fd009-a1f5-458e-88cf-462d085167ae service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:29:37.592696 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-a587d0e8-a35c-44be-943a-60c93d49feb5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '91a4e3a72b1947d7bf6f16e24e6fce14'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:29:37.600000 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=83,keystone:DELETE=13,keystone:INSERT=4 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:29:37.618030 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524fd009-a1f5-458e-88cf-462d085167ae service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:29:37.622546 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524fd009-a1f5-458e-88cf-462d085167ae service cinder] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:29:37.643841 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:29:37.644625 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-a587d0e8-a35c-44be-943a-60c93d49feb5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '91a4e3a72b1947d7bf6f16e24e6fce14'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:29:37.662473 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 666/1337] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 02:29:37 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 422 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 02:29:37.689222 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-a587d0e8-a35c-44be-943a-60c93d49feb5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '91a4e3a72b1947d7bf6f16e24e6fce14'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:29:37.690020 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-a587d0e8-a35c-44be-943a-60c93d49feb5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '91a4e3a72b1947d7bf6f16e24e6fce14'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:29:37.706437 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 672/1338] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Oct 12 02:29:37 2022] DELETE /identity/v3/users/91a4e3a72b1947d7bf6f16e24e6fce14 => generated 0 bytes in 535 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 02:29:37.709264 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2990c06-ea58-43ef-9106-9aef20edfea8 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:29:37.709715 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2990c06-ea58-43ef-9106-9aef20edfea8 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:29:37.710167 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2990c06-ea58-43ef-9106-9aef20edfea8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:29:37.716336 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a587d0e8-a35c-44be-943a-60c93d49feb5 admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:29:37.721264 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-a587d0e8-a35c-44be-943a-60c93d49feb5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:29:37.750320 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-a2990c06-ea58-43ef-9106-9aef20edfea8 None None] MFA Rules not processed for user `a326a5bb7364479382f528a592371656`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:29:37.754428 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-a2990c06-ea58-43ef-9106-9aef20edfea8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:29:37.916692 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 667/1339] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 02:29:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 02:29:37.918213 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf734c5-b089-4e59-9234-42df9dd106e8 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:29:37.918787 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf734c5-b089-4e59-9234-42df9dd106e8 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:29:37.919088 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf734c5-b089-4e59-9234-42df9dd106e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:29:37.977792 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-baf734c5-b089-4e59-9234-42df9dd106e8 None None] MFA Rules not processed for user `961c8dd429784f79ae70fe961c9e4dcb`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:29:37.984075 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-baf734c5-b089-4e59-9234-42df9dd106e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:29:38.137998 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 668/1340] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 02:29:37 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 02:29:38.139462 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf734c5-b089-4e59-9234-42df9dd106e8 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:29:38.141556 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-baf734c5-b089-4e59-9234-42df9dd106e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:29:38.150790 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a587d0e8-a35c-44be-943a-60c93d49feb5 admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:29:38.168845 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b99c8e-f34e-47ab-ab34-c27508ec4486 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:29:38.169515 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b99c8e-f34e-47ab-ab34-c27508ec4486 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:29:38.170087 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b99c8e-f34e-47ab-ab34-c27508ec4486 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:29:38.170087 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b99c8e-f34e-47ab-ab34-c27508ec4486 admin admin] PATH_INFO: `/v3/users/d452bfbc1cf840e7afcf17a4f31c9de0` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:29:38.171683 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b99c8e-f34e-47ab-ab34-c27508ec4486 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d452bfbc1cf840e7afcf17a4f31c9de0)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:29:38.176031 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b99c8e-f34e-47ab-ab34-c27508ec4486 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:29:38.247277 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf734c5-b089-4e59-9234-42df9dd106e8 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:29:38.252907 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af31706e-ef62-4372-a70c-09cce9255d34 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5223b5cab3114e9b9a13c582f8ef8386', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'beb6def6fcad45959e56425bb8bff4d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:29:38.253669 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af31706e-ef62-4372-a70c-09cce9255d34 service neutron] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:29:38.254120 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af31706e-ef62-4372-a70c-09cce9255d34 service neutron] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:29:38.254649 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af31706e-ef62-4372-a70c-09cce9255d34 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:29:38.258844 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-36b99c8e-f34e-47ab-ab34-c27508ec4486 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd452bfbc1cf840e7afcf17a4f31c9de0'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:29:38.270090 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af31706e-ef62-4372-a70c-09cce9255d34 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:29:38.273783 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af31706e-ef62-4372-a70c-09cce9255d34 service neutron] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:29:38.276533 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-36b99c8e-f34e-47ab-ab34-c27508ec4486 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd452bfbc1cf840e7afcf17a4f31c9de0'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:29:38.295951 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-36b99c8e-f34e-47ab-ab34-c27508ec4486 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd452bfbc1cf840e7afcf17a4f31c9de0'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:29:38.306911 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 669/1341] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 02:29:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 02:29:38.319147 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-36b99c8e-f34e-47ab-ab34-c27508ec4486 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd452bfbc1cf840e7afcf17a4f31c9de0'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:29:38.321459 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-36b99c8e-f34e-47ab-ab34-c27508ec4486 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd452bfbc1cf840e7afcf17a4f31c9de0'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:29:38.323791 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af31706e-ef62-4372-a70c-09cce9255d34 service neutron] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:29:38.330164 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-af31706e-ef62-4372-a70c-09cce9255d34 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:29:38.339288 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 673/1342] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Oct 12 02:29:37 2022] DELETE /identity/v3/users/d452bfbc1cf840e7afcf17a4f31c9de0 => generated 0 bytes in 623 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 02:29:38.347538 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17b9bb6-0656-42d6-9891-285da840ebb2 None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:29:38.349262 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17b9bb6-0656-42d6-9891-285da840ebb2 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:29:38.350659 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17b9bb6-0656-42d6-9891-285da840ebb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:29:38.421123 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-e17b9bb6-0656-42d6-9891-285da840ebb2 None None] MFA Rules not processed for user `a326a5bb7364479382f528a592371656`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:29:38.422454 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-e17b9bb6-0656-42d6-9891-285da840ebb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:29:38.452588 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:29:38.542634 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af31706e-ef62-4372-a70c-09cce9255d34 service neutron] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:29:38.550318 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:29:38.596865 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 674/1343] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 02:29:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 02:29:38.664983 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17b9bb6-0656-42d6-9891-285da840ebb2 None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:29:38.668114 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-e17b9bb6-0656-42d6-9891-285da840ebb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:29:38.727200 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cef646d-2bed-4fc2-acfe-76ee14fbad36 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fca96c111b45b795fb757f77908ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'beb6def6fcad45959e56425bb8bff4d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:29:38.728985 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cef646d-2bed-4fc2-acfe-76ee14fbad36 service nova] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:29:38.729766 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cef646d-2bed-4fc2-acfe-76ee14fbad36 service nova] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:29:38.730257 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cef646d-2bed-4fc2-acfe-76ee14fbad36 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:29:38.734714 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-3cef646d-2bed-4fc2-acfe-76ee14fbad36 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:29:38.805087 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17b9bb6-0656-42d6-9891-285da840ebb2 None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:29:38.809037 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d0a3d4-eaee-460e-9788-58e7e14be12d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5223b5cab3114e9b9a13c582f8ef8386', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'beb6def6fcad45959e56425bb8bff4d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:29:38.809741 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d0a3d4-eaee-460e-9788-58e7e14be12d service neutron] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:29:38.809965 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d0a3d4-eaee-460e-9788-58e7e14be12d service neutron] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:29:38.810207 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d0a3d4-eaee-460e-9788-58e7e14be12d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:29:38.822885 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d0a3d4-eaee-460e-9788-58e7e14be12d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:29:38.824495 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d0a3d4-eaee-460e-9788-58e7e14be12d service neutron] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:29:38.849169 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 675/1344] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 02:29:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 02:29:38.887883 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cef646d-2bed-4fc2-acfe-76ee14fbad36 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:29:38.889548 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cef646d-2bed-4fc2-acfe-76ee14fbad36 service nova] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:29:38.901609 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 670/1345] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 02:29:38 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 594 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 02:29:39.553948 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d0a3d4-eaee-460e-9788-58e7e14be12d service neutron] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:29:39.557494 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-b3d0a3d4-eaee-460e-9788-58e7e14be12d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:29:39.591910 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d0a3d4-eaee-460e-9788-58e7e14be12d service neutron] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:29:39.625856 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449f44f0-275c-47f2-9d24-144299f54fe3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:29:39.626544 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449f44f0-275c-47f2-9d24-144299f54fe3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:29:39.626768 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449f44f0-275c-47f2-9d24-144299f54fe3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:29:39.627036 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449f44f0-275c-47f2-9d24-144299f54fe3 admin admin] PATH_INFO: `/v3/projects/6ef772a2e3634ebaa8869f4047ad8dd4` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:29:39.630951 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449f44f0-275c-47f2-9d24-144299f54fe3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6ef772a2e3634ebaa8869f4047ad8dd4)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:29:39.632946 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449f44f0-275c-47f2-9d24-144299f54fe3 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:29:39.760241 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-449f44f0-275c-47f2-9d24-144299f54fe3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6ef772a2e3634ebaa8869f4047ad8dd4', 'request_id': 'req-449f44f0-275c-47f2-9d24-144299f54fe3'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:29:39.777568 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-449f44f0-275c-47f2-9d24-144299f54fe3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6ef772a2e3634ebaa8869f4047ad8dd4', 'request_id': 'req-449f44f0-275c-47f2-9d24-144299f54fe3'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:29:39.797276 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-449f44f0-275c-47f2-9d24-144299f54fe3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6ef772a2e3634ebaa8869f4047ad8dd4', 'request_id': 'req-449f44f0-275c-47f2-9d24-144299f54fe3'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:29:39.826561 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-449f44f0-275c-47f2-9d24-144299f54fe3 admin admin] The token cache is being invalidate because project 6ef772a2e3634ebaa8869f4047ad8dd4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81361) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 02:29:39.826561 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-449f44f0-275c-47f2-9d24-144299f54fe3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:29:39.827375 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-449f44f0-275c-47f2-9d24-144299f54fe3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:29:39.833545 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 676/1346] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Oct 12 02:29:39 2022] DELETE /identity/v3/projects/6ef772a2e3634ebaa8869f4047ad8dd4 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 02:29:39.838105 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8acb31-c3c4-4e87-af54-98d373aff153 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:29:39.838915 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8acb31-c3c4-4e87-af54-98d373aff153 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:29:39.839379 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8acb31-c3c4-4e87-af54-98d373aff153 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:29:39.891004 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-5c8acb31-c3c4-4e87-af54-98d373aff153 None None] MFA Rules not processed for user `a326a5bb7364479382f528a592371656`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:29:39.895397 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449f44f0-275c-47f2-9d24-144299f54fe3 admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:29:39.896818 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-5c8acb31-c3c4-4e87-af54-98d373aff153 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:29:39.896962 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-449f44f0-275c-47f2-9d24-144299f54fe3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:29:40.055280 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 671/1347] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 02:29:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 02:29:40.056809 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f261d55-83ac-4068-8333-1d26736ce09e None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:29:40.057105 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f261d55-83ac-4068-8333-1d26736ce09e None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:29:40.057431 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f261d55-83ac-4068-8333-1d26736ce09e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:29:40.080079 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449f44f0-275c-47f2-9d24-144299f54fe3 admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:29:40.094824 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0bd7df-92b8-40f2-8dcd-b9c8a3eafdff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:29:40.095586 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0bd7df-92b8-40f2-8dcd-b9c8a3eafdff admin admin] REQUEST_METHOD: `DELETE` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:29:40.095893 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0bd7df-92b8-40f2-8dcd-b9c8a3eafdff admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:29:40.096089 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0bd7df-92b8-40f2-8dcd-b9c8a3eafdff admin admin] PATH_INFO: `/v3/projects/36cd61ede65c4e3d961e169e1b2a2593` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:29:40.110070 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0bd7df-92b8-40f2-8dcd-b9c8a3eafdff admin admin] RBAC: Authorizing `identity:delete_project(project_id=36cd61ede65c4e3d961e169e1b2a2593)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:29:40.110070 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0bd7df-92b8-40f2-8dcd-b9c8a3eafdff admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:29:40.110838 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-7f261d55-83ac-4068-8333-1d26736ce09e None None] MFA Rules not processed for user `a326a5bb7364479382f528a592371656`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:29:40.113911 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-7f261d55-83ac-4068-8333-1d26736ce09e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:29:40.128253 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 672/1348] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 02:29:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 02:29:40.129477 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f261d55-83ac-4068-8333-1d26736ce09e None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:29:40.136442 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:29:40.145383 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f261d55-83ac-4068-8333-1d26736ce09e None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:29:40.151753 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5849b87-d6f7-46f2-9ff7-81eccb34f161 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:29:40.152379 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5849b87-d6f7-46f2-9ff7-81eccb34f161 admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:29:40.153029 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5849b87-d6f7-46f2-9ff7-81eccb34f161 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:29:40.153147 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5849b87-d6f7-46f2-9ff7-81eccb34f161 admin admin] PATH_INFO: `/v3/domains` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:29:40.154203 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5849b87-d6f7-46f2-9ff7-81eccb34f161 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 02:29:40.154695 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5849b87-d6f7-46f2-9ff7-81eccb34f161 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:29:40.156736 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5849b87-d6f7-46f2-9ff7-81eccb34f161 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:29:40.162730 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:29:40.183675 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 673/1349] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Oct 12 02:29:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 02:29:40.185753 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5849b87-d6f7-46f2-9ff7-81eccb34f161 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:29:40.209034 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5849b87-d6f7-46f2-9ff7-81eccb34f161 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:29:40.228928 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-2d0bd7df-92b8-40f2-8dcd-b9c8a3eafdff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '36cd61ede65c4e3d961e169e1b2a2593', 'request_id': 'req-2d0bd7df-92b8-40f2-8dcd-b9c8a3eafdff'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:29:40.243177 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-2d0bd7df-92b8-40f2-8dcd-b9c8a3eafdff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '36cd61ede65c4e3d961e169e1b2a2593', 'request_id': 'req-2d0bd7df-92b8-40f2-8dcd-b9c8a3eafdff'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:29:40.262966 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-2d0bd7df-92b8-40f2-8dcd-b9c8a3eafdff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '36cd61ede65c4e3d961e169e1b2a2593', 'request_id': 'req-2d0bd7df-92b8-40f2-8dcd-b9c8a3eafdff'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:29:40.286034 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-2d0bd7df-92b8-40f2-8dcd-b9c8a3eafdff admin admin] The token cache is being invalidate because project 36cd61ede65c4e3d961e169e1b2a2593 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81361) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 02:29:40.286638 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-2d0bd7df-92b8-40f2-8dcd-b9c8a3eafdff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:29:40.288757 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-2d0bd7df-92b8-40f2-8dcd-b9c8a3eafdff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:29:40.290597 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 677/1350] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Oct 12 02:29:39 2022] DELETE /identity/v3/projects/36cd61ede65c4e3d961e169e1b2a2593 => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 02:29:40.292002 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f257466b-2d06-4ce2-9818-20a5ad5e5bdd None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:29:40.293008 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f257466b-2d06-4ce2-9818-20a5ad5e5bdd None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:29:40.293441 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f257466b-2d06-4ce2-9818-20a5ad5e5bdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:29:40.305943 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fd9cee-bfff-4102-a441-eb447a4d5d3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:29:40.312428 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fd9cee-bfff-4102-a441-eb447a4d5d3d admin admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:29:40.312952 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fd9cee-bfff-4102-a441-eb447a4d5d3d admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:29:40.313581 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fd9cee-bfff-4102-a441-eb447a4d5d3d admin admin] PATH_INFO: `/v3/projects` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:29:40.314968 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9fd9cee-bfff-4102-a441-eb447a4d5d3d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:29:40.318269 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9fd9cee-bfff-4102-a441-eb447a4d5d3d admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:29:40.366750 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 674/1351] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Oct 12 02:29:40 2022] POST /identity/v3/projects => generated 405 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 02:29:40.366750 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01147a7-0158-4cca-8622-a7dcd034c767 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:29:40.366750 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01147a7-0158-4cca-8622-a7dcd034c767 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:29:40.367471 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01147a7-0158-4cca-8622-a7dcd034c767 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:29:40.368621 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-f257466b-2d06-4ce2-9818-20a5ad5e5bdd None None] MFA Rules not processed for user `e5a8c753a1c54dddaac24b5faaaf197a`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:29:40.373252 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-f257466b-2d06-4ce2-9818-20a5ad5e5bdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:29:40.395000 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-c01147a7-0158-4cca-8622-a7dcd034c767 None None] MFA Rules not processed for user `a326a5bb7364479382f528a592371656`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:29:40.396891 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-c01147a7-0158-4cca-8622-a7dcd034c767 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:29:40.546138 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 678/1352] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 02:29:40 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 02:29:40.547141 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f257466b-2d06-4ce2-9818-20a5ad5e5bdd None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:29:40.548611 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-f257466b-2d06-4ce2-9818-20a5ad5e5bdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:29:40.559166 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 675/1353] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 02:29:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 02:29:40.568779 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575746cd-a69e-4cf4-a582-5e8595d211ae None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:29:40.569199 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575746cd-a69e-4cf4-a582-5e8595d211ae None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:29:40.569483 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575746cd-a69e-4cf4-a582-5e8595d211ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:29:40.576808 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f257466b-2d06-4ce2-9818-20a5ad5e5bdd None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:29:40.589354 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27c7f95-5654-4c73-86ec-a513c5005022 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:29:40.591258 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27c7f95-5654-4c73-86ec-a513c5005022 admin admin] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:29:40.591737 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27c7f95-5654-4c73-86ec-a513c5005022 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:29:40.592932 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27c7f95-5654-4c73-86ec-a513c5005022 admin admin] PATH_INFO: `/v3/users` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:29:40.595406 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27c7f95-5654-4c73-86ec-a513c5005022 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:29:40.599111 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-575746cd-a69e-4cf4-a582-5e8595d211ae None None] MFA Rules not processed for user `e5a8c753a1c54dddaac24b5faaaf197a`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:29:40.599738 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27c7f95-5654-4c73-86ec-a513c5005022 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:29:40.600417 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-575746cd-a69e-4cf4-a582-5e8595d211ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:29:40.614267 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 676/1354] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 02:29:40 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 02:29:40.614267 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026ca52d-aa84-48da-b3d2-1cdf0915796c None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:29:40.614267 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026ca52d-aa84-48da-b3d2-1cdf0915796c None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:29:40.614267 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026ca52d-aa84-48da-b3d2-1cdf0915796c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:29:40.640039 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-026ca52d-aa84-48da-b3d2-1cdf0915796c None None] MFA Rules not processed for user `a326a5bb7364479382f528a592371656`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:29:40.642372 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-026ca52d-aa84-48da-b3d2-1cdf0915796c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:29:40.650732 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 679/1355] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Oct 12 02:29:40 2022] POST /identity/v3/users => generated 303 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 02:29:40.652090 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27c7f95-5654-4c73-86ec-a513c5005022 admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:29:40.655276 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 677/1356] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 02:29:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 02:29:40.660339 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026ca52d-aa84-48da-b3d2-1cdf0915796c None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:29:40.668098 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-e27c7f95-5654-4c73-86ec-a513c5005022 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:29:40.689841 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026ca52d-aa84-48da-b3d2-1cdf0915796c None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:29:40.705015 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f7c322-fe1c-4ec5-9a9c-c230b4ac57b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:29:40.706057 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f7c322-fe1c-4ec5-9a9c-c230b4ac57b5 admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:29:40.706410 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f7c322-fe1c-4ec5-9a9c-c230b4ac57b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:29:40.706687 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f7c322-fe1c-4ec5-9a9c-c230b4ac57b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:29:40.707909 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f7c322-fe1c-4ec5-9a9c-c230b4ac57b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:29:40.709109 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f7c322-fe1c-4ec5-9a9c-c230b4ac57b5 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:29:40.729237 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 678/1357] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Oct 12 02:29:40 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 02:29:40.732888 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f7c322-fe1c-4ec5-9a9c-c230b4ac57b5 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:29:40.754734 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f7c322-fe1c-4ec5-9a9c-c230b4ac57b5 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:29:40.768498 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9f4df7-1607-40fe-9fdb-d5ea5f89aa5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:29:40.769644 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9f4df7-1607-40fe-9fdb-d5ea5f89aa5a admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:29:40.769644 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9f4df7-1607-40fe-9fdb-d5ea5f89aa5a admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:29:40.769644 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9f4df7-1607-40fe-9fdb-d5ea5f89aa5a admin admin] PATH_INFO: `/v3/domains` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:29:40.770553 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9f4df7-1607-40fe-9fdb-d5ea5f89aa5a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 02:29:40.770818 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9f4df7-1607-40fe-9fdb-d5ea5f89aa5a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:29:40.774397 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9f4df7-1607-40fe-9fdb-d5ea5f89aa5a admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:29:40.802593 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 679/1358] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Oct 12 02:29:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 02:29:40.803363 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9f4df7-1607-40fe-9fdb-d5ea5f89aa5a admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:29:40.826453 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9f4df7-1607-40fe-9fdb-d5ea5f89aa5a admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:29:40.832600 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27c7f95-5654-4c73-86ec-a513c5005022 admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:29:40.842290 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acf089f-fedf-4abb-8d92-8c736142be3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:29:40.842929 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acf089f-fedf-4abb-8d92-8c736142be3f admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:29:40.843215 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acf089f-fedf-4abb-8d92-8c736142be3f admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:29:40.843549 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acf089f-fedf-4abb-8d92-8c736142be3f admin admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:29:40.844429 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5acf089f-fedf-4abb-8d92-8c736142be3f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:29:40.845903 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5acf089f-fedf-4abb-8d92-8c736142be3f admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:29:40.850293 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe99230-262e-498f-b35e-04299061469f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fca96c111b45b795fb757f77908ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'beb6def6fcad45959e56425bb8bff4d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:29:40.850864 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe99230-262e-498f-b35e-04299061469f service nova] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:29:40.851142 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe99230-262e-498f-b35e-04299061469f service nova] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:29:40.851414 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe99230-262e-498f-b35e-04299061469f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:29:40.863016 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 680/1359] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Oct 12 02:29:40 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 02:29:40.866627 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acf089f-fedf-4abb-8d92-8c736142be3f admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:29:40.878866 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe99230-262e-498f-b35e-04299061469f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:29:40.880670 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe99230-262e-498f-b35e-04299061469f service nova] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:29:40.899402 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acf089f-fedf-4abb-8d92-8c736142be3f admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:29:40.902348 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 680/1360] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 02:29:40 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 251 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 02:29:40.903012 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe99230-262e-498f-b35e-04299061469f service nova] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:29:40.909626 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297bfba3-545c-4e9f-bfc4-076cd5a0ea55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:29:40.910256 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297bfba3-545c-4e9f-bfc4-076cd5a0ea55 admin admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:29:40.910538 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297bfba3-545c-4e9f-bfc4-076cd5a0ea55 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:29:40.910811 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297bfba3-545c-4e9f-bfc4-076cd5a0ea55 admin admin] PATH_INFO: `/v3/projects` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:29:40.911515 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297bfba3-545c-4e9f-bfc4-076cd5a0ea55 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:29:40.913374 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297bfba3-545c-4e9f-bfc4-076cd5a0ea55 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:29:40.931480 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe99230-262e-498f-b35e-04299061469f service nova] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:29:40.944298 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3dd122-e50a-4bc1-a554-72197b3a881d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:29:40.945039 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3dd122-e50a-4bc1-a554-72197b3a881d admin admin] REQUEST_METHOD: `PUT` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:29:40.945318 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3dd122-e50a-4bc1-a554-72197b3a881d admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:29:40.945674 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3dd122-e50a-4bc1-a554-72197b3a881d admin admin] PATH_INFO: `/v3/projects/2d2d5e2fb2cd4180a7c9fa9474e73507/users/9724334a118b4eea9465ae03f1675cc7/roles/3d75c4d7f1a849b9a771504d1583ab28` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:29:40.953898 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:29:40.974467 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 681/1361] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Oct 12 02:29:40 2022] POST /identity/v3/projects => generated 385 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 02:29:40.982730 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297bfba3-545c-4e9f-bfc4-076cd5a0ea55 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:29:40.990684 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:29:40.998472 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3dd122-e50a-4bc1-a554-72197b3a881d admin admin] RBAC: Authorizing `identity:create_grant(project_id=2d2d5e2fb2cd4180a7c9fa9474e73507, user_id=9724334a118b4eea9465ae03f1675cc7, role_id=3d75c4d7f1a849b9a771504d1583ab28)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:29:41.010979 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3dd122-e50a-4bc1-a554-72197b3a881d admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:29:41.061604 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 681/1362] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Oct 12 02:29:40 2022] PUT /identity/v3/projects/2d2d5e2fb2cd4180a7c9fa9474e73507/users/9724334a118b4eea9465ae03f1675cc7/roles/3d75c4d7f1a849b9a771504d1583ab28 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 02:29:41.063508 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3284022c-9098-42e1-96d4-f3b4e4fd0cef None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:29:41.063804 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3284022c-9098-42e1-96d4-f3b4e4fd0cef None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:29:41.064081 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3284022c-9098-42e1-96d4-f3b4e4fd0cef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:29:41.132306 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297bfba3-545c-4e9f-bfc4-076cd5a0ea55 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:29:41.138576 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-3284022c-9098-42e1-96d4-f3b4e4fd0cef None None] MFA Rules not processed for user `9724334a118b4eea9465ae03f1675cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:29:41.139864 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-3284022c-9098-42e1-96d4-f3b4e4fd0cef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:29:41.322104 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d068b38-6077-4a90-a420-af0e6f8104ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:29:41.323751 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d068b38-6077-4a90-a420-af0e6f8104ce admin admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:29:41.325165 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d068b38-6077-4a90-a420-af0e6f8104ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:29:41.326176 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d068b38-6077-4a90-a420-af0e6f8104ce admin admin] PATH_INFO: `/v3/users` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:29:41.329568 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d068b38-6077-4a90-a420-af0e6f8104ce admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:29:41.339653 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 682/1363] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 02:29:41 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 277 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 02:29:41.339836 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d068b38-6077-4a90-a420-af0e6f8104ce admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:29:41.340717 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3284022c-9098-42e1-96d4-f3b4e4fd0cef None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:29:41.347268 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-3284022c-9098-42e1-96d4-f3b4e4fd0cef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:29:41.382297 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3284022c-9098-42e1-96d4-f3b4e4fd0cef None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:29:41.388502 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 682/1364] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Oct 12 02:29:40 2022] POST /identity/v3/users => generated 293 bytes in 406 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 02:29:41.390016 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d068b38-6077-4a90-a420-af0e6f8104ce admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:29:41.400071 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683ccbcb-fd8a-45db-b876-4e36b55cc781 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:29:41.401088 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683ccbcb-fd8a-45db-b876-4e36b55cc781 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:29:41.401429 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683ccbcb-fd8a-45db-b876-4e36b55cc781 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:29:41.401912 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683ccbcb-fd8a-45db-b876-4e36b55cc781 admin admin] PATH_INFO: `/v3/users/3ded765f2c0f4389ad874d786f1c752c` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:29:41.404002 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683ccbcb-fd8a-45db-b876-4e36b55cc781 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3ded765f2c0f4389ad874d786f1c752c)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:29:41.409166 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683ccbcb-fd8a-45db-b876-4e36b55cc781 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:29:41.418239 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d068b38-6077-4a90-a420-af0e6f8104ce admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:29:41.433562 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ed87bf-7b29-45ff-8f78-f0442166a064 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:29:41.436952 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ed87bf-7b29-45ff-8f78-f0442166a064 admin admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:29:41.437759 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ed87bf-7b29-45ff-8f78-f0442166a064 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:29:41.438032 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ed87bf-7b29-45ff-8f78-f0442166a064 admin admin] PATH_INFO: `/v3/projects` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:29:41.438724 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ed87bf-7b29-45ff-8f78-f0442166a064 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:29:41.446105 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ed87bf-7b29-45ff-8f78-f0442166a064 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:29:41.557567 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 683/1365] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Oct 12 02:29:41 2022] POST /identity/v3/projects => generated 403 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 02:29:41.558542 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ed87bf-7b29-45ff-8f78-f0442166a064 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:29:41.560639 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-683ccbcb-fd8a-45db-b876-4e36b55cc781 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3ded765f2c0f4389ad874d786f1c752c'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:29:41.588600 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-683ccbcb-fd8a-45db-b876-4e36b55cc781 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3ded765f2c0f4389ad874d786f1c752c'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:29:41.610625 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-683ccbcb-fd8a-45db-b876-4e36b55cc781 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3ded765f2c0f4389ad874d786f1c752c'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:29:41.633470 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-683ccbcb-fd8a-45db-b876-4e36b55cc781 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3ded765f2c0f4389ad874d786f1c752c'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:29:41.635867 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-683ccbcb-fd8a-45db-b876-4e36b55cc781 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3ded765f2c0f4389ad874d786f1c752c'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:29:41.650975 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 683/1366] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Oct 12 02:29:41 2022] DELETE /identity/v3/users/3ded765f2c0f4389ad874d786f1c752c => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 02:29:41.651808 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683ccbcb-fd8a-45db-b876-4e36b55cc781 admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:29:41.655353 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-683ccbcb-fd8a-45db-b876-4e36b55cc781 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:29:41.672703 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ed87bf-7b29-45ff-8f78-f0442166a064 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:29:41.724484 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:29:41.761772 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:29:41.821425 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e433b24a-b226-4fda-9cd6-1aaf2edecd42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:29:41.822310 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e433b24a-b226-4fda-9cd6-1aaf2edecd42 admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:29:41.822720 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e433b24a-b226-4fda-9cd6-1aaf2edecd42 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:29:41.823109 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e433b24a-b226-4fda-9cd6-1aaf2edecd42 admin admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:29:41.823934 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e433b24a-b226-4fda-9cd6-1aaf2edecd42 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:29:41.825862 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e433b24a-b226-4fda-9cd6-1aaf2edecd42 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:29:41.831619 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683ccbcb-fd8a-45db-b876-4e36b55cc781 admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:29:41.838302 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a3c850-0234-4218-8b9e-c54f9c4544e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:29:41.838936 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a3c850-0234-4218-8b9e-c54f9c4544e0 admin admin] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:29:41.839217 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a3c850-0234-4218-8b9e-c54f9c4544e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:29:41.839492 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a3c850-0234-4218-8b9e-c54f9c4544e0 admin admin] PATH_INFO: `/v3/users` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:29:41.840131 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a3c850-0234-4218-8b9e-c54f9c4544e0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:29:41.842132 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a3c850-0234-4218-8b9e-c54f9c4544e0 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:29:41.848457 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 684/1367] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Oct 12 02:29:41 2022] GET /identity/v3/roles => generated 1420 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 02:29:41.850019 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc60ba16-c8bc-4650-a5d3-56dfc6d62169 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:29:41.850428 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc60ba16-c8bc-4650-a5d3-56dfc6d62169 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:29:41.850810 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc60ba16-c8bc-4650-a5d3-56dfc6d62169 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:29:41.893708 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-fc60ba16-c8bc-4650-a5d3-56dfc6d62169 None None] MFA Rules not processed for user `a326a5bb7364479382f528a592371656`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:29:41.903131 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-fc60ba16-c8bc-4650-a5d3-56dfc6d62169 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:29:41.905178 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 684/1368] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Oct 12 02:29:41 2022] POST /identity/v3/users => generated 308 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 02:29:41.906782 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a3c850-0234-4218-8b9e-c54f9c4544e0 admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:29:41.914664 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-b3a3c850-0234-4218-8b9e-c54f9c4544e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:29:41.930361 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 685/1369] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 02:29:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 02:29:41.934668 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc60ba16-c8bc-4650-a5d3-56dfc6d62169 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:29:41.945052 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a3c850-0234-4218-8b9e-c54f9c4544e0 admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:29:41.958936 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d3eb3c-eee3-4c97-9074-87b1c4e9b7c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:29:41.959833 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d3eb3c-eee3-4c97-9074-87b1c4e9b7c9 admin admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:29:41.960220 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d3eb3c-eee3-4c97-9074-87b1c4e9b7c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:29:41.960634 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d3eb3c-eee3-4c97-9074-87b1c4e9b7c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:29:41.961405 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d3eb3c-eee3-4c97-9074-87b1c4e9b7c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:29:41.963275 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc60ba16-c8bc-4650-a5d3-56dfc6d62169 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:29:41.969960 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d3eb3c-eee3-4c97-9074-87b1c4e9b7c9 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:29:41.975162 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7215eb88-86fb-4924-a3cb-0b7846982514 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:29:41.978227 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7215eb88-86fb-4924-a3cb-0b7846982514 admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:29:41.979556 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7215eb88-86fb-4924-a3cb-0b7846982514 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:29:41.981112 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7215eb88-86fb-4924-a3cb-0b7846982514 admin admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:29:41.982293 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7215eb88-86fb-4924-a3cb-0b7846982514 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:29:41.988756 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7215eb88-86fb-4924-a3cb-0b7846982514 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:29:41.991011 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 685/1370] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Oct 12 02:29:41 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 02:29:41.992117 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d3eb3c-eee3-4c97-9074-87b1c4e9b7c9 admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:29:41.996513 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-b8d3eb3c-eee3-4c97-9074-87b1c4e9b7c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:29:42.028488 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 686/1371] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Oct 12 02:29:41 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 02:29:42.030324 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7215eb88-86fb-4924-a3cb-0b7846982514 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:29:42.065774 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7215eb88-86fb-4924-a3cb-0b7846982514 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:29:42.089390 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c484b0b4-4580-4418-8150-bb579c3db9b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:29:42.090189 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c484b0b4-4580-4418-8150-bb579c3db9b2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:29:42.090601 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c484b0b4-4580-4418-8150-bb579c3db9b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:29:42.091003 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c484b0b4-4580-4418-8150-bb579c3db9b2 admin admin] PATH_INFO: `/v3/projects/79c50e2493504ba6a18a3ad52e711a6a/users/3c1e10b0dc9a4f65a25ee5ae37d657d3/roles/3d75c4d7f1a849b9a771504d1583ab28` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:29:42.169557 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c484b0b4-4580-4418-8150-bb579c3db9b2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=79c50e2493504ba6a18a3ad52e711a6a, user_id=3c1e10b0dc9a4f65a25ee5ae37d657d3, role_id=3d75c4d7f1a849b9a771504d1583ab28)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:29:42.172855 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c484b0b4-4580-4418-8150-bb579c3db9b2 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:29:42.205001 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 687/1372] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Oct 12 02:29:42 2022] PUT /identity/v3/projects/79c50e2493504ba6a18a3ad52e711a6a/users/3c1e10b0dc9a4f65a25ee5ae37d657d3/roles/3d75c4d7f1a849b9a771504d1583ab28 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 02:29:42.206143 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c484b0b4-4580-4418-8150-bb579c3db9b2 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:29:42.224989 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d3eb3c-eee3-4c97-9074-87b1c4e9b7c9 admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:29:42.367931 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dae015e-6337-45b3-b242-e8dca664b1e6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5223b5cab3114e9b9a13c582f8ef8386', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'beb6def6fcad45959e56425bb8bff4d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:29:42.368784 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dae015e-6337-45b3-b242-e8dca664b1e6 service neutron] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:29:42.369062 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dae015e-6337-45b3-b242-e8dca664b1e6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:29:42.369333 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dae015e-6337-45b3-b242-e8dca664b1e6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:29:42.401142 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dae015e-6337-45b3-b242-e8dca664b1e6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:29:42.402680 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c484b0b4-4580-4418-8150-bb579c3db9b2 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:29:42.403348 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dae015e-6337-45b3-b242-e8dca664b1e6 service neutron] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:29:42.427912 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 686/1373] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 02:29:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 436 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 02:29:42.429883 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2790a5-4bb8-4c1e-b76e-57f0a48e5adb None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:29:42.430168 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2790a5-4bb8-4c1e-b76e-57f0a48e5adb None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:29:42.430439 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2790a5-4bb8-4c1e-b76e-57f0a48e5adb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:29:42.430877 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8388fa2b-5cc0-4081-b5ba-2ab884ee459a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:29:42.432738 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8388fa2b-5cc0-4081-b5ba-2ab884ee459a admin admin] REQUEST_METHOD: `PUT` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:29:42.433157 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8388fa2b-5cc0-4081-b5ba-2ab884ee459a admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:29:42.434448 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8388fa2b-5cc0-4081-b5ba-2ab884ee459a admin admin] PATH_INFO: `/v3/projects/e8580df2123a4457abf531233b049125/users/1eaa99c727704de89c0b5b35f20a4f0b/roles/39b1e8108dff402383def3c559f48189` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:29:42.495180 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8388fa2b-5cc0-4081-b5ba-2ab884ee459a admin admin] RBAC: Authorizing `identity:create_grant(project_id=e8580df2123a4457abf531233b049125, user_id=1eaa99c727704de89c0b5b35f20a4f0b, role_id=39b1e8108dff402383def3c559f48189)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:29:42.505924 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8388fa2b-5cc0-4081-b5ba-2ab884ee459a admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:29:42.516948 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-7f2790a5-4bb8-4c1e-b76e-57f0a48e5adb None None] MFA Rules not processed for user `3c1e10b0dc9a4f65a25ee5ae37d657d3`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:29:42.522183 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-7f2790a5-4bb8-4c1e-b76e-57f0a48e5adb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:29:42.557681 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 688/1374] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Oct 12 02:29:42 2022] PUT /identity/v3/projects/e8580df2123a4457abf531233b049125/users/1eaa99c727704de89c0b5b35f20a4f0b/roles/39b1e8108dff402383def3c559f48189 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 02:29:42.564849 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8388fa2b-5cc0-4081-b5ba-2ab884ee459a admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:29:42.698194 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8388fa2b-5cc0-4081-b5ba-2ab884ee459a admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:29:42.706361 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ab2132-85b6-4f0a-b4bb-9c9cc740fb59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:29:42.707733 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ab2132-85b6-4f0a-b4bb-9c9cc740fb59 admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:29:42.708021 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ab2132-85b6-4f0a-b4bb-9c9cc740fb59 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:29:42.708422 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ab2132-85b6-4f0a-b4bb-9c9cc740fb59 admin admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:29:42.709818 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ab2132-85b6-4f0a-b4bb-9c9cc740fb59 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:29:42.712925 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ab2132-85b6-4f0a-b4bb-9c9cc740fb59 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:29:42.723778 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:29:42.741063 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 689/1375] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Oct 12 02:29:42 2022] GET /identity/v3/roles => generated 1420 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 02:29:42.742958 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97d466c-23a6-489d-848a-8cab931b0887 None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:29:42.743256 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97d466c-23a6-489d-848a-8cab931b0887 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:29:42.743544 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97d466c-23a6-489d-848a-8cab931b0887 None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:29:42.745689 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 690/1376] 10.222.0.18 () {54 vars in 912 bytes} [Wed Oct 12 02:29:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 02:29:42.753917 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97d466c-23a6-489d-848a-8cab931b0887 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:29:42.778502 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 687/1377] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 02:29:42 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 350 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 02:29:42.779815 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f581c15b-df83-4205-8bb0-98d7aae7765e None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:29:42.780104 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f581c15b-df83-4205-8bb0-98d7aae7765e None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:29:42.780380 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f581c15b-df83-4205-8bb0-98d7aae7765e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:29:42.795552 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97d466c-23a6-489d-848a-8cab931b0887 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:29:42.823758 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b9d6c9-396b-4292-ad97-f6d6a9f1103c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:29:42.827960 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b9d6c9-396b-4292-ad97-f6d6a9f1103c admin admin] REQUEST_METHOD: `PUT` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:29:42.828264 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b9d6c9-396b-4292-ad97-f6d6a9f1103c admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:29:42.828604 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b9d6c9-396b-4292-ad97-f6d6a9f1103c admin admin] PATH_INFO: `/v3/projects/e8580df2123a4457abf531233b049125/users/1eaa99c727704de89c0b5b35f20a4f0b/roles/39b1e8108dff402383def3c559f48189` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:29:42.832988 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b9d6c9-396b-4292-ad97-f6d6a9f1103c admin admin] RBAC: Authorizing `identity:create_grant(project_id=e8580df2123a4457abf531233b049125, user_id=1eaa99c727704de89c0b5b35f20a4f0b, role_id=39b1e8108dff402383def3c559f48189)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:29:42.842988 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:29:42.857660 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b9d6c9-396b-4292-ad97-f6d6a9f1103c admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:29:42.896539 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 691/1378] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Oct 12 02:29:42 2022] PUT /identity/v3/projects/e8580df2123a4457abf531233b049125/users/1eaa99c727704de89c0b5b35f20a4f0b/roles/39b1e8108dff402383def3c559f48189 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 02:29:42.899161 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b9d6c9-396b-4292-ad97-f6d6a9f1103c admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:29:42.905409 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-04b9d6c9-396b-4292-ad97-f6d6a9f1103c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:29:42.926102 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-f581c15b-df83-4205-8bb0-98d7aae7765e None None] MFA Rules not processed for user `5223b5cab3114e9b9a13c582f8ef8386`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:29:42.927404 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-f581c15b-df83-4205-8bb0-98d7aae7765e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:29:43.082805 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 688/1379] 10.222.0.18 () {58 vars in 1009 bytes} [Wed Oct 12 02:29:42 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 304 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 02:29:43.084044 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2fcfd2-cded-4037-a71a-8d51d11ec16e None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:29:43.084330 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2fcfd2-cded-4037-a71a-8d51d11ec16e None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:29:43.084625 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2fcfd2-cded-4037-a71a-8d51d11ec16e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:29:43.122383 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b9d6c9-396b-4292-ad97-f6d6a9f1103c admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:29:43.126736 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3eff447-9160-4aaa-be2e-6d35413d9d6f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ba688e0c4d44d13898539ee886f95fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'beb6def6fcad45959e56425bb8bff4d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:29:43.127547 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3eff447-9160-4aaa-be2e-6d35413d9d6f service cinder] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:29:43.127940 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3eff447-9160-4aaa-be2e-6d35413d9d6f service cinder] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:29:43.128329 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3eff447-9160-4aaa-be2e-6d35413d9d6f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:29:43.200515 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-db2fcfd2-cded-4037-a71a-8d51d11ec16e None None] MFA Rules not processed for user `1eaa99c727704de89c0b5b35f20a4f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:29:43.206513 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-db2fcfd2-cded-4037-a71a-8d51d11ec16e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:29:43.272990 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3eff447-9160-4aaa-be2e-6d35413d9d6f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:29:43.274634 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3eff447-9160-4aaa-be2e-6d35413d9d6f service cinder] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:29:43.298358 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 692/1380] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 02:29:42 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 02:29:43.301266 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3eff447-9160-4aaa-be2e-6d35413d9d6f service cinder] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:29:43.343211 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3eff447-9160-4aaa-be2e-6d35413d9d6f service cinder] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:29:43.353358 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0270e1cb-7423-427d-a2cb-a2076978af10 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5223b5cab3114e9b9a13c582f8ef8386', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'beb6def6fcad45959e56425bb8bff4d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:29:43.354754 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0270e1cb-7423-427d-a2cb-a2076978af10 service neutron] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:29:43.356927 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0270e1cb-7423-427d-a2cb-a2076978af10 service neutron] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:29:43.357335 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0270e1cb-7423-427d-a2cb-a2076978af10 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:29:43.378558 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0270e1cb-7423-427d-a2cb-a2076978af10 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:29:43.380334 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0270e1cb-7423-427d-a2cb-a2076978af10 service neutron] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:29:43.401039 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 693/1381] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 02:29:43 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 02:29:43.460361 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 689/1382] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 02:29:43 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 377 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 02:29:43.472546 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0270e1cb-7423-427d-a2cb-a2076978af10 service neutron] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:29:43.474208 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-0270e1cb-7423-427d-a2cb-a2076978af10 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:29:43.494186 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0270e1cb-7423-427d-a2cb-a2076978af10 service neutron] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:29:43.509355 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d85c3cd-11c4-46cb-b2dd-c29a805b8a9d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ba688e0c4d44d13898539ee886f95fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'beb6def6fcad45959e56425bb8bff4d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:29:43.511305 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d85c3cd-11c4-46cb-b2dd-c29a805b8a9d service cinder] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:29:43.513398 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d85c3cd-11c4-46cb-b2dd-c29a805b8a9d service cinder] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:29:43.513798 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d85c3cd-11c4-46cb-b2dd-c29a805b8a9d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:29:43.546588 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d85c3cd-11c4-46cb-b2dd-c29a805b8a9d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:29:43.550364 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d85c3cd-11c4-46cb-b2dd-c29a805b8a9d service cinder] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:29:43.589935 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 694/1383] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 02:29:43 2022] GET /identity/v3/auth/tokens => generated 3347 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 02:29:43.904754 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2fcfd2-cded-4037-a71a-8d51d11ec16e None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:29:44.174665 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2fcfd2-cded-4037-a71a-8d51d11ec16e None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:29:44.201638 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61eb55b-0d67-4ddd-8c75-a2b5b5775ce3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:29:44.202303 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61eb55b-0d67-4ddd-8c75-a2b5b5775ce3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:29:44.202581 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61eb55b-0d67-4ddd-8c75-a2b5b5775ce3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:29:44.203409 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61eb55b-0d67-4ddd-8c75-a2b5b5775ce3 admin admin] PATH_INFO: `/v3/users/9724334a118b4eea9465ae03f1675cc7` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:29:44.210720 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61eb55b-0d67-4ddd-8c75-a2b5b5775ce3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9724334a118b4eea9465ae03f1675cc7)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:29:44.213874 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61eb55b-0d67-4ddd-8c75-a2b5b5775ce3 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:29:44.328752 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:29:44.390384 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-b61eb55b-0d67-4ddd-8c75-a2b5b5775ce3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9724334a118b4eea9465ae03f1675cc7'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:29:44.417087 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-b61eb55b-0d67-4ddd-8c75-a2b5b5775ce3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9724334a118b4eea9465ae03f1675cc7'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:29:44.453685 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-b61eb55b-0d67-4ddd-8c75-a2b5b5775ce3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9724334a118b4eea9465ae03f1675cc7'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:29:44.476996 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-b61eb55b-0d67-4ddd-8c75-a2b5b5775ce3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9724334a118b4eea9465ae03f1675cc7'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:29:44.480499 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-b61eb55b-0d67-4ddd-8c75-a2b5b5775ce3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9724334a118b4eea9465ae03f1675cc7'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:29:44.497160 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 690/1384] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Oct 12 02:29:43 2022] DELETE /identity/v3/users/9724334a118b4eea9465ae03f1675cc7 => generated 0 bytes in 589 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 02:29:44.498286 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dab394b-dedf-4683-96f0-7300995df267 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:29:44.498717 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dab394b-dedf-4683-96f0-7300995df267 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:29:44.498886 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dab394b-dedf-4683-96f0-7300995df267 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:29:44.544222 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-7dab394b-dedf-4683-96f0-7300995df267 None None] MFA Rules not processed for user `a326a5bb7364479382f528a592371656`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:29:44.547266 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-7dab394b-dedf-4683-96f0-7300995df267 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:29:44.710974 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 695/1385] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 02:29:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 02:29:44.777175 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61eb55b-0d67-4ddd-8c75-a2b5b5775ce3 admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:29:44.779159 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-b61eb55b-0d67-4ddd-8c75-a2b5b5775ce3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:29:44.811138 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d49755-2878-4dc5-8564-77402eba35e9 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:29:44.811738 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d49755-2878-4dc5-8564-77402eba35e9 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:29:44.812724 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d49755-2878-4dc5-8564-77402eba35e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:29:44.915228 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-44d49755-2878-4dc5-8564-77402eba35e9 None None] MFA Rules not processed for user `4f91d4dca41d45ff8b6e96c3594e851b`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:29:44.919226 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-44d49755-2878-4dc5-8564-77402eba35e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:29:44.924585 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:29:44.963224 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61eb55b-0d67-4ddd-8c75-a2b5b5775ce3 admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:29:44.977885 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a922123e-d119-4403-924d-686418ebaabe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5223b5cab3114e9b9a13c582f8ef8386', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'beb6def6fcad45959e56425bb8bff4d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:29:44.980643 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a922123e-d119-4403-924d-686418ebaabe service neutron] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:29:44.982856 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a922123e-d119-4403-924d-686418ebaabe service neutron] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:29:44.983930 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a922123e-d119-4403-924d-686418ebaabe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:29:45.022412 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a922123e-d119-4403-924d-686418ebaabe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:29:45.024239 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a922123e-d119-4403-924d-686418ebaabe service neutron] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:29:45.038441 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 691/1386] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 02:29:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 262 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 02:29:45.039422 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a922123e-d119-4403-924d-686418ebaabe service neutron] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:29:45.041302 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-a922123e-d119-4403-924d-686418ebaabe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:29:45.069171 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a922123e-d119-4403-924d-686418ebaabe service neutron] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:29:45.075445 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38855440-5ae3-4750-b156-71237f75d3bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:29:45.076428 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38855440-5ae3-4750-b156-71237f75d3bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:29:45.078115 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38855440-5ae3-4750-b156-71237f75d3bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:29:45.078514 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38855440-5ae3-4750-b156-71237f75d3bd admin admin] PATH_INFO: `/v3/projects/11200aad5c8b40e888ede3464d78cf32` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:29:45.079874 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38855440-5ae3-4750-b156-71237f75d3bd admin admin] RBAC: Authorizing `identity:delete_project(project_id=11200aad5c8b40e888ede3464d78cf32)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:29:45.083846 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38855440-5ae3-4750-b156-71237f75d3bd admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:29:45.184114 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 696/1387] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 02:29:44 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 375 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 02:29:45.191412 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d49755-2878-4dc5-8564-77402eba35e9 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:29:45.193014 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-44d49755-2878-4dc5-8564-77402eba35e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:29:45.410805 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-38855440-5ae3-4750-b156-71237f75d3bd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '11200aad5c8b40e888ede3464d78cf32', 'request_id': 'req-38855440-5ae3-4750-b156-71237f75d3bd'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:29:45.433309 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-38855440-5ae3-4750-b156-71237f75d3bd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '11200aad5c8b40e888ede3464d78cf32', 'request_id': 'req-38855440-5ae3-4750-b156-71237f75d3bd'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:29:45.455568 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-38855440-5ae3-4750-b156-71237f75d3bd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '11200aad5c8b40e888ede3464d78cf32', 'request_id': 'req-38855440-5ae3-4750-b156-71237f75d3bd'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:29:45.477433 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d49755-2878-4dc5-8564-77402eba35e9 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:29:45.503492 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-38855440-5ae3-4750-b156-71237f75d3bd admin admin] The token cache is being invalidate because project 11200aad5c8b40e888ede3464d78cf32 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81361) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 02:29:45.503840 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-38855440-5ae3-4750-b156-71237f75d3bd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:29:45.506054 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-38855440-5ae3-4750-b156-71237f75d3bd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:29:45.514573 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 692/1388] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Oct 12 02:29:45 2022] DELETE /identity/v3/projects/11200aad5c8b40e888ede3464d78cf32 => generated 0 bytes in 475 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 02:29:45.516368 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38855440-5ae3-4750-b156-71237f75d3bd admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:29:45.521471 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-38855440-5ae3-4750-b156-71237f75d3bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:29:45.664232 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:29:45.698557 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80203848-26b5-4a2f-8df8-876fbfdae999 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fca96c111b45b795fb757f77908ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'beb6def6fcad45959e56425bb8bff4d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:29:45.699769 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80203848-26b5-4a2f-8df8-876fbfdae999 service nova] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:29:45.700193 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80203848-26b5-4a2f-8df8-876fbfdae999 service nova] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:29:45.701574 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80203848-26b5-4a2f-8df8-876fbfdae999 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:29:45.708368 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-80203848-26b5-4a2f-8df8-876fbfdae999 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:29:45.715461 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38855440-5ae3-4750-b156-71237f75d3bd admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:29:45.728294 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33b6501-b475-4925-aae3-5f11d439c503 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a58b9e0467c040638c3d43e3ac9c0495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'beb6def6fcad45959e56425bb8bff4d1', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:29:45.730640 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33b6501-b475-4925-aae3-5f11d439c503 service placement] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:29:45.731003 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33b6501-b475-4925-aae3-5f11d439c503 service placement] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:29:45.731413 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33b6501-b475-4925-aae3-5f11d439c503 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:29:45.738369 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-c33b6501-b475-4925-aae3-5f11d439c503 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:29:45.773469 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33b6501-b475-4925-aae3-5f11d439c503 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:29:45.775518 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33b6501-b475-4925-aae3-5f11d439c503 service placement] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:29:45.813353 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 693/1389] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 02:29:45 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 02:29:45.815172 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cbfcf9-be66-4d0e-aa7d-86bfae7ff1b9 None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:29:45.815463 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cbfcf9-be66-4d0e-aa7d-86bfae7ff1b9 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:29:45.815742 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cbfcf9-be66-4d0e-aa7d-86bfae7ff1b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:29:45.823411 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:29:45.884279 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80203848-26b5-4a2f-8df8-876fbfdae999 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:29:45.887529 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80203848-26b5-4a2f-8df8-876fbfdae999 service nova] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:29:45.896163 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-60cbfcf9-be66-4d0e-aa7d-86bfae7ff1b9 None None] MFA Rules not processed for user `a326a5bb7364479382f528a592371656`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:29:45.897534 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-60cbfcf9-be66-4d0e-aa7d-86bfae7ff1b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:29:45.911903 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 697/1390] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 02:29:45 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 722 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 02:29:45.923784 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d942ca6a-81ea-4ef1-a8cd-e3785dc31b6d None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:29:45.924291 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d942ca6a-81ea-4ef1-a8cd-e3785dc31b6d None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:29:45.924629 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d942ca6a-81ea-4ef1-a8cd-e3785dc31b6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:29:45.975579 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-d942ca6a-81ea-4ef1-a8cd-e3785dc31b6d None None] MFA Rules not processed for user `e5a8c753a1c54dddaac24b5faaaf197a`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:29:45.976428 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-d942ca6a-81ea-4ef1-a8cd-e3785dc31b6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:29:46.083062 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 694/1391] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 02:29:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 02:29:46.086925 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070e1994-3dbd-4b36-b93a-955d20c8e792 None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:29:46.087214 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070e1994-3dbd-4b36-b93a-955d20c8e792 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:29:46.087607 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070e1994-3dbd-4b36-b93a-955d20c8e792 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:29:46.131713 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 698/1392] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 02:29:45 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 02:29:46.172831 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-070e1994-3dbd-4b36-b93a-955d20c8e792 None None] MFA Rules not processed for user `a326a5bb7364479382f528a592371656`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:29:46.178175 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-070e1994-3dbd-4b36-b93a-955d20c8e792 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:29:46.212752 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d942ca6a-81ea-4ef1-a8cd-e3785dc31b6d None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:29:46.218493 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 695/1393] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 02:29:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 02:29:46.233453 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d942ca6a-81ea-4ef1-a8cd-e3785dc31b6d None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:29:46.258819 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df062d6-220b-4ebd-ad56-3bc7e3fbeb10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:29:46.259453 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df062d6-220b-4ebd-ad56-3bc7e3fbeb10 admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:29:46.259731 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df062d6-220b-4ebd-ad56-3bc7e3fbeb10 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:29:46.259998 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df062d6-220b-4ebd-ad56-3bc7e3fbeb10 admin admin] PATH_INFO: `/v3/domains` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:29:46.260706 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df062d6-220b-4ebd-ad56-3bc7e3fbeb10 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 02:29:46.260993 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df062d6-220b-4ebd-ad56-3bc7e3fbeb10 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:29:46.262685 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df062d6-220b-4ebd-ad56-3bc7e3fbeb10 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:29:46.314601 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 699/1394] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Oct 12 02:29:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 02:29:46.324011 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070e1994-3dbd-4b36-b93a-955d20c8e792 None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:29:46.347966 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070e1994-3dbd-4b36-b93a-955d20c8e792 None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:29:46.400669 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9affa4c3-39b2-4dec-8da6-8cbab6b41638 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:29:46.402387 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9affa4c3-39b2-4dec-8da6-8cbab6b41638 admin admin] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:29:46.402726 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9affa4c3-39b2-4dec-8da6-8cbab6b41638 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:29:46.404107 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9affa4c3-39b2-4dec-8da6-8cbab6b41638 admin admin] PATH_INFO: `/v3/projects` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:29:46.408071 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9affa4c3-39b2-4dec-8da6-8cbab6b41638 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:29:46.412605 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9affa4c3-39b2-4dec-8da6-8cbab6b41638 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:29:46.499279 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 696/1395] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Oct 12 02:29:46 2022] POST /identity/v3/projects => generated 371 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 02:29:46.502010 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df062d6-220b-4ebd-ad56-3bc7e3fbeb10 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:29:46.513405 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df062d6-220b-4ebd-ad56-3bc7e3fbeb10 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:29:46.663543 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffc4650-8f70-41c4-b141-3274d22286e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:29:46.664537 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffc4650-8f70-41c4-b141-3274d22286e9 admin admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:29:46.665193 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffc4650-8f70-41c4-b141-3274d22286e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:29:46.665617 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffc4650-8f70-41c4-b141-3274d22286e9 admin admin] PATH_INFO: `/v3/users` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:29:46.666408 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ffc4650-8f70-41c4-b141-3274d22286e9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:29:46.675606 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ffc4650-8f70-41c4-b141-3274d22286e9 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:29:46.739615 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 700/1396] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Oct 12 02:29:46 2022] POST /identity/v3/users => generated 286 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 02:29:46.741014 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9affa4c3-39b2-4dec-8da6-8cbab6b41638 admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:29:46.764031 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9affa4c3-39b2-4dec-8da6-8cbab6b41638 admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:29:46.793168 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399887da-5e21-495f-88e6-7d4b5d5508fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:29:46.803028 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399887da-5e21-495f-88e6-7d4b5d5508fc admin admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:29:46.803682 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399887da-5e21-495f-88e6-7d4b5d5508fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:29:46.805381 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399887da-5e21-495f-88e6-7d4b5d5508fc admin admin] PATH_INFO: `/v3/roles` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:29:46.807129 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399887da-5e21-495f-88e6-7d4b5d5508fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:29:46.817502 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399887da-5e21-495f-88e6-7d4b5d5508fc admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:29:46.852712 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 697/1397] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Oct 12 02:29:46 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 02:29:46.856440 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffc4650-8f70-41c4-b141-3274d22286e9 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:29:46.880140 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffc4650-8f70-41c4-b141-3274d22286e9 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:29:46.891628 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa19e191-c00b-4eef-a76b-32cb0215a0be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:29:46.892274 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa19e191-c00b-4eef-a76b-32cb0215a0be admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:29:46.892581 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa19e191-c00b-4eef-a76b-32cb0215a0be admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:29:46.892857 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa19e191-c00b-4eef-a76b-32cb0215a0be admin admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:29:46.893645 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa19e191-c00b-4eef-a76b-32cb0215a0be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:29:46.895203 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa19e191-c00b-4eef-a76b-32cb0215a0be admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:29:46.934930 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399887da-5e21-495f-88e6-7d4b5d5508fc admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:29:46.936062 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 701/1398] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Oct 12 02:29:46 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 02:29:46.946838 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18df28dc-6f84-4544-8d7d-a000cbf18cf2 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:29:46.947122 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18df28dc-6f84-4544-8d7d-a000cbf18cf2 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:29:46.947397 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18df28dc-6f84-4544-8d7d-a000cbf18cf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:29:46.956714 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399887da-5e21-495f-88e6-7d4b5d5508fc admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:29:46.978749 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36591df-f6a1-4b0d-bdac-637d7dd54def admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:29:46.979662 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36591df-f6a1-4b0d-bdac-637d7dd54def admin admin] REQUEST_METHOD: `PUT` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:29:46.980082 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36591df-f6a1-4b0d-bdac-637d7dd54def admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:29:46.982155 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36591df-f6a1-4b0d-bdac-637d7dd54def admin admin] PATH_INFO: `/v3/projects/ebceedff7fe84bd2b785841c0425735d/users/b5218e2cb11d4d83a341830292f273e4/roles/3d75c4d7f1a849b9a771504d1583ab28` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:29:47.018512 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-18df28dc-6f84-4544-8d7d-a000cbf18cf2 None None] MFA Rules not processed for user `961c8dd429784f79ae70fe961c9e4dcb`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:29:47.019763 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-18df28dc-6f84-4544-8d7d-a000cbf18cf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:29:47.036654 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36591df-f6a1-4b0d-bdac-637d7dd54def admin admin] RBAC: Authorizing `identity:create_grant(project_id=ebceedff7fe84bd2b785841c0425735d, user_id=b5218e2cb11d4d83a341830292f273e4, role_id=3d75c4d7f1a849b9a771504d1583ab28)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:29:47.043884 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36591df-f6a1-4b0d-bdac-637d7dd54def admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:29:47.107385 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 698/1399] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Oct 12 02:29:46 2022] PUT /identity/v3/projects/ebceedff7fe84bd2b785841c0425735d/users/b5218e2cb11d4d83a341830292f273e4/roles/3d75c4d7f1a849b9a771504d1583ab28 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 02:29:47.113009 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ae8652-2daa-4a53-abd6-a69f76752695 None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:29:47.113298 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ae8652-2daa-4a53-abd6-a69f76752695 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:29:47.113626 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ae8652-2daa-4a53-abd6-a69f76752695 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:29:47.200704 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:29:47.210317 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-d9ae8652-2daa-4a53-abd6-a69f76752695 None None] MFA Rules not processed for user `b5218e2cb11d4d83a341830292f273e4`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:29:47.211569 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-d9ae8652-2daa-4a53-abd6-a69f76752695 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:29:47.237592 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 702/1400] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 02:29:46 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 297 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 02:29:47.242664 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18df28dc-6f84-4544-8d7d-a000cbf18cf2 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:29:47.254302 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-18df28dc-6f84-4544-8d7d-a000cbf18cf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:29:47.314516 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18df28dc-6f84-4544-8d7d-a000cbf18cf2 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:29:47.427541 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:29:47.447528 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a10599-9dff-4281-af01-2ebb432e1d8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:29:47.449403 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a10599-9dff-4281-af01-2ebb432e1d8a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:29:47.450677 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a10599-9dff-4281-af01-2ebb432e1d8a admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:29:47.451103 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a10599-9dff-4281-af01-2ebb432e1d8a admin admin] PATH_INFO: `/v3/projects/2d2d5e2fb2cd4180a7c9fa9474e73507` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:29:47.453225 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a10599-9dff-4281-af01-2ebb432e1d8a admin admin] RBAC: Authorizing `identity:delete_project(project_id=2d2d5e2fb2cd4180a7c9fa9474e73507)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:29:47.458869 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a10599-9dff-4281-af01-2ebb432e1d8a admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:29:47.467003 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 699/1401] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 02:29:47 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 355 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 02:29:47.468765 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d93e38-f0bb-4d03-9554-285b72940378 None None] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:29:47.471526 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d93e38-f0bb-4d03-9554-285b72940378 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:29:47.471971 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d93e38-f0bb-4d03-9554-285b72940378 None None] PATH_INFO: `/` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:29:47.475494 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 700/1402] 10.222.0.18 () {54 vars in 912 bytes} [Wed Oct 12 02:29:47 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 02:29:47.477662 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d93e38-f0bb-4d03-9554-285b72940378 None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:29:47.510975 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d93e38-f0bb-4d03-9554-285b72940378 None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:29:47.535350 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550a3675-edfb-41c8-9ed4-ae2f34a8ece9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:29:47.536577 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550a3675-edfb-41c8-9ed4-ae2f34a8ece9 admin admin] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:29:47.536862 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550a3675-edfb-41c8-9ed4-ae2f34a8ece9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:29:47.537135 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550a3675-edfb-41c8-9ed4-ae2f34a8ece9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:29:47.537785 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550a3675-edfb-41c8-9ed4-ae2f34a8ece9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:29:47.544838 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550a3675-edfb-41c8-9ed4-ae2f34a8ece9 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:29:47.578393 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-c4a10599-9dff-4281-af01-2ebb432e1d8a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2d2d5e2fb2cd4180a7c9fa9474e73507', 'request_id': 'req-c4a10599-9dff-4281-af01-2ebb432e1d8a'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:29:47.596872 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-c4a10599-9dff-4281-af01-2ebb432e1d8a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2d2d5e2fb2cd4180a7c9fa9474e73507', 'request_id': 'req-c4a10599-9dff-4281-af01-2ebb432e1d8a'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:29:47.610339 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-c4a10599-9dff-4281-af01-2ebb432e1d8a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2d2d5e2fb2cd4180a7c9fa9474e73507', 'request_id': 'req-c4a10599-9dff-4281-af01-2ebb432e1d8a'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:29:47.630956 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 701/1403] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Oct 12 02:29:47 2022] POST /identity/v3/projects => generated 373 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 02:29:47.632650 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a083f7-1289-434f-b019-d31f63e08b2a None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:29:47.635478 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a083f7-1289-434f-b019-d31f63e08b2a None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:29:47.635690 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a083f7-1289-434f-b019-d31f63e08b2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:29:47.636909 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-c4a10599-9dff-4281-af01-2ebb432e1d8a admin admin] The token cache is being invalidate because project 2d2d5e2fb2cd4180a7c9fa9474e73507 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81362) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 02:29:47.637258 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-c4a10599-9dff-4281-af01-2ebb432e1d8a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:29:47.639300 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-c4a10599-9dff-4281-af01-2ebb432e1d8a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:29:47.642230 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 703/1404] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Oct 12 02:29:47 2022] DELETE /identity/v3/projects/2d2d5e2fb2cd4180a7c9fa9474e73507 => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 02:29:47.642762 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a10599-9dff-4281-af01-2ebb432e1d8a admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:29:47.653360 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-c4a10599-9dff-4281-af01-2ebb432e1d8a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:29:47.705222 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-26a083f7-1289-434f-b019-d31f63e08b2a None None] MFA Rules not processed for user `5223b5cab3114e9b9a13c582f8ef8386`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:29:47.706488 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-26a083f7-1289-434f-b019-d31f63e08b2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:29:47.781412 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a10599-9dff-4281-af01-2ebb432e1d8a admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:29:47.833788 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 702/1405] 10.222.0.18 () {58 vars in 1009 bytes} [Wed Oct 12 02:29:47 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 02:29:47.838242 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a083f7-1289-434f-b019-d31f63e08b2a None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:29:47.839899 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-26a083f7-1289-434f-b019-d31f63e08b2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:29:47.848152 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:29:47.919925 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5104e8-7a47-4528-9156-1c8461d038ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:29:47.919925 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5104e8-7a47-4528-9156-1c8461d038ca admin admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:29:47.919925 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5104e8-7a47-4528-9156-1c8461d038ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:29:47.919925 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5104e8-7a47-4528-9156-1c8461d038ca admin admin] PATH_INFO: `/v3/users` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:29:47.920359 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5104e8-7a47-4528-9156-1c8461d038ca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:29:47.924719 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5104e8-7a47-4528-9156-1c8461d038ca admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:29:48.026928 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 704/1406] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Oct 12 02:29:47 2022] POST /identity/v3/users => generated 293 bytes in 381 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 02:29:48.027859 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5104e8-7a47-4528-9156-1c8461d038ca admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:29:48.035128 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-fd5104e8-7a47-4528-9156-1c8461d038ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:29:48.061628 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a083f7-1289-434f-b019-d31f63e08b2a None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:29:48.070660 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4057b6-249d-4bf5-a438-86198535667d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:29:48.076020 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4057b6-249d-4bf5-a438-86198535667d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:29:48.078576 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4057b6-249d-4bf5-a438-86198535667d admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:29:48.079044 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4057b6-249d-4bf5-a438-86198535667d admin admin] PATH_INFO: `/v3/users/1eaa99c727704de89c0b5b35f20a4f0b` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:29:48.080974 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4057b6-249d-4bf5-a438-86198535667d admin admin] RBAC: Authorizing `identity:delete_user(user_id=1eaa99c727704de89c0b5b35f20a4f0b)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:29:48.086415 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4057b6-249d-4bf5-a438-86198535667d admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:29:48.118652 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5104e8-7a47-4528-9156-1c8461d038ca admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:29:48.192923 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687a0e9e-1b22-46fc-9860-7193210a7805 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5223b5cab3114e9b9a13c582f8ef8386', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'beb6def6fcad45959e56425bb8bff4d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:29:48.196188 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687a0e9e-1b22-46fc-9860-7193210a7805 service neutron] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:29:48.198621 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687a0e9e-1b22-46fc-9860-7193210a7805 service neutron] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:29:48.198621 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687a0e9e-1b22-46fc-9860-7193210a7805 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:29:48.225934 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687a0e9e-1b22-46fc-9860-7193210a7805 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:29:48.228627 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-8d4057b6-249d-4bf5-a438-86198535667d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1eaa99c727704de89c0b5b35f20a4f0b'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:29:48.229973 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687a0e9e-1b22-46fc-9860-7193210a7805 service neutron] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:29:48.261162 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-8d4057b6-249d-4bf5-a438-86198535667d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1eaa99c727704de89c0b5b35f20a4f0b'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:29:48.280802 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 705/1407] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 02:29:48 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 256 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 02:29:48.282550 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687a0e9e-1b22-46fc-9860-7193210a7805 service neutron] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:29:48.303174 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687a0e9e-1b22-46fc-9860-7193210a7805 service neutron] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:29:48.303409 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-8d4057b6-249d-4bf5-a438-86198535667d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1eaa99c727704de89c0b5b35f20a4f0b'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:29:48.309833 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53e9000-e4bc-4637-b208-21d6ea56b8df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:29:48.310835 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53e9000-e4bc-4637-b208-21d6ea56b8df admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:29:48.311317 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53e9000-e4bc-4637-b208-21d6ea56b8df admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:29:48.311826 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53e9000-e4bc-4637-b208-21d6ea56b8df admin admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:29:48.313803 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53e9000-e4bc-4637-b208-21d6ea56b8df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:29:48.326775 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53e9000-e4bc-4637-b208-21d6ea56b8df admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:29:48.335414 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-8d4057b6-249d-4bf5-a438-86198535667d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1eaa99c727704de89c0b5b35f20a4f0b'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:29:48.336177 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-8d4057b6-249d-4bf5-a438-86198535667d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1eaa99c727704de89c0b5b35f20a4f0b'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:29:48.341204 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:29:48.342525 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 706/1408] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Oct 12 02:29:48 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 02:29:48.347619 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53e9000-e4bc-4637-b208-21d6ea56b8df admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:29:48.351872 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-e53e9000-e4bc-4637-b208-21d6ea56b8df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:29:48.365123 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 703/1409] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Oct 12 02:29:47 2022] DELETE /identity/v3/users/1eaa99c727704de89c0b5b35f20a4f0b => generated 0 bytes in 531 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 02:29:48.392736 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53e9000-e4bc-4637-b208-21d6ea56b8df admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:29:48.600898 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65aea1b9-a5e1-4676-8604-124b71f90058 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:29:48.601927 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65aea1b9-a5e1-4676-8604-124b71f90058 admin admin] REQUEST_METHOD: `PUT` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:29:48.602209 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65aea1b9-a5e1-4676-8604-124b71f90058 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:29:48.602551 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65aea1b9-a5e1-4676-8604-124b71f90058 admin admin] PATH_INFO: `/v3/projects/00e9bff6c613490686e78b5210e6c989/users/88bf77bb0daf4d2388c96a2a48d0bc95/roles/39b1e8108dff402383def3c559f48189` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:29:48.642421 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65aea1b9-a5e1-4676-8604-124b71f90058 admin admin] RBAC: Authorizing `identity:create_grant(project_id=00e9bff6c613490686e78b5210e6c989, user_id=88bf77bb0daf4d2388c96a2a48d0bc95, role_id=39b1e8108dff402383def3c559f48189)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:29:48.647267 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65aea1b9-a5e1-4676-8604-124b71f90058 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:29:48.692520 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 707/1410] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Oct 12 02:29:48 2022] PUT /identity/v3/projects/00e9bff6c613490686e78b5210e6c989/users/88bf77bb0daf4d2388c96a2a48d0bc95/roles/39b1e8108dff402383def3c559f48189 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 02:29:48.696461 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4057b6-249d-4bf5-a438-86198535667d admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:29:48.716429 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4057b6-249d-4bf5-a438-86198535667d admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:29:48.913211 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36c0440-f344-4c60-868e-9f3b28d3116c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:29:48.915027 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36c0440-f344-4c60-868e-9f3b28d3116c admin admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:29:48.916136 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36c0440-f344-4c60-868e-9f3b28d3116c admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:29:48.922709 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36c0440-f344-4c60-868e-9f3b28d3116c admin admin] PATH_INFO: `/v3/roles` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:29:48.925039 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36c0440-f344-4c60-868e-9f3b28d3116c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:29:48.928554 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36c0440-f344-4c60-868e-9f3b28d3116c admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:29:48.947798 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 704/1411] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Oct 12 02:29:48 2022] GET /identity/v3/roles => generated 1420 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 02:29:48.949251 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65aea1b9-a5e1-4676-8604-124b71f90058 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:29:48.971444 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65aea1b9-a5e1-4676-8604-124b71f90058 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:29:49.010397 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a626001-5f54-4ccd-90f9-794b90c1843e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:29:49.011114 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a626001-5f54-4ccd-90f9-794b90c1843e admin admin] REQUEST_METHOD: `PUT` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:29:49.011393 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a626001-5f54-4ccd-90f9-794b90c1843e admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:29:49.012350 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a626001-5f54-4ccd-90f9-794b90c1843e admin admin] PATH_INFO: `/v3/projects/00e9bff6c613490686e78b5210e6c989/users/88bf77bb0daf4d2388c96a2a48d0bc95/roles/39b1e8108dff402383def3c559f48189` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:29:49.020423 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a626001-5f54-4ccd-90f9-794b90c1843e admin admin] RBAC: Authorizing `identity:create_grant(project_id=00e9bff6c613490686e78b5210e6c989, user_id=88bf77bb0daf4d2388c96a2a48d0bc95, role_id=39b1e8108dff402383def3c559f48189)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:29:49.023259 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a626001-5f54-4ccd-90f9-794b90c1843e admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:29:49.054590 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 708/1412] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Oct 12 02:29:48 2022] PUT /identity/v3/projects/00e9bff6c613490686e78b5210e6c989/users/88bf77bb0daf4d2388c96a2a48d0bc95/roles/39b1e8108dff402383def3c559f48189 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 02:29:49.069151 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4043c42-06f5-4851-8480-3c76909eb1c3 None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:29:49.069440 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4043c42-06f5-4851-8480-3c76909eb1c3 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:29:49.069768 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4043c42-06f5-4851-8480-3c76909eb1c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:29:49.133324 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-f4043c42-06f5-4851-8480-3c76909eb1c3 None None] MFA Rules not processed for user `88bf77bb0daf4d2388c96a2a48d0bc95`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:29:49.135249 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-f4043c42-06f5-4851-8480-3c76909eb1c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:29:49.314051 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 705/1413] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 02:29:49 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 02:29:49.324387 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a626001-5f54-4ccd-90f9-794b90c1843e admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:29:49.327144 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-4a626001-5f54-4ccd-90f9-794b90c1843e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:29:49.490300 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a626001-5f54-4ccd-90f9-794b90c1843e admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:29:49.506465 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31537c8e-0baa-409c-86fa-e871aebe7f62 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ba688e0c4d44d13898539ee886f95fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'beb6def6fcad45959e56425bb8bff4d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:29:49.507269 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31537c8e-0baa-409c-86fa-e871aebe7f62 service cinder] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:29:49.508162 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31537c8e-0baa-409c-86fa-e871aebe7f62 service cinder] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:29:49.508448 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31537c8e-0baa-409c-86fa-e871aebe7f62 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:29:49.543993 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31537c8e-0baa-409c-86fa-e871aebe7f62 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:29:49.548001 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31537c8e-0baa-409c-86fa-e871aebe7f62 service cinder] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:29:49.598143 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 709/1414] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 02:29:49 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 275 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 02:29:49.712333 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d073ade9-a4ff-4dd5-91b9-42d2679a180c None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:29:49.712781 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d073ade9-a4ff-4dd5-91b9-42d2679a180c None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:29:49.713136 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d073ade9-a4ff-4dd5-91b9-42d2679a180c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:29:49.921470 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31537c8e-0baa-409c-86fa-e871aebe7f62 service cinder] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:29:49.932578 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-d073ade9-a4ff-4dd5-91b9-42d2679a180c None None] MFA Rules not processed for user `8d0e2087e5324071926c3dc3a3cb9b1d`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:29:49.937933 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31537c8e-0baa-409c-86fa-e871aebe7f62 service cinder] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:29:49.941442 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-d073ade9-a4ff-4dd5-91b9-42d2679a180c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:29:49.947775 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b9a3f6-cdff-4a63-9d32-6688df4512a7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ba688e0c4d44d13898539ee886f95fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'beb6def6fcad45959e56425bb8bff4d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:29:49.948410 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b9a3f6-cdff-4a63-9d32-6688df4512a7 service cinder] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:29:49.948727 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b9a3f6-cdff-4a63-9d32-6688df4512a7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:29:49.949001 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b9a3f6-cdff-4a63-9d32-6688df4512a7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:29:49.951361 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-b1b9a3f6-cdff-4a63-9d32-6688df4512a7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:29:50.011729 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:29:50.160812 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:29:50.194634 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 706/1415] 10.222.0.18 () {58 vars in 1009 bytes} [Wed Oct 12 02:29:49 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 483 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 02:29:50.251512 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b9a3f6-cdff-4a63-9d32-6688df4512a7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:29:50.267260 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b9a3f6-cdff-4a63-9d32-6688df4512a7 service cinder] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:29:50.330431 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 710/1416] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 02:29:49 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 02:29:50.498796 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d073ade9-a4ff-4dd5-91b9-42d2679a180c None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:29:50.501352 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-d073ade9-a4ff-4dd5-91b9-42d2679a180c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:29:50.526289 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b91192-2662-4d7d-b2f6-2bde1b6ad9c0 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:29:50.526890 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b91192-2662-4d7d-b2f6-2bde1b6ad9c0 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:29:50.527360 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b91192-2662-4d7d-b2f6-2bde1b6ad9c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:29:50.682853 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-49b91192-2662-4d7d-b2f6-2bde1b6ad9c0 None None] MFA Rules not processed for user `ea459e1bb9a543d5aa41f288ab49c7da`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:29:50.684399 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-49b91192-2662-4d7d-b2f6-2bde1b6ad9c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:29:50.823634 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 711/1417] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 02:29:50 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 298 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 02:29:50.824689 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b91192-2662-4d7d-b2f6-2bde1b6ad9c0 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:29:50.826170 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-49b91192-2662-4d7d-b2f6-2bde1b6ad9c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:29:50.918655 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d073ade9-a4ff-4dd5-91b9-42d2679a180c None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:29:50.926611 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bb585f-b102-4779-9684-d3622684d181 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af9bd50c42cc437dbdd5a431d8adbb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'beb6def6fcad45959e56425bb8bff4d1', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:29:50.927369 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bb585f-b102-4779-9684-d3622684d181 service swift] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:29:50.927812 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bb585f-b102-4779-9684-d3622684d181 service swift] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:29:50.928530 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bb585f-b102-4779-9684-d3622684d181 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:29:50.942275 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98bb585f-b102-4779-9684-d3622684d181 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:29:50.945784 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98bb585f-b102-4779-9684-d3622684d181 service swift] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:29:50.961992 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 707/1418] 10.222.0.18 () {60 vars in 1384 bytes} [Wed Oct 12 02:29:50 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 464 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 12 02:29:50.963995 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8afa23-82a4-4ab6-8662-bee8443d811c None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:29:50.964990 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8afa23-82a4-4ab6-8662-bee8443d811c None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:29:50.965538 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8afa23-82a4-4ab6-8662-bee8443d811c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:29:50.993351 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-9e8afa23-82a4-4ab6-8662-bee8443d811c None None] MFA Rules not processed for user `ea459e1bb9a543d5aa41f288ab49c7da`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:29:50.995069 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-9e8afa23-82a4-4ab6-8662-bee8443d811c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:29:51.060175 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 708/1419] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 02:29:50 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 02:29:51.064330 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b91192-2662-4d7d-b2f6-2bde1b6ad9c0 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:29:51.073796 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8afa23-82a4-4ab6-8662-bee8443d811c None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:29:51.075992 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-9e8afa23-82a4-4ab6-8662-bee8443d811c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:29:51.108903 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a5c8dc-6bd3-4b2e-a6df-69db4f627528 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:29:51.110376 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a5c8dc-6bd3-4b2e-a6df-69db4f627528 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:29:51.110734 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a5c8dc-6bd3-4b2e-a6df-69db4f627528 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:29:51.111106 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a5c8dc-6bd3-4b2e-a6df-69db4f627528 admin admin] PATH_INFO: `/v3/users/1428126dc8754da5887c6d49bbacb009` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:29:51.121514 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a5c8dc-6bd3-4b2e-a6df-69db4f627528 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1428126dc8754da5887c6d49bbacb009)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:29:51.123711 dv-cinder-849143-14-smb devstack@keystone.service[81362]: WARNING py.warnings [None req-58a5c8dc-6bd3-4b2e-a6df-69db4f627528 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 12 02:29:51.123711 dv-cinder-849143-14-smb devstack@keystone.service[81362]: warnings.warn(msg) Oct 12 02:29:51.123711 dv-cinder-849143-14-smb devstack@keystone.service[81362]: Oct 12 02:29:51.133814 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a5c8dc-6bd3-4b2e-a6df-69db4f627528 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:29:51.389314 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:29:51.408819 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8afa23-82a4-4ab6-8662-bee8443d811c None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:29:51.413612 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-58a5c8dc-6bd3-4b2e-a6df-69db4f627528 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1428126dc8754da5887c6d49bbacb009'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:29:51.439861 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f002dad-bbfc-4dd1-9fcc-91918bb4f094 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fca96c111b45b795fb757f77908ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'beb6def6fcad45959e56425bb8bff4d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:29:51.439976 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f002dad-bbfc-4dd1-9fcc-91918bb4f094 service nova] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:29:51.440212 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f002dad-bbfc-4dd1-9fcc-91918bb4f094 service nova] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:29:51.440565 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f002dad-bbfc-4dd1-9fcc-91918bb4f094 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:29:51.445610 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-58a5c8dc-6bd3-4b2e-a6df-69db4f627528 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1428126dc8754da5887c6d49bbacb009'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:29:51.480619 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f002dad-bbfc-4dd1-9fcc-91918bb4f094 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:29:51.482243 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f002dad-bbfc-4dd1-9fcc-91918bb4f094 service nova] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:29:51.534682 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-58a5c8dc-6bd3-4b2e-a6df-69db4f627528 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1428126dc8754da5887c6d49bbacb009'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:29:51.536120 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 709/1420] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 02:29:51 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 460 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 12 02:29:51.537136 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f002dad-bbfc-4dd1-9fcc-91918bb4f094 service nova] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:29:51.551020 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-9f002dad-bbfc-4dd1-9fcc-91918bb4f094 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:29:51.612173 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-58a5c8dc-6bd3-4b2e-a6df-69db4f627528 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1428126dc8754da5887c6d49bbacb009'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:29:51.617529 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-58a5c8dc-6bd3-4b2e-a6df-69db4f627528 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1428126dc8754da5887c6d49bbacb009'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:29:51.634510 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f002dad-bbfc-4dd1-9fcc-91918bb4f094 service nova] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:29:51.652346 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 712/1421] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Oct 12 02:29:50 2022] DELETE /identity/v3/users/1428126dc8754da5887c6d49bbacb009 => generated 0 bytes in 828 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 02:29:51.666086 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a5c8dc-6bd3-4b2e-a6df-69db4f627528 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:29:51.672166 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-58a5c8dc-6bd3-4b2e-a6df-69db4f627528 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:29:51.673211 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7280dbdd-989d-4f9a-9499-e70b9ee753eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:29:51.673862 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7280dbdd-989d-4f9a-9499-e70b9ee753eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:29:51.674137 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7280dbdd-989d-4f9a-9499-e70b9ee753eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:29:51.674403 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7280dbdd-989d-4f9a-9499-e70b9ee753eb admin admin] PATH_INFO: `/v3/projects/e8580df2123a4457abf531233b049125` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:29:51.680601 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7280dbdd-989d-4f9a-9499-e70b9ee753eb admin admin] RBAC: Authorizing `identity:delete_project(project_id=e8580df2123a4457abf531233b049125)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:29:51.695261 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7280dbdd-989d-4f9a-9499-e70b9ee753eb admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:29:51.854904 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:29:51.912514 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-7280dbdd-989d-4f9a-9499-e70b9ee753eb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e8580df2123a4457abf531233b049125', 'request_id': 'req-7280dbdd-989d-4f9a-9499-e70b9ee753eb'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:29:51.939050 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-7280dbdd-989d-4f9a-9499-e70b9ee753eb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e8580df2123a4457abf531233b049125', 'request_id': 'req-7280dbdd-989d-4f9a-9499-e70b9ee753eb'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:29:51.969371 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-7280dbdd-989d-4f9a-9499-e70b9ee753eb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e8580df2123a4457abf531233b049125', 'request_id': 'req-7280dbdd-989d-4f9a-9499-e70b9ee753eb'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:29:51.990561 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a5c8dc-6bd3-4b2e-a6df-69db4f627528 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:29:52.025323 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-7280dbdd-989d-4f9a-9499-e70b9ee753eb admin admin] The token cache is being invalidate because project e8580df2123a4457abf531233b049125 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81361) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 02:29:52.028008 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-7280dbdd-989d-4f9a-9499-e70b9ee753eb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:29:52.031257 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-7280dbdd-989d-4f9a-9499-e70b9ee753eb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:29:52.038411 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 710/1422] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Oct 12 02:29:51 2022] DELETE /identity/v3/projects/e8580df2123a4457abf531233b049125 => generated 0 bytes in 501 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 02:29:52.043677 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbd1fb6-1272-469d-be47-74336ac7bce2 None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:29:52.044533 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbd1fb6-1272-469d-be47-74336ac7bce2 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:29:52.045416 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbd1fb6-1272-469d-be47-74336ac7bce2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:29:52.126799 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-1cbd1fb6-1272-469d-be47-74336ac7bce2 None None] MFA Rules not processed for user `a326a5bb7364479382f528a592371656`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:29:52.131742 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-1cbd1fb6-1272-469d-be47-74336ac7bce2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:29:52.312928 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d14c1d-03e6-4cee-b451-56dfb4c4404f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:29:52.313612 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d14c1d-03e6-4cee-b451-56dfb4c4404f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:29:52.332936 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d14c1d-03e6-4cee-b451-56dfb4c4404f admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:29:52.334319 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d14c1d-03e6-4cee-b451-56dfb4c4404f admin admin] PATH_INFO: `/v3/users/3c1e10b0dc9a4f65a25ee5ae37d657d3` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:29:52.338345 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d14c1d-03e6-4cee-b451-56dfb4c4404f admin admin] RBAC: Authorizing `identity:delete_user(user_id=3c1e10b0dc9a4f65a25ee5ae37d657d3)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:29:52.343256 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 711/1423] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 02:29:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 304 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 02:29:52.348449 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e88efe7-76b9-49b3-baf4-2624984fad6f None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:29:52.348775 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e88efe7-76b9-49b3-baf4-2624984fad6f None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:29:52.349130 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d14c1d-03e6-4cee-b451-56dfb4c4404f admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:29:52.349827 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e88efe7-76b9-49b3-baf4-2624984fad6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:29:52.449101 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-8e88efe7-76b9-49b3-baf4-2624984fad6f None None] MFA Rules not processed for user `a326a5bb7364479382f528a592371656`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:29:52.457262 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-8e88efe7-76b9-49b3-baf4-2624984fad6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:29:52.500307 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 712/1424] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 02:29:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 02:29:52.500964 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e88efe7-76b9-49b3-baf4-2624984fad6f None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:29:52.511034 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-8e88efe7-76b9-49b3-baf4-2624984fad6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:29:52.600014 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-b1d14c1d-03e6-4cee-b451-56dfb4c4404f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3c1e10b0dc9a4f65a25ee5ae37d657d3'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:29:52.626522 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-b1d14c1d-03e6-4cee-b451-56dfb4c4404f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3c1e10b0dc9a4f65a25ee5ae37d657d3'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:29:52.697923 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:29:52.713141 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-b1d14c1d-03e6-4cee-b451-56dfb4c4404f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3c1e10b0dc9a4f65a25ee5ae37d657d3'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:29:52.750115 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-b1d14c1d-03e6-4cee-b451-56dfb4c4404f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3c1e10b0dc9a4f65a25ee5ae37d657d3'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:29:52.753149 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-b1d14c1d-03e6-4cee-b451-56dfb4c4404f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3c1e10b0dc9a4f65a25ee5ae37d657d3'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:29:52.755800 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e88efe7-76b9-49b3-baf4-2624984fad6f None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:29:52.772460 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d44fda9-1a6b-437c-be3c-c2b10e591527 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5223b5cab3114e9b9a13c582f8ef8386', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'beb6def6fcad45959e56425bb8bff4d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:29:52.775494 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d44fda9-1a6b-437c-be3c-c2b10e591527 service neutron] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:29:52.781561 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d44fda9-1a6b-437c-be3c-c2b10e591527 service neutron] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:29:52.781561 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d44fda9-1a6b-437c-be3c-c2b10e591527 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:29:52.790157 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-0d44fda9-1a6b-437c-be3c-c2b10e591527 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:29:52.813975 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 713/1425] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Oct 12 02:29:51 2022] DELETE /identity/v3/users/3c1e10b0dc9a4f65a25ee5ae37d657d3 => generated 0 bytes in 1161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 02:29:52.829653 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37514c6d-1aea-41c6-bccd-16345c89934a None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:29:52.830035 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37514c6d-1aea-41c6-bccd-16345c89934a None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:29:52.830210 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37514c6d-1aea-41c6-bccd-16345c89934a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:29:52.836648 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d44fda9-1a6b-437c-be3c-c2b10e591527 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:29:52.842299 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d44fda9-1a6b-437c-be3c-c2b10e591527 service neutron] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:29:52.884490 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 713/1426] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 02:29:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 02:29:52.895152 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ab8e1b-c4a8-4eb2-8bd2-1327d21abb05 None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:29:52.900582 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ab8e1b-c4a8-4eb2-8bd2-1327d21abb05 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:29:52.903293 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ab8e1b-c4a8-4eb2-8bd2-1327d21abb05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:29:52.953980 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-37514c6d-1aea-41c6-bccd-16345c89934a None None] MFA Rules not processed for user `a326a5bb7364479382f528a592371656`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:29:52.955311 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-37514c6d-1aea-41c6-bccd-16345c89934a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:29:52.974134 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-85ab8e1b-c4a8-4eb2-8bd2-1327d21abb05 None None] MFA Rules not processed for user `a326a5bb7364479382f528a592371656`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:29:52.977195 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-85ab8e1b-c4a8-4eb2-8bd2-1327d21abb05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:29:53.204383 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 714/1427] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 02:29:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 319 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 02:29:53.281190 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 714/1428] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 02:29:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 454 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 02:29:53.285339 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ab8e1b-c4a8-4eb2-8bd2-1327d21abb05 None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:29:53.299172 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:29:53.319011 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ab8e1b-c4a8-4eb2-8bd2-1327d21abb05 None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:29:53.364766 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25afe9ec-4346-4271-99fc-52d721e825f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:29:53.371860 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25afe9ec-4346-4271-99fc-52d721e825f7 admin admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:29:53.376164 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25afe9ec-4346-4271-99fc-52d721e825f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:29:53.376646 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25afe9ec-4346-4271-99fc-52d721e825f7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:29:53.377908 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25afe9ec-4346-4271-99fc-52d721e825f7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 02:29:53.384318 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25afe9ec-4346-4271-99fc-52d721e825f7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:29:53.391056 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25afe9ec-4346-4271-99fc-52d721e825f7 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:29:53.465117 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 715/1429] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Oct 12 02:29:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 02:29:53.469452 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37514c6d-1aea-41c6-bccd-16345c89934a None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:29:53.488733 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37514c6d-1aea-41c6-bccd-16345c89934a None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:29:53.509690 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1fb087-c414-412f-927e-ef5e59f83c8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:29:53.510608 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1fb087-c414-412f-927e-ef5e59f83c8f admin admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:29:53.514288 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1fb087-c414-412f-927e-ef5e59f83c8f admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:29:53.514759 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1fb087-c414-412f-927e-ef5e59f83c8f admin admin] PATH_INFO: `/v3/projects` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:29:53.516177 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1fb087-c414-412f-927e-ef5e59f83c8f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:29:53.523356 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1fb087-c414-412f-927e-ef5e59f83c8f admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:29:53.527285 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25afe9ec-4346-4271-99fc-52d721e825f7 admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:29:53.529691 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-25afe9ec-4346-4271-99fc-52d721e825f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:29:53.697307 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25afe9ec-4346-4271-99fc-52d721e825f7 admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:29:53.714543 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add01ff6-2abf-43cd-a2e9-e155ee92ae6e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5223b5cab3114e9b9a13c582f8ef8386', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'beb6def6fcad45959e56425bb8bff4d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:29:53.715087 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add01ff6-2abf-43cd-a2e9-e155ee92ae6e service neutron] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:29:53.715375 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add01ff6-2abf-43cd-a2e9-e155ee92ae6e service neutron] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:29:53.715650 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add01ff6-2abf-43cd-a2e9-e155ee92ae6e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:29:53.724419 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 715/1430] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Oct 12 02:29:53 2022] POST /identity/v3/projects => generated 365 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 02:29:53.734920 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1fb087-c414-412f-927e-ef5e59f83c8f admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:29:53.781874 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add01ff6-2abf-43cd-a2e9-e155ee92ae6e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:29:53.783247 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add01ff6-2abf-43cd-a2e9-e155ee92ae6e service neutron] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:29:53.876038 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 716/1431] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 02:29:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 02:29:54.178390 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1fb087-c414-412f-927e-ef5e59f83c8f admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:29:54.191503 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241704cf-6a81-47ad-913d-03ac8785a113 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:29:54.192264 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241704cf-6a81-47ad-913d-03ac8785a113 admin admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:29:54.193782 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241704cf-6a81-47ad-913d-03ac8785a113 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:29:54.194558 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241704cf-6a81-47ad-913d-03ac8785a113 admin admin] PATH_INFO: `/v3/users` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:29:54.196685 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241704cf-6a81-47ad-913d-03ac8785a113 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:29:54.215927 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241704cf-6a81-47ad-913d-03ac8785a113 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:29:54.316173 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 716/1432] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Oct 12 02:29:53 2022] POST /identity/v3/users => generated 283 bytes in 585 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 02:29:54.317314 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add01ff6-2abf-43cd-a2e9-e155ee92ae6e service neutron] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:29:54.346421 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add01ff6-2abf-43cd-a2e9-e155ee92ae6e service neutron] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:29:54.394863 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9979f2d0-d76d-4441-8005-28c4911dc486 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:29:54.394863 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9979f2d0-d76d-4441-8005-28c4911dc486 admin admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:29:54.394863 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9979f2d0-d76d-4441-8005-28c4911dc486 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:29:54.394863 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9979f2d0-d76d-4441-8005-28c4911dc486 admin admin] PATH_INFO: `/v3/roles` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:29:54.395631 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9979f2d0-d76d-4441-8005-28c4911dc486 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:29:54.424438 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9979f2d0-d76d-4441-8005-28c4911dc486 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:29:54.468383 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 717/1433] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Oct 12 02:29:54 2022] GET /identity/v3/roles => generated 1420 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 02:29:54.472598 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241704cf-6a81-47ad-913d-03ac8785a113 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:29:54.489236 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241704cf-6a81-47ad-913d-03ac8785a113 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:29:54.510202 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473714e8-ef5d-40c6-97a4-8a461b2e9571 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:29:54.510852 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473714e8-ef5d-40c6-97a4-8a461b2e9571 admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:29:54.511133 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473714e8-ef5d-40c6-97a4-8a461b2e9571 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:29:54.511408 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473714e8-ef5d-40c6-97a4-8a461b2e9571 admin admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:29:54.512142 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473714e8-ef5d-40c6-97a4-8a461b2e9571 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:29:54.513859 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473714e8-ef5d-40c6-97a4-8a461b2e9571 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:29:54.536437 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 717/1434] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Oct 12 02:29:54 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 02:29:54.537618 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9979f2d0-d76d-4441-8005-28c4911dc486 admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:29:54.559440 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9979f2d0-d76d-4441-8005-28c4911dc486 admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:29:54.576015 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451edc48-a147-4a3c-b386-4b4b9291b58f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:29:54.577853 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451edc48-a147-4a3c-b386-4b4b9291b58f admin admin] REQUEST_METHOD: `PUT` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:29:54.578275 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451edc48-a147-4a3c-b386-4b4b9291b58f admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:29:54.580760 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451edc48-a147-4a3c-b386-4b4b9291b58f admin admin] PATH_INFO: `/v3/projects/14d3b0584fce4d20b07ac969ab848d5f/users/74d3770ca49b4ee8be914da960bcd084/roles/3d75c4d7f1a849b9a771504d1583ab28` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:29:54.619069 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451edc48-a147-4a3c-b386-4b4b9291b58f admin admin] RBAC: Authorizing `identity:create_grant(project_id=14d3b0584fce4d20b07ac969ab848d5f, user_id=74d3770ca49b4ee8be914da960bcd084, role_id=3d75c4d7f1a849b9a771504d1583ab28)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:29:54.637866 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451edc48-a147-4a3c-b386-4b4b9291b58f admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:29:54.710783 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 718/1435] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Oct 12 02:29:54 2022] PUT /identity/v3/projects/14d3b0584fce4d20b07ac969ab848d5f/users/74d3770ca49b4ee8be914da960bcd084/roles/3d75c4d7f1a849b9a771504d1583ab28 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 02:29:54.724129 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1967b09-d9b1-4e14-b5b6-1eacf2c72cb9 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:29:54.724511 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1967b09-d9b1-4e14-b5b6-1eacf2c72cb9 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:29:54.724792 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1967b09-d9b1-4e14-b5b6-1eacf2c72cb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:29:54.788316 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-c1967b09-d9b1-4e14-b5b6-1eacf2c72cb9 None None] MFA Rules not processed for user `74d3770ca49b4ee8be914da960bcd084`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:29:54.801926 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-c1967b09-d9b1-4e14-b5b6-1eacf2c72cb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:29:54.950352 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451edc48-a147-4a3c-b386-4b4b9291b58f admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:29:54.953037 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-451edc48-a147-4a3c-b386-4b4b9291b58f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:29:54.960007 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:DELETE=1,keystone:SELECT=95,keystone:INSERT=4 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:29:55.117680 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 718/1436] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 02:29:54 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 394 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 02:29:55.118569 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1967b09-d9b1-4e14-b5b6-1eacf2c72cb9 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:29:55.254448 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451edc48-a147-4a3c-b386-4b4b9291b58f admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:29:55.291382 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f87af1c-cec7-47b1-82eb-5cfe4d7cce75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:29:55.292220 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f87af1c-cec7-47b1-82eb-5cfe4d7cce75 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:29:55.293892 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f87af1c-cec7-47b1-82eb-5cfe4d7cce75 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:29:55.294191 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f87af1c-cec7-47b1-82eb-5cfe4d7cce75 admin admin] PATH_INFO: `/v3/projects/be232e59a17f46d3bde790b2034b3a14` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:29:55.297875 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f87af1c-cec7-47b1-82eb-5cfe4d7cce75 admin admin] RBAC: Authorizing `identity:delete_project(project_id=be232e59a17f46d3bde790b2034b3a14)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:29:55.320193 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f87af1c-cec7-47b1-82eb-5cfe4d7cce75 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:29:55.469643 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1967b09-d9b1-4e14-b5b6-1eacf2c72cb9 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:29:55.514903 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-7f87af1c-cec7-47b1-82eb-5cfe4d7cce75 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'be232e59a17f46d3bde790b2034b3a14', 'request_id': 'req-7f87af1c-cec7-47b1-82eb-5cfe4d7cce75'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:29:55.529721 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-7f87af1c-cec7-47b1-82eb-5cfe4d7cce75 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'be232e59a17f46d3bde790b2034b3a14', 'request_id': 'req-7f87af1c-cec7-47b1-82eb-5cfe4d7cce75'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:29:55.531562 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=93,keystone:INSERT=1,keystone:DELETE=6 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:29:55.564747 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-7f87af1c-cec7-47b1-82eb-5cfe4d7cce75 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'be232e59a17f46d3bde790b2034b3a14', 'request_id': 'req-7f87af1c-cec7-47b1-82eb-5cfe4d7cce75'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:29:55.602330 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-7f87af1c-cec7-47b1-82eb-5cfe4d7cce75 admin admin] The token cache is being invalidate because project be232e59a17f46d3bde790b2034b3a14 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81361) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 02:29:55.606936 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-7f87af1c-cec7-47b1-82eb-5cfe4d7cce75 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:29:55.610268 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-7f87af1c-cec7-47b1-82eb-5cfe4d7cce75 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:29:55.613581 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 719/1437] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Oct 12 02:29:54 2022] DELETE /identity/v3/projects/be232e59a17f46d3bde790b2034b3a14 => generated 0 bytes in 664 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 02:29:55.617461 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f87af1c-cec7-47b1-82eb-5cfe4d7cce75 admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:29:55.629179 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-7f87af1c-cec7-47b1-82eb-5cfe4d7cce75 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:29:55.713258 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78274f35-0085-42ce-920c-a416a8af3a19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:29:55.713907 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78274f35-0085-42ce-920c-a416a8af3a19 admin admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:29:55.714192 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78274f35-0085-42ce-920c-a416a8af3a19 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:29:55.714482 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78274f35-0085-42ce-920c-a416a8af3a19 admin admin] PATH_INFO: `/v3/projects` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:29:55.718556 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78274f35-0085-42ce-920c-a416a8af3a19 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:29:55.738429 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78274f35-0085-42ce-920c-a416a8af3a19 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:29:55.889618 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 719/1438] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Oct 12 02:29:55 2022] POST /identity/v3/projects => generated 363 bytes in 771 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 02:29:55.895725 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78274f35-0085-42ce-920c-a416a8af3a19 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:29:55.898947 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-78274f35-0085-42ce-920c-a416a8af3a19 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:29:55.948529 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f87af1c-cec7-47b1-82eb-5cfe4d7cce75 admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:29:56.120963 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39915d64-02e6-40fc-ac14-074e19c45e5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:29:56.122348 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39915d64-02e6-40fc-ac14-074e19c45e5b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:29:56.122808 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39915d64-02e6-40fc-ac14-074e19c45e5b admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:29:56.123278 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39915d64-02e6-40fc-ac14-074e19c45e5b admin admin] PATH_INFO: `/v3/users/3f63d9ac0b6c4fe885b82a80e42a6d86` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:29:56.133462 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39915d64-02e6-40fc-ac14-074e19c45e5b admin admin] RBAC: Authorizing `identity:delete_user(user_id=3f63d9ac0b6c4fe885b82a80e42a6d86)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:29:56.148557 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39915d64-02e6-40fc-ac14-074e19c45e5b admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:29:56.245059 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-39915d64-02e6-40fc-ac14-074e19c45e5b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3f63d9ac0b6c4fe885b82a80e42a6d86'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:29:56.261309 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-39915d64-02e6-40fc-ac14-074e19c45e5b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3f63d9ac0b6c4fe885b82a80e42a6d86'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:29:56.327510 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78274f35-0085-42ce-920c-a416a8af3a19 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:29:56.339840 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-39915d64-02e6-40fc-ac14-074e19c45e5b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3f63d9ac0b6c4fe885b82a80e42a6d86'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:29:56.355707 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ed12ab-cf01-4f6f-b975-35353f14bd21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:29:56.361852 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ed12ab-cf01-4f6f-b975-35353f14bd21 admin admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:29:56.362795 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ed12ab-cf01-4f6f-b975-35353f14bd21 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:29:56.364932 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ed12ab-cf01-4f6f-b975-35353f14bd21 admin admin] PATH_INFO: `/v3/users` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:29:56.365758 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ed12ab-cf01-4f6f-b975-35353f14bd21 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:29:56.369804 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-39915d64-02e6-40fc-ac14-074e19c45e5b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3f63d9ac0b6c4fe885b82a80e42a6d86'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:29:56.372086 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ed12ab-cf01-4f6f-b975-35353f14bd21 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:29:56.374999 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-39915d64-02e6-40fc-ac14-074e19c45e5b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3f63d9ac0b6c4fe885b82a80e42a6d86'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:29:56.394379 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 720/1439] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Oct 12 02:29:55 2022] DELETE /identity/v3/users/3f63d9ac0b6c4fe885b82a80e42a6d86 => generated 0 bytes in 777 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 02:29:56.395390 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39915d64-02e6-40fc-ac14-074e19c45e5b admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:29:56.398840 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-39915d64-02e6-40fc-ac14-074e19c45e5b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:29:56.403573 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:29:56.429492 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 720/1440] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Oct 12 02:29:55 2022] POST /identity/v3/users => generated 288 bytes in 534 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 02:29:56.433178 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338aae9e-4fcf-4efe-b8aa-d7f6cc752202 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:29:56.436821 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338aae9e-4fcf-4efe-b8aa-d7f6cc752202 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:29:56.437144 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338aae9e-4fcf-4efe-b8aa-d7f6cc752202 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:29:56.440751 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:29:56.493593 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-338aae9e-4fcf-4efe-b8aa-d7f6cc752202 None None] MFA Rules not processed for user `4f91d4dca41d45ff8b6e96c3594e851b`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:29:56.500412 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-338aae9e-4fcf-4efe-b8aa-d7f6cc752202 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:29:56.651120 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39915d64-02e6-40fc-ac14-074e19c45e5b admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:29:56.667411 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd736b7-ce5e-430e-9432-88c7a7ff53d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:29:56.669071 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd736b7-ce5e-430e-9432-88c7a7ff53d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:29:56.669344 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd736b7-ce5e-430e-9432-88c7a7ff53d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:29:56.669645 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd736b7-ce5e-430e-9432-88c7a7ff53d7 admin admin] PATH_INFO: `/v3/projects/79c50e2493504ba6a18a3ad52e711a6a` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:29:56.670922 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd736b7-ce5e-430e-9432-88c7a7ff53d7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=79c50e2493504ba6a18a3ad52e711a6a)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:29:56.673985 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd736b7-ce5e-430e-9432-88c7a7ff53d7 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:29:56.775144 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 721/1441] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 02:29:56 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 340 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 02:29:56.775144 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338aae9e-4fcf-4efe-b8aa-d7f6cc752202 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:29:56.776927 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-338aae9e-4fcf-4efe-b8aa-d7f6cc752202 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:29:56.796795 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-5fd736b7-ce5e-430e-9432-88c7a7ff53d7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '79c50e2493504ba6a18a3ad52e711a6a', 'request_id': 'req-5fd736b7-ce5e-430e-9432-88c7a7ff53d7'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:29:56.810228 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-5fd736b7-ce5e-430e-9432-88c7a7ff53d7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '79c50e2493504ba6a18a3ad52e711a6a', 'request_id': 'req-5fd736b7-ce5e-430e-9432-88c7a7ff53d7'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:29:56.825192 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-5fd736b7-ce5e-430e-9432-88c7a7ff53d7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '79c50e2493504ba6a18a3ad52e711a6a', 'request_id': 'req-5fd736b7-ce5e-430e-9432-88c7a7ff53d7'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:29:56.827820 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338aae9e-4fcf-4efe-b8aa-d7f6cc752202 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:29:56.860496 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-5fd736b7-ce5e-430e-9432-88c7a7ff53d7 admin admin] The token cache is being invalidate because project 79c50e2493504ba6a18a3ad52e711a6a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81361) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 02:29:56.860496 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-5fd736b7-ce5e-430e-9432-88c7a7ff53d7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:29:56.880999 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-5fd736b7-ce5e-430e-9432-88c7a7ff53d7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:29:56.888952 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 721/1442] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Oct 12 02:29:56 2022] DELETE /identity/v3/projects/79c50e2493504ba6a18a3ad52e711a6a => generated 0 bytes in 491 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 02:29:56.888952 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8deb20-0364-4ef4-a6ac-f2ecedbd099d None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:29:56.888952 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8deb20-0364-4ef4-a6ac-f2ecedbd099d None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:29:56.888952 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8deb20-0364-4ef4-a6ac-f2ecedbd099d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:29:56.969837 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-fd8deb20-0364-4ef4-a6ac-f2ecedbd099d None None] MFA Rules not processed for user `5223b5cab3114e9b9a13c582f8ef8386`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:29:56.971581 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-fd8deb20-0364-4ef4-a6ac-f2ecedbd099d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:29:57.153292 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 722/1443] 10.222.0.27 () {58 vars in 1015 bytes} [Wed Oct 12 02:29:56 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 02:29:57.161702 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f05973d-4144-4059-b3a5-2ef4e734c3b5 None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:29:57.161954 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f05973d-4144-4059-b3a5-2ef4e734c3b5 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:29:57.162255 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f05973d-4144-4059-b3a5-2ef4e734c3b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:29:57.238411 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7537710e-9b2f-4438-b9cd-601d3032e6bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:29:57.239747 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7537710e-9b2f-4438-b9cd-601d3032e6bb admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:29:57.242335 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7537710e-9b2f-4438-b9cd-601d3032e6bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:29:57.242810 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7537710e-9b2f-4438-b9cd-601d3032e6bb admin admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:29:57.244341 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7537710e-9b2f-4438-b9cd-601d3032e6bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:29:57.251219 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7537710e-9b2f-4438-b9cd-601d3032e6bb admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:29:57.256664 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-4f05973d-4144-4059-b3a5-2ef4e734c3b5 None None] MFA Rules not processed for user `a326a5bb7364479382f528a592371656`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:29:57.261355 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-4f05973d-4144-4059-b3a5-2ef4e734c3b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:29:57.292272 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 722/1444] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Oct 12 02:29:56 2022] GET /identity/v3/roles => generated 1420 bytes in 521 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 02:29:57.297031 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7537710e-9b2f-4438-b9cd-601d3032e6bb admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:29:57.300450 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-7537710e-9b2f-4438-b9cd-601d3032e6bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:29:57.301291 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 723/1445] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 02:29:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 02:29:57.310438 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63f4b64-065a-4a17-80c5-b9bd5913efe2 None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:29:57.310722 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63f4b64-065a-4a17-80c5-b9bd5913efe2 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:29:57.311062 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63f4b64-065a-4a17-80c5-b9bd5913efe2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:29:57.342999 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7537710e-9b2f-4438-b9cd-601d3032e6bb admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:29:57.365169 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a35b48-55fc-465d-9b52-cb442f0a9557 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:29:57.367014 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a35b48-55fc-465d-9b52-cb442f0a9557 admin admin] REQUEST_METHOD: `PUT` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:29:57.367997 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a35b48-55fc-465d-9b52-cb442f0a9557 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:29:57.368664 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a35b48-55fc-465d-9b52-cb442f0a9557 admin admin] PATH_INFO: `/v3/projects/d2e11a7790e94138b21e3d4e29bd20e3/users/48c1e0e7f4934f11bb69276a5aec1313/roles/39b1e8108dff402383def3c559f48189` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:29:57.389023 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-d63f4b64-065a-4a17-80c5-b9bd5913efe2 None None] MFA Rules not processed for user `a326a5bb7364479382f528a592371656`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:29:57.391975 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-d63f4b64-065a-4a17-80c5-b9bd5913efe2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:29:57.394315 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a35b48-55fc-465d-9b52-cb442f0a9557 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d2e11a7790e94138b21e3d4e29bd20e3, user_id=48c1e0e7f4934f11bb69276a5aec1313, role_id=39b1e8108dff402383def3c559f48189)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:29:57.398230 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a35b48-55fc-465d-9b52-cb442f0a9557 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:29:57.418742 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 723/1446] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Oct 12 02:29:57 2022] PUT /identity/v3/projects/d2e11a7790e94138b21e3d4e29bd20e3/users/48c1e0e7f4934f11bb69276a5aec1313/roles/39b1e8108dff402383def3c559f48189 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 02:29:57.422956 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a35b48-55fc-465d-9b52-cb442f0a9557 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:29:57.428893 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 724/1447] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 02:29:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 02:29:57.448689 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63f4b64-065a-4a17-80c5-b9bd5913efe2 None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:29:57.487909 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63f4b64-065a-4a17-80c5-b9bd5913efe2 None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:29:57.649730 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:29:57.716880 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a35b48-55fc-465d-9b52-cb442f0a9557 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:29:57.733607 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ff79fd-d2cd-441f-9975-45906ef910c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:29:57.734998 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ff79fd-d2cd-441f-9975-45906ef910c3 admin admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:29:57.735301 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ff79fd-d2cd-441f-9975-45906ef910c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:29:57.735601 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ff79fd-d2cd-441f-9975-45906ef910c3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:29:57.738623 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ff79fd-d2cd-441f-9975-45906ef910c3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 02:29:57.738949 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ff79fd-d2cd-441f-9975-45906ef910c3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:29:57.744242 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4fa5d5-f3b9-412b-883b-6171d7a2ca39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:29:57.745419 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ff79fd-d2cd-441f-9975-45906ef910c3 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:29:57.747731 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4fa5d5-f3b9-412b-883b-6171d7a2ca39 admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:29:57.748136 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4fa5d5-f3b9-412b-883b-6171d7a2ca39 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:29:57.751729 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4fa5d5-f3b9-412b-883b-6171d7a2ca39 admin admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:29:57.759134 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4fa5d5-f3b9-412b-883b-6171d7a2ca39 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:29:57.762879 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4fa5d5-f3b9-412b-883b-6171d7a2ca39 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:29:57.825881 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 725/1448] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Oct 12 02:29:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 396 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 02:29:57.826865 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ff79fd-d2cd-441f-9975-45906ef910c3 admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:29:57.827052 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 724/1449] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Oct 12 02:29:57 2022] GET /identity/v3/roles => generated 1420 bytes in 404 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 02:29:57.830565 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4fa5d5-f3b9-412b-883b-6171d7a2ca39 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:29:57.877109 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4fa5d5-f3b9-412b-883b-6171d7a2ca39 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:29:57.879290 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ff79fd-d2cd-441f-9975-45906ef910c3 admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:29:57.902654 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5295599e-b93f-4283-8b5e-a88eeb9671a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:29:57.905246 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5295599e-b93f-4283-8b5e-a88eeb9671a6 admin admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:29:57.905545 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5295599e-b93f-4283-8b5e-a88eeb9671a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:29:57.909490 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5295599e-b93f-4283-8b5e-a88eeb9671a6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:29:57.910186 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5295599e-b93f-4283-8b5e-a88eeb9671a6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:29:57.918397 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969ef088-8cb2-45dc-8e1a-f384209d7788 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:29:57.918845 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5295599e-b93f-4283-8b5e-a88eeb9671a6 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:29:57.919178 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969ef088-8cb2-45dc-8e1a-f384209d7788 admin admin] REQUEST_METHOD: `PUT` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:29:57.919480 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969ef088-8cb2-45dc-8e1a-f384209d7788 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:29:57.919791 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969ef088-8cb2-45dc-8e1a-f384209d7788 admin admin] PATH_INFO: `/v3/projects/d2e11a7790e94138b21e3d4e29bd20e3/users/48c1e0e7f4934f11bb69276a5aec1313/roles/39b1e8108dff402383def3c559f48189` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:29:57.926938 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969ef088-8cb2-45dc-8e1a-f384209d7788 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d2e11a7790e94138b21e3d4e29bd20e3, user_id=48c1e0e7f4934f11bb69276a5aec1313, role_id=39b1e8108dff402383def3c559f48189)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:29:57.934142 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969ef088-8cb2-45dc-8e1a-f384209d7788 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:29:57.947064 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:29:57.974254 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 726/1450] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Oct 12 02:29:57 2022] PUT /identity/v3/projects/d2e11a7790e94138b21e3d4e29bd20e3/users/48c1e0e7f4934f11bb69276a5aec1313/roles/39b1e8108dff402383def3c559f48189 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 02:29:57.984552 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89680fff-bf85-4747-8a89-a717be895d7a None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:29:57.985298 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89680fff-bf85-4747-8a89-a717be895d7a None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:29:57.987583 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89680fff-bf85-4747-8a89-a717be895d7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:29:58.057858 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 725/1451] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Oct 12 02:29:57 2022] POST /identity/v3/projects => generated 375 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 02:29:58.073990 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5295599e-b93f-4283-8b5e-a88eeb9671a6 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:29:58.141569 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-89680fff-bf85-4747-8a89-a717be895d7a None None] MFA Rules not processed for user `48c1e0e7f4934f11bb69276a5aec1313`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:29:58.143588 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-89680fff-bf85-4747-8a89-a717be895d7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:29:58.238354 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5295599e-b93f-4283-8b5e-a88eeb9671a6 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:29:58.243788 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ce69d8-3265-4f3e-8493-23cd40e8dc26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:29:58.244424 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ce69d8-3265-4f3e-8493-23cd40e8dc26 admin admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:29:58.244733 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ce69d8-3265-4f3e-8493-23cd40e8dc26 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:29:58.245008 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ce69d8-3265-4f3e-8493-23cd40e8dc26 admin admin] PATH_INFO: `/v3/users` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:29:58.245770 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ce69d8-3265-4f3e-8493-23cd40e8dc26 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:29:58.248334 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ce69d8-3265-4f3e-8493-23cd40e8dc26 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:29:58.282151 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 726/1452] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Oct 12 02:29:58 2022] POST /identity/v3/users => generated 288 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 02:29:58.283170 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ce69d8-3265-4f3e-8493-23cd40e8dc26 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:29:58.286218 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-52ce69d8-3265-4f3e-8493-23cd40e8dc26 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:29:58.432951 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 727/1453] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 02:29:57 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 451 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 02:29:58.436269 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89680fff-bf85-4747-8a89-a717be895d7a None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:29:58.482019 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89680fff-bf85-4747-8a89-a717be895d7a None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:29:58.494171 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519b6558-6199-4726-b208-a89c1af52815 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:29:58.501226 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519b6558-6199-4726-b208-a89c1af52815 admin admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:29:58.501491 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519b6558-6199-4726-b208-a89c1af52815 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:29:58.501778 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519b6558-6199-4726-b208-a89c1af52815 admin admin] PATH_INFO: `/v3/roles` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:29:58.502765 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519b6558-6199-4726-b208-a89c1af52815 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:29:58.504502 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519b6558-6199-4726-b208-a89c1af52815 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:29:58.539526 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 728/1454] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Oct 12 02:29:58 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 02:29:58.540519 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519b6558-6199-4726-b208-a89c1af52815 admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:29:58.544603 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-519b6558-6199-4726-b208-a89c1af52815 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:29:58.553967 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ce69d8-3265-4f3e-8493-23cd40e8dc26 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:29:58.569271 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abaac38c-196d-4fb0-b644-696783d69a18 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5223b5cab3114e9b9a13c582f8ef8386', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'beb6def6fcad45959e56425bb8bff4d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:29:58.570085 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abaac38c-196d-4fb0-b644-696783d69a18 service neutron] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:29:58.570242 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abaac38c-196d-4fb0-b644-696783d69a18 service neutron] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:29:58.570520 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abaac38c-196d-4fb0-b644-696783d69a18 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:29:58.594813 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abaac38c-196d-4fb0-b644-696783d69a18 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:29:58.596302 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abaac38c-196d-4fb0-b644-696783d69a18 service neutron] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:29:58.621350 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 727/1455] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 02:29:58 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 02:29:58.622255 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abaac38c-196d-4fb0-b644-696783d69a18 service neutron] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:29:58.681919 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abaac38c-196d-4fb0-b644-696783d69a18 service neutron] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:29:58.691357 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492b16ec-18c7-462f-964e-1d06ae622300 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:29:58.691981 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492b16ec-18c7-462f-964e-1d06ae622300 admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:29:58.692804 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492b16ec-18c7-462f-964e-1d06ae622300 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:29:58.693088 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492b16ec-18c7-462f-964e-1d06ae622300 admin admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:29:58.693916 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492b16ec-18c7-462f-964e-1d06ae622300 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:29:58.695514 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492b16ec-18c7-462f-964e-1d06ae622300 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:29:58.715169 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 728/1456] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Oct 12 02:29:58 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 02:29:58.719063 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492b16ec-18c7-462f-964e-1d06ae622300 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:29:58.731769 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492b16ec-18c7-462f-964e-1d06ae622300 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:29:58.738369 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aece14f7-93db-48c2-b6d4-b6e064daecbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:29:58.739043 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aece14f7-93db-48c2-b6d4-b6e064daecbf admin admin] REQUEST_METHOD: `PUT` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:29:58.739321 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aece14f7-93db-48c2-b6d4-b6e064daecbf admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:29:58.739593 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aece14f7-93db-48c2-b6d4-b6e064daecbf admin admin] PATH_INFO: `/v3/projects/48771975a9a34947bc2c5cf92c5c84f4/users/6811c913ed244889bbbbfb00635a5190/roles/3d75c4d7f1a849b9a771504d1583ab28` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:29:58.746891 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519b6558-6199-4726-b208-a89c1af52815 admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:29:58.771729 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aece14f7-93db-48c2-b6d4-b6e064daecbf admin admin] RBAC: Authorizing `identity:create_grant(project_id=48771975a9a34947bc2c5cf92c5c84f4, user_id=6811c913ed244889bbbbfb00635a5190, role_id=3d75c4d7f1a849b9a771504d1583ab28)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:29:58.771983 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13d9f96-39f5-446a-949c-4a1fc229b961 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ba688e0c4d44d13898539ee886f95fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'beb6def6fcad45959e56425bb8bff4d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:29:58.772871 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13d9f96-39f5-446a-949c-4a1fc229b961 service cinder] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:29:58.774612 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aece14f7-93db-48c2-b6d4-b6e064daecbf admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:29:58.775231 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13d9f96-39f5-446a-949c-4a1fc229b961 service cinder] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:29:58.775625 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13d9f96-39f5-446a-949c-4a1fc229b961 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:29:58.814674 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13d9f96-39f5-446a-949c-4a1fc229b961 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:29:58.821034 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13d9f96-39f5-446a-949c-4a1fc229b961 service cinder] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:29:58.837234 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 729/1457] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Oct 12 02:29:58 2022] PUT /identity/v3/projects/48771975a9a34947bc2c5cf92c5c84f4/users/6811c913ed244889bbbbfb00635a5190/roles/3d75c4d7f1a849b9a771504d1583ab28 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 02:29:58.841140 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8972ce-9328-443f-bd63-e74ac338df42 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:29:58.841433 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8972ce-9328-443f-bd63-e74ac338df42 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:29:58.841709 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8972ce-9328-443f-bd63-e74ac338df42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:29:58.879888 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 729/1458] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 02:29:58 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 02:29:58.919752 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-0f8972ce-9328-443f-bd63-e74ac338df42 None None] MFA Rules not processed for user `6811c913ed244889bbbbfb00635a5190`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:29:58.923388 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-0f8972ce-9328-443f-bd63-e74ac338df42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:29:59.021045 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:29:59.076824 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13d9f96-39f5-446a-949c-4a1fc229b961 service cinder] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:29:59.086880 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13d9f96-39f5-446a-949c-4a1fc229b961 service cinder] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:29:59.134752 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 730/1459] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 02:29:58 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 295 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 02:29:59.226786 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:29:59.286393 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bff056a-3398-460f-93b8-2541f3491bb0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ba688e0c4d44d13898539ee886f95fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'beb6def6fcad45959e56425bb8bff4d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:29:59.287189 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bff056a-3398-460f-93b8-2541f3491bb0 service cinder] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:29:59.287584 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bff056a-3398-460f-93b8-2541f3491bb0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:29:59.287987 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bff056a-3398-460f-93b8-2541f3491bb0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:29:59.294252 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-4bff056a-3398-460f-93b8-2541f3491bb0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:29:59.331480 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8972ce-9328-443f-bd63-e74ac338df42 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:29:59.335468 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-0f8972ce-9328-443f-bd63-e74ac338df42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:29:59.371756 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8972ce-9328-443f-bd63-e74ac338df42 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:29:59.392180 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a858e88-5f17-4958-b6ac-3bca1adf4d54 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ba688e0c4d44d13898539ee886f95fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'beb6def6fcad45959e56425bb8bff4d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:29:59.392394 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a858e88-5f17-4958-b6ac-3bca1adf4d54 service cinder] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:29:59.392699 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a858e88-5f17-4958-b6ac-3bca1adf4d54 service cinder] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:29:59.393180 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a858e88-5f17-4958-b6ac-3bca1adf4d54 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:29:59.426218 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a858e88-5f17-4958-b6ac-3bca1adf4d54 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:29:59.428872 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a858e88-5f17-4958-b6ac-3bca1adf4d54 service cinder] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:29:59.450951 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bff056a-3398-460f-93b8-2541f3491bb0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:29:59.453420 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bff056a-3398-460f-93b8-2541f3491bb0 service cinder] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:29:59.474145 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 730/1460] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 02:29:59 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 12 02:29:59.480549 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 731/1461] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 02:29:59 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 02:30:00.929793 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bff056a-3398-460f-93b8-2541f3491bb0 service cinder] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:30:00.931368 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-4bff056a-3398-460f-93b8-2541f3491bb0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:30:01.233819 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bff056a-3398-460f-93b8-2541f3491bb0 service cinder] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:30:01.253625 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55eaf4a7-0d68-444d-856e-d3a8910e6121 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:30:01.254554 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55eaf4a7-0d68-444d-856e-d3a8910e6121 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:01.254970 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55eaf4a7-0d68-444d-856e-d3a8910e6121 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:01.256188 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55eaf4a7-0d68-444d-856e-d3a8910e6121 admin admin] PATH_INFO: `/v3/projects/63c8324fb15d4b1bb6d17447a5e7638b` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:01.257748 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55eaf4a7-0d68-444d-856e-d3a8910e6121 admin admin] RBAC: Authorizing `identity:delete_project(project_id=63c8324fb15d4b1bb6d17447a5e7638b)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:30:01.264115 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55eaf4a7-0d68-444d-856e-d3a8910e6121 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:30:01.369368 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-55eaf4a7-0d68-444d-856e-d3a8910e6121 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '63c8324fb15d4b1bb6d17447a5e7638b', 'request_id': 'req-55eaf4a7-0d68-444d-856e-d3a8910e6121'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:30:01.382512 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-55eaf4a7-0d68-444d-856e-d3a8910e6121 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '63c8324fb15d4b1bb6d17447a5e7638b', 'request_id': 'req-55eaf4a7-0d68-444d-856e-d3a8910e6121'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:30:01.395908 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-55eaf4a7-0d68-444d-856e-d3a8910e6121 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '63c8324fb15d4b1bb6d17447a5e7638b', 'request_id': 'req-55eaf4a7-0d68-444d-856e-d3a8910e6121'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:30:01.428141 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-55eaf4a7-0d68-444d-856e-d3a8910e6121 admin admin] The token cache is being invalidate because project 63c8324fb15d4b1bb6d17447a5e7638b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81361) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 02:30:01.428141 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-55eaf4a7-0d68-444d-856e-d3a8910e6121 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:30:01.442167 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-55eaf4a7-0d68-444d-856e-d3a8910e6121 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:30:01.445015 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 731/1462] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Oct 12 02:30:00 2022] DELETE /identity/v3/projects/63c8324fb15d4b1bb6d17447a5e7638b => generated 0 bytes in 516 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 02:30:01.449930 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfd38fe-58af-4a1b-82cf-883c0bf93cd8 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:01.450508 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfd38fe-58af-4a1b-82cf-883c0bf93cd8 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:01.450508 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfd38fe-58af-4a1b-82cf-883c0bf93cd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:01.517190 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-9bfd38fe-58af-4a1b-82cf-883c0bf93cd8 None None] MFA Rules not processed for user `a326a5bb7364479382f528a592371656`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:30:01.518507 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-9bfd38fe-58af-4a1b-82cf-883c0bf93cd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:30:01.772235 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 732/1463] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 02:30:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 323 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 02:30:01.776375 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf778f6-c795-4ce3-a22c-097b3e1b6aaf None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:01.776671 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf778f6-c795-4ce3-a22c-097b3e1b6aaf None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:01.777018 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf778f6-c795-4ce3-a22c-097b3e1b6aaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:01.837999 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-edf778f6-c795-4ce3-a22c-097b3e1b6aaf None None] MFA Rules not processed for user `a326a5bb7364479382f528a592371656`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:30:01.839506 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-edf778f6-c795-4ce3-a22c-097b3e1b6aaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:30:01.877062 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 732/1464] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 02:30:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 02:30:01.882390 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfd38fe-58af-4a1b-82cf-883c0bf93cd8 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:30:01.893782 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfd38fe-58af-4a1b-82cf-883c0bf93cd8 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:30:01.916426 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdcc7ec-8540-47cd-a994-e6f37afc1d17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:30:01.922311 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdcc7ec-8540-47cd-a994-e6f37afc1d17 admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:01.922532 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdcc7ec-8540-47cd-a994-e6f37afc1d17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:01.922944 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdcc7ec-8540-47cd-a994-e6f37afc1d17 admin admin] PATH_INFO: `/v3/domains` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:01.923469 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cdcc7ec-8540-47cd-a994-e6f37afc1d17 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 02:30:01.923908 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cdcc7ec-8540-47cd-a994-e6f37afc1d17 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:30:01.941564 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cdcc7ec-8540-47cd-a994-e6f37afc1d17 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:30:02.000283 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 733/1465] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Oct 12 02:30:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 02:30:02.004315 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf778f6-c795-4ce3-a22c-097b3e1b6aaf None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:30:02.019190 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf778f6-c795-4ce3-a22c-097b3e1b6aaf None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:30:02.037229 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfc03aa-3b65-428f-9550-8cc50b94c6d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:30:02.046865 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfc03aa-3b65-428f-9550-8cc50b94c6d3 admin admin] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:02.047261 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfc03aa-3b65-428f-9550-8cc50b94c6d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:02.048125 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfc03aa-3b65-428f-9550-8cc50b94c6d3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:02.049162 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bfc03aa-3b65-428f-9550-8cc50b94c6d3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:30:02.053789 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bfc03aa-3b65-428f-9550-8cc50b94c6d3 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:30:02.142479 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:30:02.185129 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 733/1466] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Oct 12 02:30:02 2022] POST /identity/v3/projects => generated 391 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 02:30:02.189348 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdcc7ec-8540-47cd-a994-e6f37afc1d17 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:30:02.205900 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdcc7ec-8540-47cd-a994-e6f37afc1d17 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:30:02.544379 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9292d0-030d-4c42-8d5d-2ce4cbc6be50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:30:02.545215 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9292d0-030d-4c42-8d5d-2ce4cbc6be50 admin admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:02.545507 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9292d0-030d-4c42-8d5d-2ce4cbc6be50 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:02.546574 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9292d0-030d-4c42-8d5d-2ce4cbc6be50 admin admin] PATH_INFO: `/v3/users` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:02.548281 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9292d0-030d-4c42-8d5d-2ce4cbc6be50 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:30:02.555503 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9292d0-030d-4c42-8d5d-2ce4cbc6be50 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:30:02.630722 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 734/1467] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Oct 12 02:30:02 2022] POST /identity/v3/users => generated 296 bytes in 442 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 02:30:02.633479 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfc03aa-3b65-428f-9550-8cc50b94c6d3 admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:30:02.656355 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfc03aa-3b65-428f-9550-8cc50b94c6d3 admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:30:02.693553 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4211242-67bf-4fc3-81ea-ab278bcda3e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:30:02.694310 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4211242-67bf-4fc3-81ea-ab278bcda3e4 admin admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:02.699828 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4211242-67bf-4fc3-81ea-ab278bcda3e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:02.700277 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4211242-67bf-4fc3-81ea-ab278bcda3e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:02.702611 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4211242-67bf-4fc3-81ea-ab278bcda3e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:30:02.704647 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4211242-67bf-4fc3-81ea-ab278bcda3e4 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:30:02.761960 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9292d0-030d-4c42-8d5d-2ce4cbc6be50 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:30:02.771913 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 734/1468] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Oct 12 02:30:02 2022] GET /identity/v3/roles => generated 1420 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 02:30:02.804079 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9292d0-030d-4c42-8d5d-2ce4cbc6be50 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:30:02.840901 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8328cbc5-56a0-4a37-ba2b-0e441ababadc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:30:02.842276 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8328cbc5-56a0-4a37-ba2b-0e441ababadc admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:02.844060 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8328cbc5-56a0-4a37-ba2b-0e441ababadc admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:02.845428 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8328cbc5-56a0-4a37-ba2b-0e441ababadc admin admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:02.848953 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8328cbc5-56a0-4a37-ba2b-0e441ababadc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:30:02.855245 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8328cbc5-56a0-4a37-ba2b-0e441ababadc admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:30:02.933995 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 735/1469] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Oct 12 02:30:02 2022] GET /identity/v3/roles => generated 1420 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 02:30:02.937035 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4211242-67bf-4fc3-81ea-ab278bcda3e4 admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:30:02.957242 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4211242-67bf-4fc3-81ea-ab278bcda3e4 admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:30:02.985709 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b63a63-c363-49e1-b566-b16f6b9493eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:30:02.992019 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b63a63-c363-49e1-b566-b16f6b9493eb admin admin] REQUEST_METHOD: `PUT` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:02.992390 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b63a63-c363-49e1-b566-b16f6b9493eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:02.993048 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b63a63-c363-49e1-b566-b16f6b9493eb admin admin] PATH_INFO: `/v3/projects/542a276216784f8a911232db5fc62bb3/users/b2221f8b58ac4636b8d8e64a6b6c99d8/roles/3d75c4d7f1a849b9a771504d1583ab28` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:03.060321 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b63a63-c363-49e1-b566-b16f6b9493eb admin admin] RBAC: Authorizing `identity:create_grant(project_id=542a276216784f8a911232db5fc62bb3, user_id=b2221f8b58ac4636b8d8e64a6b6c99d8, role_id=3d75c4d7f1a849b9a771504d1583ab28)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:30:03.066196 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b63a63-c363-49e1-b566-b16f6b9493eb admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:30:03.112771 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 735/1470] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Oct 12 02:30:02 2022] PUT /identity/v3/projects/542a276216784f8a911232db5fc62bb3/users/b2221f8b58ac4636b8d8e64a6b6c99d8/roles/3d75c4d7f1a849b9a771504d1583ab28 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 02:30:03.123646 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8640e9c6-1eae-49c5-a55f-abd6d313a19a None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:03.125270 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8640e9c6-1eae-49c5-a55f-abd6d313a19a None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:03.125867 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8640e9c6-1eae-49c5-a55f-abd6d313a19a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:03.175804 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b63a63-c363-49e1-b566-b16f6b9493eb admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:30:03.177583 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-29b63a63-c363-49e1-b566-b16f6b9493eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:30:03.209252 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-8640e9c6-1eae-49c5-a55f-abd6d313a19a None None] MFA Rules not processed for user `b2221f8b58ac4636b8d8e64a6b6c99d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:30:03.211442 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-8640e9c6-1eae-49c5-a55f-abd6d313a19a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:30:03.247918 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:30:03.502004 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b63a63-c363-49e1-b566-b16f6b9493eb admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:30:03.505889 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 736/1471] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 02:30:03 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 382 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 02:30:03.507615 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8640e9c6-1eae-49c5-a55f-abd6d313a19a None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:30:03.537795 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d9689a-1a61-4952-8b2f-af5e71011d30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:30:03.539386 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d9689a-1a61-4952-8b2f-af5e71011d30 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:03.539781 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8640e9c6-1eae-49c5-a55f-abd6d313a19a None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:30:03.544369 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d9689a-1a61-4952-8b2f-af5e71011d30 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:03.546759 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d9689a-1a61-4952-8b2f-af5e71011d30 admin admin] PATH_INFO: `/v3/users/74d3770ca49b4ee8be914da960bcd084` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:03.556910 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d9689a-1a61-4952-8b2f-af5e71011d30 admin admin] RBAC: Authorizing `identity:delete_user(user_id=74d3770ca49b4ee8be914da960bcd084)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:30:03.559456 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82767119-1985-45bd-b739-b84f7c2beda2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:30:03.562608 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82767119-1985-45bd-b739-b84f7c2beda2 admin admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:03.563514 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82767119-1985-45bd-b739-b84f7c2beda2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:03.564068 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82767119-1985-45bd-b739-b84f7c2beda2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:03.567285 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82767119-1985-45bd-b739-b84f7c2beda2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:30:03.568053 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d9689a-1a61-4952-8b2f-af5e71011d30 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:30:03.573115 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82767119-1985-45bd-b739-b84f7c2beda2 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:30:03.693409 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 737/1472] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Oct 12 02:30:03 2022] POST /identity/v3/projects => generated 393 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 02:30:03.697357 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82767119-1985-45bd-b739-b84f7c2beda2 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:30:03.759907 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-d0d9689a-1a61-4952-8b2f-af5e71011d30 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '74d3770ca49b4ee8be914da960bcd084'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:30:03.783630 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-d0d9689a-1a61-4952-8b2f-af5e71011d30 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '74d3770ca49b4ee8be914da960bcd084'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:30:03.843836 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-d0d9689a-1a61-4952-8b2f-af5e71011d30 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '74d3770ca49b4ee8be914da960bcd084'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:30:03.872591 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-d0d9689a-1a61-4952-8b2f-af5e71011d30 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '74d3770ca49b4ee8be914da960bcd084'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:30:03.874946 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-d0d9689a-1a61-4952-8b2f-af5e71011d30 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '74d3770ca49b4ee8be914da960bcd084'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:30:03.906872 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 736/1473] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Oct 12 02:30:03 2022] DELETE /identity/v3/users/74d3770ca49b4ee8be914da960bcd084 => generated 0 bytes in 728 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 02:30:03.909759 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698fca4c-82fb-4ba9-b742-77f89491aa56 None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:03.910772 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698fca4c-82fb-4ba9-b742-77f89491aa56 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:03.911067 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698fca4c-82fb-4ba9-b742-77f89491aa56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:03.986392 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82767119-1985-45bd-b739-b84f7c2beda2 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:30:04.010346 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-698fca4c-82fb-4ba9-b742-77f89491aa56 None None] MFA Rules not processed for user `a326a5bb7364479382f528a592371656`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:30:04.011890 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-698fca4c-82fb-4ba9-b742-77f89491aa56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:30:04.146983 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:INSERT=3,keystone:SELECT=87,keystone:DELETE=10 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:30:04.204839 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de0b35e-db00-466b-9157-cf0a3877b133 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:30:04.211289 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de0b35e-db00-466b-9157-cf0a3877b133 admin admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:04.212205 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de0b35e-db00-466b-9157-cf0a3877b133 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:04.219864 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de0b35e-db00-466b-9157-cf0a3877b133 admin admin] PATH_INFO: `/v3/users` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:04.220797 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de0b35e-db00-466b-9157-cf0a3877b133 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:30:04.222963 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de0b35e-db00-466b-9157-cf0a3877b133 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:30:04.255155 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 737/1474] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 02:30:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 347 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 02:30:04.278903 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 738/1475] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Oct 12 02:30:03 2022] POST /identity/v3/users => generated 303 bytes in 582 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 02:30:04.283753 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698fca4c-82fb-4ba9-b742-77f89491aa56 None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:30:04.285722 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-698fca4c-82fb-4ba9-b742-77f89491aa56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:30:04.307584 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698fca4c-82fb-4ba9-b742-77f89491aa56 None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:30:04.309602 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de0b35e-db00-466b-9157-cf0a3877b133 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:30:04.312185 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-0de0b35e-db00-466b-9157-cf0a3877b133 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:30:04.315995 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41a7e05-c4af-419e-9510-77a712a23ba1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:30:04.316767 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41a7e05-c4af-419e-9510-77a712a23ba1 admin admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:04.317055 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41a7e05-c4af-419e-9510-77a712a23ba1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:04.317330 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41a7e05-c4af-419e-9510-77a712a23ba1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:04.318173 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41a7e05-c4af-419e-9510-77a712a23ba1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:30:04.320100 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41a7e05-c4af-419e-9510-77a712a23ba1 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:30:04.340893 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 738/1476] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Oct 12 02:30:04 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 12 02:30:04.345862 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41a7e05-c4af-419e-9510-77a712a23ba1 admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:30:04.361149 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41a7e05-c4af-419e-9510-77a712a23ba1 admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:30:04.367206 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d295c7-ddc7-49e1-bf3b-b10adeb64cf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:30:04.367888 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d295c7-ddc7-49e1-bf3b-b10adeb64cf5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:04.368172 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d295c7-ddc7-49e1-bf3b-b10adeb64cf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:04.368542 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d295c7-ddc7-49e1-bf3b-b10adeb64cf5 admin admin] PATH_INFO: `/v3/projects/8e9e06ba48a24cc7930bf37c3cb87304/users/3bb834cf26dc4b5ea06444f927d583fc/roles/39b1e8108dff402383def3c559f48189` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:04.385159 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:30:04.401648 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d295c7-ddc7-49e1-bf3b-b10adeb64cf5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e9e06ba48a24cc7930bf37c3cb87304, user_id=3bb834cf26dc4b5ea06444f927d583fc, role_id=39b1e8108dff402383def3c559f48189)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:30:04.410400 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d295c7-ddc7-49e1-bf3b-b10adeb64cf5 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:30:04.445031 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 739/1477] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Oct 12 02:30:04 2022] PUT /identity/v3/projects/8e9e06ba48a24cc7930bf37c3cb87304/users/3bb834cf26dc4b5ea06444f927d583fc/roles/39b1e8108dff402383def3c559f48189 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 02:30:04.449121 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d295c7-ddc7-49e1-bf3b-b10adeb64cf5 admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:30:04.503080 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de0b35e-db00-466b-9157-cf0a3877b133 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:30:04.611363 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d295c7-ddc7-49e1-bf3b-b10adeb64cf5 admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:30:04.623148 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72ffcca-ccd8-4303-975f-c42a4433b2ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:30:04.624781 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72ffcca-ccd8-4303-975f-c42a4433b2ea admin admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:04.625273 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72ffcca-ccd8-4303-975f-c42a4433b2ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:04.626053 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72ffcca-ccd8-4303-975f-c42a4433b2ea admin admin] PATH_INFO: `/v3/roles` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:04.627176 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72ffcca-ccd8-4303-975f-c42a4433b2ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:30:04.629757 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72ffcca-ccd8-4303-975f-c42a4433b2ea admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:30:04.672682 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a7e792-7967-4310-b5a5-ec91c79bca60 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5223b5cab3114e9b9a13c582f8ef8386', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'beb6def6fcad45959e56425bb8bff4d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:30:04.673723 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a7e792-7967-4310-b5a5-ec91c79bca60 service neutron] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:04.676357 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a7e792-7967-4310-b5a5-ec91c79bca60 service neutron] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:04.676697 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a7e792-7967-4310-b5a5-ec91c79bca60 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:04.682958 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 740/1478] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Oct 12 02:30:04 2022] GET /identity/v3/roles => generated 1420 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 02:30:04.684872 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72ffcca-ccd8-4303-975f-c42a4433b2ea admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:30:04.705917 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a7e792-7967-4310-b5a5-ec91c79bca60 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:30:04.710351 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a7e792-7967-4310-b5a5-ec91c79bca60 service neutron] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:30:04.735664 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72ffcca-ccd8-4303-975f-c42a4433b2ea admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:30:04.742324 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 739/1479] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 02:30:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 433 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 12 02:30:04.763473 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce87610-decc-4b37-bf69-cd2dc95960ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:30:04.765645 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce87610-decc-4b37-bf69-cd2dc95960ba admin admin] REQUEST_METHOD: `PUT` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:04.766183 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce87610-decc-4b37-bf69-cd2dc95960ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:04.766592 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce87610-decc-4b37-bf69-cd2dc95960ba admin admin] PATH_INFO: `/v3/projects/8e9e06ba48a24cc7930bf37c3cb87304/users/3bb834cf26dc4b5ea06444f927d583fc/roles/39b1e8108dff402383def3c559f48189` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:04.781518 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce87610-decc-4b37-bf69-cd2dc95960ba admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e9e06ba48a24cc7930bf37c3cb87304, user_id=3bb834cf26dc4b5ea06444f927d583fc, role_id=39b1e8108dff402383def3c559f48189)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:30:04.795692 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce87610-decc-4b37-bf69-cd2dc95960ba admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:30:04.821200 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 741/1480] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Oct 12 02:30:04 2022] PUT /identity/v3/projects/8e9e06ba48a24cc7930bf37c3cb87304/users/3bb834cf26dc4b5ea06444f927d583fc/roles/39b1e8108dff402383def3c559f48189 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 02:30:04.835929 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578523c8-4a3e-447b-9112-af8a82435b06 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:04.836407 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578523c8-4a3e-447b-9112-af8a82435b06 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:04.837099 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578523c8-4a3e-447b-9112-af8a82435b06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:04.898575 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-578523c8-4a3e-447b-9112-af8a82435b06 None None] MFA Rules not processed for user `3bb834cf26dc4b5ea06444f927d583fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:30:04.900169 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-578523c8-4a3e-447b-9112-af8a82435b06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:30:05.131894 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 740/1481] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 02:30:04 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 298 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 02:30:05.179390 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce87610-decc-4b37-bf69-cd2dc95960ba admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:30:05.182076 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-dce87610-decc-4b37-bf69-cd2dc95960ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:30:05.376219 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce87610-decc-4b37-bf69-cd2dc95960ba admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:30:05.385902 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d507990f-1092-45ee-9e59-1dfad359bf05 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ba688e0c4d44d13898539ee886f95fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'beb6def6fcad45959e56425bb8bff4d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:30:05.386112 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d507990f-1092-45ee-9e59-1dfad359bf05 service cinder] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:05.386356 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d507990f-1092-45ee-9e59-1dfad359bf05 service cinder] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:05.386649 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d507990f-1092-45ee-9e59-1dfad359bf05 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:05.453291 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d507990f-1092-45ee-9e59-1dfad359bf05 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:30:05.457783 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d507990f-1092-45ee-9e59-1dfad359bf05 service cinder] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:30:05.476102 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce1aca1-583d-4504-a686-c4afb3e3d28c None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:05.476775 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce1aca1-583d-4504-a686-c4afb3e3d28c None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:05.477260 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce1aca1-583d-4504-a686-c4afb3e3d28c None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:05.477683 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 742/1482] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 02:30:05 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 02:30:05.479809 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 741/1483] 10.222.0.18 () {54 vars in 921 bytes} [Wed Oct 12 02:30:05 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 02:30:05.640187 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d507990f-1092-45ee-9e59-1dfad359bf05 service cinder] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:30:05.652873 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d507990f-1092-45ee-9e59-1dfad359bf05 service cinder] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:30:05.674996 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3edbaf-9f87-42e6-b9da-156d856e38d1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ba688e0c4d44d13898539ee886f95fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'beb6def6fcad45959e56425bb8bff4d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:30:05.691581 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3edbaf-9f87-42e6-b9da-156d856e38d1 service cinder] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:05.691798 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3edbaf-9f87-42e6-b9da-156d856e38d1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:05.692047 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3edbaf-9f87-42e6-b9da-156d856e38d1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:05.703037 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-8c3edbaf-9f87-42e6-b9da-156d856e38d1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:30:05.873224 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:30:05.927939 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a18a77-70cf-49d2-8af3-d30c76e04c75 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:05.928538 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a18a77-70cf-49d2-8af3-d30c76e04c75 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:05.928744 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a18a77-70cf-49d2-8af3-d30c76e04c75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:05.967046 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-f0a18a77-70cf-49d2-8af3-d30c76e04c75 None None] MFA Rules not processed for user `f2fca96c111b45b795fb757f77908ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:30:05.973256 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-f0a18a77-70cf-49d2-8af3-d30c76e04c75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:30:05.995122 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3edbaf-9f87-42e6-b9da-156d856e38d1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:30:05.996665 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3edbaf-9f87-42e6-b9da-156d856e38d1 service cinder] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:30:06.034713 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 743/1484] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 02:30:05 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 02:30:06.228082 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 742/1485] 10.222.0.18 () {58 vars in 1018 bytes} [Wed Oct 12 02:30:05 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 301 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 02:30:06.509378 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8983d5ef-0181-446f-80e1-9bfd27c87db8 None None] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:06.510739 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8983d5ef-0181-446f-80e1-9bfd27c87db8 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:06.512074 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8983d5ef-0181-446f-80e1-9bfd27c87db8 None None] PATH_INFO: `/` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:06.514171 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 744/1486] 10.222.0.18 () {54 vars in 921 bytes} [Wed Oct 12 02:30:06 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 02:30:06.599937 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6db0e27-6ca4-4054-96ff-0258e0a35536 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:06.600371 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6db0e27-6ca4-4054-96ff-0258e0a35536 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:06.600682 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6db0e27-6ca4-4054-96ff-0258e0a35536 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:06.620197 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:30:06.650341 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-e6db0e27-6ca4-4054-96ff-0258e0a35536 None None] MFA Rules not processed for user `f2fca96c111b45b795fb757f77908ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:30:06.654516 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-e6db0e27-6ca4-4054-96ff-0258e0a35536 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:30:06.745059 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 743/1487] 10.222.0.18 () {58 vars in 1018 bytes} [Wed Oct 12 02:30:06 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 02:30:06.745286 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8983d5ef-0181-446f-80e1-9bfd27c87db8 None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:30:06.747262 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-8983d5ef-0181-446f-80e1-9bfd27c87db8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:30:06.801850 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8983d5ef-0181-446f-80e1-9bfd27c87db8 None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:30:06.809209 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523b8e37-d7f3-43c8-9d3b-616b156e9a18 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fca96c111b45b795fb757f77908ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'beb6def6fcad45959e56425bb8bff4d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:30:06.809869 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523b8e37-d7f3-43c8-9d3b-616b156e9a18 service nova] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:06.810297 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523b8e37-d7f3-43c8-9d3b-616b156e9a18 service nova] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:06.810572 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523b8e37-d7f3-43c8-9d3b-616b156e9a18 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:06.825393 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523b8e37-d7f3-43c8-9d3b-616b156e9a18 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:30:06.827455 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523b8e37-d7f3-43c8-9d3b-616b156e9a18 service nova] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:30:06.894500 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 745/1488] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 02:30:06 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 12 02:30:07.289664 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6db0e27-6ca4-4054-96ff-0258e0a35536 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:30:07.291482 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-e6db0e27-6ca4-4054-96ff-0258e0a35536 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:30:07.315526 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6db0e27-6ca4-4054-96ff-0258e0a35536 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:30:07.346431 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b47895-1ede-413e-883a-0ae6c7b92be7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fca96c111b45b795fb757f77908ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'beb6def6fcad45959e56425bb8bff4d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:30:07.347055 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b47895-1ede-413e-883a-0ae6c7b92be7 service nova] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:07.347420 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b47895-1ede-413e-883a-0ae6c7b92be7 service nova] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:07.347588 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b47895-1ede-413e-883a-0ae6c7b92be7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:07.371052 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b47895-1ede-413e-883a-0ae6c7b92be7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:30:07.372668 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b47895-1ede-413e-883a-0ae6c7b92be7 service nova] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:30:07.404742 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 744/1489] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 02:30:07 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 02:30:07.531008 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523b8e37-d7f3-43c8-9d3b-616b156e9a18 service nova] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:30:07.537052 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-523b8e37-d7f3-43c8-9d3b-616b156e9a18 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:30:07.692090 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523b8e37-d7f3-43c8-9d3b-616b156e9a18 service nova] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:30:07.713996 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1998921a-21ee-4bb7-87a9-e5558210791a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:30:07.713996 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1998921a-21ee-4bb7-87a9-e5558210791a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:07.713996 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1998921a-21ee-4bb7-87a9-e5558210791a admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:07.714254 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1998921a-21ee-4bb7-87a9-e5558210791a admin admin] PATH_INFO: `/v3/projects/14d3b0584fce4d20b07ac969ab848d5f` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:07.717512 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1998921a-21ee-4bb7-87a9-e5558210791a admin admin] RBAC: Authorizing `identity:delete_project(project_id=14d3b0584fce4d20b07ac969ab848d5f)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:30:07.722872 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1998921a-21ee-4bb7-87a9-e5558210791a admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:30:07.805920 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-1998921a-21ee-4bb7-87a9-e5558210791a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '14d3b0584fce4d20b07ac969ab848d5f', 'request_id': 'req-1998921a-21ee-4bb7-87a9-e5558210791a'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:30:07.815838 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-1998921a-21ee-4bb7-87a9-e5558210791a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '14d3b0584fce4d20b07ac969ab848d5f', 'request_id': 'req-1998921a-21ee-4bb7-87a9-e5558210791a'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:30:07.823483 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-1998921a-21ee-4bb7-87a9-e5558210791a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '14d3b0584fce4d20b07ac969ab848d5f', 'request_id': 'req-1998921a-21ee-4bb7-87a9-e5558210791a'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:30:07.837718 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-1998921a-21ee-4bb7-87a9-e5558210791a admin admin] The token cache is being invalidate because project 14d3b0584fce4d20b07ac969ab848d5f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81361) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 02:30:07.838094 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-1998921a-21ee-4bb7-87a9-e5558210791a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:30:07.838778 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-1998921a-21ee-4bb7-87a9-e5558210791a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:30:07.840641 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 746/1490] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Oct 12 02:30:07 2022] DELETE /identity/v3/projects/14d3b0584fce4d20b07ac969ab848d5f => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 02:30:07.844717 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b47895-1ede-413e-883a-0ae6c7b92be7 service nova] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:30:07.855907 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b47895-1ede-413e-883a-0ae6c7b92be7 service nova] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:30:08.058845 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f61ec1-b59f-4e77-b560-b645e48cd370 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:30:08.060448 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f61ec1-b59f-4e77-b560-b645e48cd370 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:08.060962 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f61ec1-b59f-4e77-b560-b645e48cd370 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:08.062057 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f61ec1-b59f-4e77-b560-b645e48cd370 admin admin] PATH_INFO: `/v3/users/48c1e0e7f4934f11bb69276a5aec1313` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:08.064829 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f61ec1-b59f-4e77-b560-b645e48cd370 admin admin] RBAC: Authorizing `identity:delete_user(user_id=48c1e0e7f4934f11bb69276a5aec1313)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:30:08.066898 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f61ec1-b59f-4e77-b560-b645e48cd370 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:30:08.145608 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-f3f61ec1-b59f-4e77-b560-b645e48cd370 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '48c1e0e7f4934f11bb69276a5aec1313'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:30:08.160658 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-f3f61ec1-b59f-4e77-b560-b645e48cd370 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '48c1e0e7f4934f11bb69276a5aec1313'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:30:08.183309 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-f3f61ec1-b59f-4e77-b560-b645e48cd370 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '48c1e0e7f4934f11bb69276a5aec1313'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:30:08.212972 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-f3f61ec1-b59f-4e77-b560-b645e48cd370 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '48c1e0e7f4934f11bb69276a5aec1313'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:30:08.214275 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-f3f61ec1-b59f-4e77-b560-b645e48cd370 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '48c1e0e7f4934f11bb69276a5aec1313'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:30:08.231009 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 745/1491] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Oct 12 02:30:07 2022] DELETE /identity/v3/users/48c1e0e7f4934f11bb69276a5aec1313 => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 02:30:08.905959 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1998921a-21ee-4bb7-87a9-e5558210791a admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:30:08.908381 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-1998921a-21ee-4bb7-87a9-e5558210791a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:30:08.947049 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1998921a-21ee-4bb7-87a9-e5558210791a admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:30:09.057928 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:30:09.086466 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31574be2-b3f5-45fe-85fd-396d9016444b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:30:09.087920 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31574be2-b3f5-45fe-85fd-396d9016444b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:09.088076 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31574be2-b3f5-45fe-85fd-396d9016444b admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:09.088627 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31574be2-b3f5-45fe-85fd-396d9016444b admin admin] PATH_INFO: `/v3/projects/d2e11a7790e94138b21e3d4e29bd20e3` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:09.090625 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31574be2-b3f5-45fe-85fd-396d9016444b admin admin] RBAC: Authorizing `identity:delete_project(project_id=d2e11a7790e94138b21e3d4e29bd20e3)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:30:09.093682 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31574be2-b3f5-45fe-85fd-396d9016444b admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:30:09.195535 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-31574be2-b3f5-45fe-85fd-396d9016444b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd2e11a7790e94138b21e3d4e29bd20e3', 'request_id': 'req-31574be2-b3f5-45fe-85fd-396d9016444b'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:30:09.210676 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-31574be2-b3f5-45fe-85fd-396d9016444b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd2e11a7790e94138b21e3d4e29bd20e3', 'request_id': 'req-31574be2-b3f5-45fe-85fd-396d9016444b'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:30:09.230081 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-31574be2-b3f5-45fe-85fd-396d9016444b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd2e11a7790e94138b21e3d4e29bd20e3', 'request_id': 'req-31574be2-b3f5-45fe-85fd-396d9016444b'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:30:09.258815 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-31574be2-b3f5-45fe-85fd-396d9016444b admin admin] The token cache is being invalidate because project d2e11a7790e94138b21e3d4e29bd20e3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81361) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 02:30:09.259114 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-31574be2-b3f5-45fe-85fd-396d9016444b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:30:09.259867 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-31574be2-b3f5-45fe-85fd-396d9016444b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:30:09.261911 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 747/1492] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Oct 12 02:30:08 2022] DELETE /identity/v3/projects/d2e11a7790e94138b21e3d4e29bd20e3 => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 02:30:09.268610 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55186d33-095c-4694-80fd-602ce6c8405b None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:09.269452 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55186d33-095c-4694-80fd-602ce6c8405b None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:09.269921 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55186d33-095c-4694-80fd-602ce6c8405b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:09.304800 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-55186d33-095c-4694-80fd-602ce6c8405b None None] MFA Rules not processed for user `a326a5bb7364479382f528a592371656`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:30:09.306890 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-55186d33-095c-4694-80fd-602ce6c8405b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:30:09.468755 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 746/1493] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 02:30:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 02:30:09.478930 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fea41be-7f59-4f7d-bfe6-655fa799ae0b None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:09.480492 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fea41be-7f59-4f7d-bfe6-655fa799ae0b None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:09.481148 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fea41be-7f59-4f7d-bfe6-655fa799ae0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:09.559593 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-6fea41be-7f59-4f7d-bfe6-655fa799ae0b None None] MFA Rules not processed for user `a326a5bb7364479382f528a592371656`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:30:09.561161 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-6fea41be-7f59-4f7d-bfe6-655fa799ae0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:30:09.571852 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 748/1494] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 02:30:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 02:30:09.578283 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55186d33-095c-4694-80fd-602ce6c8405b None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:30:09.590215 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:30:09.595744 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55186d33-095c-4694-80fd-602ce6c8405b None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:30:09.605770 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94b2fc0-dbdb-4882-b5c9-b9b0e2047b42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:30:09.606746 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94b2fc0-dbdb-4882-b5c9-b9b0e2047b42 admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:09.607276 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94b2fc0-dbdb-4882-b5c9-b9b0e2047b42 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:09.607999 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94b2fc0-dbdb-4882-b5c9-b9b0e2047b42 admin admin] PATH_INFO: `/v3/domains` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:09.609838 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94b2fc0-dbdb-4882-b5c9-b9b0e2047b42 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 02:30:09.610679 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94b2fc0-dbdb-4882-b5c9-b9b0e2047b42 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:30:09.613782 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94b2fc0-dbdb-4882-b5c9-b9b0e2047b42 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:30:09.628849 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 747/1495] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Oct 12 02:30:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 02:30:09.633334 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fea41be-7f59-4f7d-bfe6-655fa799ae0b None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:30:09.644747 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fea41be-7f59-4f7d-bfe6-655fa799ae0b None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:30:09.672295 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8fb313-33a3-4b80-8272-782f9f16075c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:30:09.679388 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8fb313-33a3-4b80-8272-782f9f16075c admin admin] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:09.680656 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8fb313-33a3-4b80-8272-782f9f16075c admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:09.681553 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8fb313-33a3-4b80-8272-782f9f16075c admin admin] PATH_INFO: `/v3/projects` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:09.685071 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8fb313-33a3-4b80-8272-782f9f16075c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:30:09.691961 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8fb313-33a3-4b80-8272-782f9f16075c admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:30:09.758786 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 749/1496] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Oct 12 02:30:09 2022] POST /identity/v3/projects => generated 367 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 02:30:09.763220 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94b2fc0-dbdb-4882-b5c9-b9b0e2047b42 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:30:09.777461 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94b2fc0-dbdb-4882-b5c9-b9b0e2047b42 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:30:09.866264 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbd0e9b-321f-4f7e-a86e-31b34665cf5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:30:09.867126 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbd0e9b-321f-4f7e-a86e-31b34665cf5a admin admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:09.867652 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbd0e9b-321f-4f7e-a86e-31b34665cf5a admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:09.868181 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbd0e9b-321f-4f7e-a86e-31b34665cf5a admin admin] PATH_INFO: `/v3/users` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:09.869062 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbd0e9b-321f-4f7e-a86e-31b34665cf5a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:30:09.871496 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbd0e9b-321f-4f7e-a86e-31b34665cf5a admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:30:09.896831 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 748/1497] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Oct 12 02:30:09 2022] POST /identity/v3/users => generated 284 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 02:30:09.900907 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8fb313-33a3-4b80-8272-782f9f16075c admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:30:09.911617 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8fb313-33a3-4b80-8272-782f9f16075c admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:30:09.916455 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bef3664-a560-420b-a44c-6691df495a29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:30:09.917284 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bef3664-a560-420b-a44c-6691df495a29 admin admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:09.917669 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bef3664-a560-420b-a44c-6691df495a29 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:09.918076 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bef3664-a560-420b-a44c-6691df495a29 admin admin] PATH_INFO: `/v3/roles` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:09.918836 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bef3664-a560-420b-a44c-6691df495a29 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:30:09.920696 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bef3664-a560-420b-a44c-6691df495a29 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:30:09.931735 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 750/1498] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Oct 12 02:30:09 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 12 02:30:09.935791 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbd0e9b-321f-4f7e-a86e-31b34665cf5a admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:30:09.947838 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbd0e9b-321f-4f7e-a86e-31b34665cf5a admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:30:09.953756 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b7fc49-d29c-4c74-9a79-8d965faec3ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:30:09.954456 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b7fc49-d29c-4c74-9a79-8d965faec3ff admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:09.954973 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b7fc49-d29c-4c74-9a79-8d965faec3ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:09.955323 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b7fc49-d29c-4c74-9a79-8d965faec3ff admin admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:09.956050 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b7fc49-d29c-4c74-9a79-8d965faec3ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:30:09.957964 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b7fc49-d29c-4c74-9a79-8d965faec3ff admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:30:09.969876 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 749/1499] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Oct 12 02:30:09 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 02:30:09.974129 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bef3664-a560-420b-a44c-6691df495a29 admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:30:09.991090 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bef3664-a560-420b-a44c-6691df495a29 admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:30:09.996191 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037352d9-4c1a-4b83-acb6-e90085b763b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:30:09.997055 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037352d9-4c1a-4b83-acb6-e90085b763b9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:09.997604 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037352d9-4c1a-4b83-acb6-e90085b763b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:09.999237 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037352d9-4c1a-4b83-acb6-e90085b763b9 admin admin] PATH_INFO: `/v3/projects/9161e45d2259477f8c756d903258dcd1/users/87585940940c4332b7bccea24454b194/roles/3d75c4d7f1a849b9a771504d1583ab28` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:10.019319 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037352d9-4c1a-4b83-acb6-e90085b763b9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9161e45d2259477f8c756d903258dcd1, user_id=87585940940c4332b7bccea24454b194, role_id=3d75c4d7f1a849b9a771504d1583ab28)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:30:10.022178 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037352d9-4c1a-4b83-acb6-e90085b763b9 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:30:10.040206 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 751/1500] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Oct 12 02:30:09 2022] PUT /identity/v3/projects/9161e45d2259477f8c756d903258dcd1/users/87585940940c4332b7bccea24454b194/roles/3d75c4d7f1a849b9a771504d1583ab28 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 02:30:10.050744 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4d46dd-bf4f-4ad8-9733-c1042d5c6236 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:10.051583 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4d46dd-bf4f-4ad8-9733-c1042d5c6236 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:10.051583 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4d46dd-bf4f-4ad8-9733-c1042d5c6236 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:10.081523 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-5f4d46dd-bf4f-4ad8-9733-c1042d5c6236 None None] MFA Rules not processed for user `87585940940c4332b7bccea24454b194`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:30:10.082809 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-5f4d46dd-bf4f-4ad8-9733-c1042d5c6236 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:30:10.163550 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 750/1501] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 02:30:10 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 02:30:10.168699 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037352d9-4c1a-4b83-acb6-e90085b763b9 admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:30:10.242535 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037352d9-4c1a-4b83-acb6-e90085b763b9 admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:30:10.247429 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ca610b-1546-417b-8e48-66c1dca18ada admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:30:10.248423 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ca610b-1546-417b-8e48-66c1dca18ada admin admin] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:10.248423 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ca610b-1546-417b-8e48-66c1dca18ada admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:10.248967 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ca610b-1546-417b-8e48-66c1dca18ada admin admin] PATH_INFO: `/v3/projects` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:10.249605 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ca610b-1546-417b-8e48-66c1dca18ada admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:30:10.251881 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ca610b-1546-417b-8e48-66c1dca18ada admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:30:10.275951 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:30:10.295304 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 752/1502] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Oct 12 02:30:10 2022] POST /identity/v3/projects => generated 367 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 02:30:10.300501 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4d46dd-bf4f-4ad8-9733-c1042d5c6236 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:30:10.315863 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4d46dd-bf4f-4ad8-9733-c1042d5c6236 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:30:10.414369 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac44b67b-9123-4a29-a183-7a9cabab88bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:30:10.415390 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac44b67b-9123-4a29-a183-7a9cabab88bf admin admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:10.415877 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac44b67b-9123-4a29-a183-7a9cabab88bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:10.416181 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac44b67b-9123-4a29-a183-7a9cabab88bf admin admin] PATH_INFO: `/v3/users` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:10.416874 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac44b67b-9123-4a29-a183-7a9cabab88bf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:30:10.418961 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac44b67b-9123-4a29-a183-7a9cabab88bf admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:30:10.428996 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:30:10.466426 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 751/1503] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Oct 12 02:30:10 2022] POST /identity/v3/users => generated 290 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 02:30:10.472375 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ca610b-1546-417b-8e48-66c1dca18ada admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:30:10.489391 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ca610b-1546-417b-8e48-66c1dca18ada admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:30:10.497997 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415e592e-9fbd-4d43-8f49-4f70c7ec3819 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:30:10.499159 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415e592e-9fbd-4d43-8f49-4f70c7ec3819 admin admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:10.499437 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415e592e-9fbd-4d43-8f49-4f70c7ec3819 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:10.500711 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415e592e-9fbd-4d43-8f49-4f70c7ec3819 admin admin] PATH_INFO: `/v3/roles` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:10.501375 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415e592e-9fbd-4d43-8f49-4f70c7ec3819 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:30:10.504598 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415e592e-9fbd-4d43-8f49-4f70c7ec3819 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:30:10.539596 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 753/1504] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Oct 12 02:30:10 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 12 02:30:10.540920 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac44b67b-9123-4a29-a183-7a9cabab88bf admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:30:10.556407 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac44b67b-9123-4a29-a183-7a9cabab88bf admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:30:10.567218 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442d5ef3-d117-4413-8809-9970e718cca0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:30:10.568045 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442d5ef3-d117-4413-8809-9970e718cca0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:10.568635 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442d5ef3-d117-4413-8809-9970e718cca0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:10.570363 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442d5ef3-d117-4413-8809-9970e718cca0 admin admin] PATH_INFO: `/v3/projects/d975a93035594514bfdd2e06449dc955/users/cf4b0e86867a47a6adfbc15ccbba2801/roles/39b1e8108dff402383def3c559f48189` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:10.610081 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442d5ef3-d117-4413-8809-9970e718cca0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d975a93035594514bfdd2e06449dc955, user_id=cf4b0e86867a47a6adfbc15ccbba2801, role_id=39b1e8108dff402383def3c559f48189)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:30:10.616107 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442d5ef3-d117-4413-8809-9970e718cca0 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:30:10.651794 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 752/1505] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Oct 12 02:30:10 2022] PUT /identity/v3/projects/d975a93035594514bfdd2e06449dc955/users/cf4b0e86867a47a6adfbc15ccbba2801/roles/39b1e8108dff402383def3c559f48189 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 02:30:10.656616 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415e592e-9fbd-4d43-8f49-4f70c7ec3819 admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:30:10.681897 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415e592e-9fbd-4d43-8f49-4f70c7ec3819 admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:30:10.713352 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442d5ef3-d117-4413-8809-9970e718cca0 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:30:10.715814 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-442d5ef3-d117-4413-8809-9970e718cca0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:30:10.772939 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989df277-4ffc-4010-afda-9ed15236e32c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:30:10.774214 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989df277-4ffc-4010-afda-9ed15236e32c admin admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:10.774802 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989df277-4ffc-4010-afda-9ed15236e32c admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:10.775341 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989df277-4ffc-4010-afda-9ed15236e32c admin admin] PATH_INFO: `/v3/roles` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:10.776548 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989df277-4ffc-4010-afda-9ed15236e32c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:30:10.779107 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989df277-4ffc-4010-afda-9ed15236e32c admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:30:10.793214 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 754/1506] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Oct 12 02:30:10 2022] GET /identity/v3/roles => generated 1420 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 02:30:10.799162 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989df277-4ffc-4010-afda-9ed15236e32c admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:30:10.802053 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442d5ef3-d117-4413-8809-9970e718cca0 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:30:10.807777 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b7b5e6-0eaf-4461-81a8-c7b5834f1571 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:30:10.808452 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b7b5e6-0eaf-4461-81a8-c7b5834f1571 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:10.808766 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b7b5e6-0eaf-4461-81a8-c7b5834f1571 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:10.809040 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b7b5e6-0eaf-4461-81a8-c7b5834f1571 admin admin] PATH_INFO: `/v3/users/b2221f8b58ac4636b8d8e64a6b6c99d8` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:10.810259 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b7b5e6-0eaf-4461-81a8-c7b5834f1571 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b2221f8b58ac4636b8d8e64a6b6c99d8)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:30:10.812549 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b7b5e6-0eaf-4461-81a8-c7b5834f1571 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:30:10.813230 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989df277-4ffc-4010-afda-9ed15236e32c admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:30:10.818315 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167bdf90-04a4-45b8-926d-661dd63525c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:30:10.820130 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167bdf90-04a4-45b8-926d-661dd63525c0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:10.820621 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167bdf90-04a4-45b8-926d-661dd63525c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:10.821064 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167bdf90-04a4-45b8-926d-661dd63525c0 admin admin] PATH_INFO: `/v3/projects/d975a93035594514bfdd2e06449dc955/users/cf4b0e86867a47a6adfbc15ccbba2801/roles/39b1e8108dff402383def3c559f48189` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:10.823505 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167bdf90-04a4-45b8-926d-661dd63525c0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d975a93035594514bfdd2e06449dc955, user_id=cf4b0e86867a47a6adfbc15ccbba2801, role_id=39b1e8108dff402383def3c559f48189)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:30:10.827512 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167bdf90-04a4-45b8-926d-661dd63525c0 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:30:10.843457 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 755/1507] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Oct 12 02:30:10 2022] PUT /identity/v3/projects/d975a93035594514bfdd2e06449dc955/users/cf4b0e86867a47a6adfbc15ccbba2801/roles/39b1e8108dff402383def3c559f48189 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 02:30:10.854883 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc7d515-818e-4ee6-abb5-f06ae408b851 None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:10.855860 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc7d515-818e-4ee6-abb5-f06ae408b851 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:10.855963 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc7d515-818e-4ee6-abb5-f06ae408b851 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:10.900196 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-b8b7b5e6-0eaf-4461-81a8-c7b5834f1571 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b2221f8b58ac4636b8d8e64a6b6c99d8'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:30:10.912602 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-b8b7b5e6-0eaf-4461-81a8-c7b5834f1571 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b2221f8b58ac4636b8d8e64a6b6c99d8'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:30:10.914521 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-edc7d515-818e-4ee6-abb5-f06ae408b851 None None] MFA Rules not processed for user `cf4b0e86867a47a6adfbc15ccbba2801`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:30:10.915748 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-edc7d515-818e-4ee6-abb5-f06ae408b851 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:30:10.930631 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-b8b7b5e6-0eaf-4461-81a8-c7b5834f1571 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b2221f8b58ac4636b8d8e64a6b6c99d8'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:30:10.940168 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-b8b7b5e6-0eaf-4461-81a8-c7b5834f1571 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b2221f8b58ac4636b8d8e64a6b6c99d8'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:30:10.941208 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-b8b7b5e6-0eaf-4461-81a8-c7b5834f1571 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b2221f8b58ac4636b8d8e64a6b6c99d8'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:30:10.951397 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 753/1508] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Oct 12 02:30:10 2022] DELETE /identity/v3/users/b2221f8b58ac4636b8d8e64a6b6c99d8 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 02:30:10.957964 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2595268e-9965-4ba2-befd-a338d98016d5 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:10.958254 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2595268e-9965-4ba2-befd-a338d98016d5 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:10.958533 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2595268e-9965-4ba2-befd-a338d98016d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:10.982552 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-2595268e-9965-4ba2-befd-a338d98016d5 None None] MFA Rules not processed for user `a326a5bb7364479382f528a592371656`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:30:10.985017 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-2595268e-9965-4ba2-befd-a338d98016d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:30:11.011237 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 756/1509] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 02:30:10 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 02:30:11.026854 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc7d515-818e-4ee6-abb5-f06ae408b851 None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:30:11.028572 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-edc7d515-818e-4ee6-abb5-f06ae408b851 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:30:11.036451 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:INSERT=5,keystone:SELECT=85,keystone:DELETE=10 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:30:11.066386 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 754/1510] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 02:30:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 02:30:11.078611 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2595268e-9965-4ba2-befd-a338d98016d5 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:30:11.079954 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-2595268e-9965-4ba2-befd-a338d98016d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:30:11.099550 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc7d515-818e-4ee6-abb5-f06ae408b851 None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:30:11.104924 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:30:11.146492 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2595268e-9965-4ba2-befd-a338d98016d5 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:30:11.150126 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceade2f6-42e7-4695-aa9c-2e941a5aaeb1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5223b5cab3114e9b9a13c582f8ef8386', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'beb6def6fcad45959e56425bb8bff4d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:30:11.150739 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceade2f6-42e7-4695-aa9c-2e941a5aaeb1 service neutron] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:11.151011 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceade2f6-42e7-4695-aa9c-2e941a5aaeb1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:11.151283 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceade2f6-42e7-4695-aa9c-2e941a5aaeb1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:11.158976 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36426fd5-2fef-428c-8499-e68d3911043d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ba688e0c4d44d13898539ee886f95fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'beb6def6fcad45959e56425bb8bff4d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:30:11.159725 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36426fd5-2fef-428c-8499-e68d3911043d service cinder] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:11.160062 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36426fd5-2fef-428c-8499-e68d3911043d service cinder] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:11.160340 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36426fd5-2fef-428c-8499-e68d3911043d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:11.162857 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceade2f6-42e7-4695-aa9c-2e941a5aaeb1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:30:11.164404 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceade2f6-42e7-4695-aa9c-2e941a5aaeb1 service neutron] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:30:11.174407 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 755/1511] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 02:30:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 12 02:30:11.232917 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36426fd5-2fef-428c-8499-e68d3911043d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:30:11.234419 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36426fd5-2fef-428c-8499-e68d3911043d service cinder] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:30:11.244627 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 757/1512] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 02:30:11 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 12 02:30:11.295535 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceade2f6-42e7-4695-aa9c-2e941a5aaeb1 service neutron] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:30:11.297107 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-ceade2f6-42e7-4695-aa9c-2e941a5aaeb1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:30:11.322952 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceade2f6-42e7-4695-aa9c-2e941a5aaeb1 service neutron] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:30:11.330683 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c677dff9-6700-46d3-b0d6-437d595c09e2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ba688e0c4d44d13898539ee886f95fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'beb6def6fcad45959e56425bb8bff4d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:30:11.331819 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c677dff9-6700-46d3-b0d6-437d595c09e2 service cinder] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:11.332242 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c677dff9-6700-46d3-b0d6-437d595c09e2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:11.332684 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c677dff9-6700-46d3-b0d6-437d595c09e2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:11.334649 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-c677dff9-6700-46d3-b0d6-437d595c09e2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:30:11.445252 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c677dff9-6700-46d3-b0d6-437d595c09e2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:30:11.447466 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c677dff9-6700-46d3-b0d6-437d595c09e2 service cinder] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:30:11.475986 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 756/1513] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 02:30:11 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 02:30:11.692806 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36426fd5-2fef-428c-8499-e68d3911043d service cinder] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:30:11.696559 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-36426fd5-2fef-428c-8499-e68d3911043d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:30:11.718051 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36426fd5-2fef-428c-8499-e68d3911043d service cinder] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:30:11.723963 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae38dc1a-9748-4e4e-b338-d06316b5c276 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:30:11.724707 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae38dc1a-9748-4e4e-b338-d06316b5c276 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:11.724984 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae38dc1a-9748-4e4e-b338-d06316b5c276 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:11.725264 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae38dc1a-9748-4e4e-b338-d06316b5c276 admin admin] PATH_INFO: `/v3/projects/542a276216784f8a911232db5fc62bb3` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:11.726526 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae38dc1a-9748-4e4e-b338-d06316b5c276 admin admin] RBAC: Authorizing `identity:delete_project(project_id=542a276216784f8a911232db5fc62bb3)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:30:11.728648 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae38dc1a-9748-4e4e-b338-d06316b5c276 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:30:11.819099 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-ae38dc1a-9748-4e4e-b338-d06316b5c276 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '542a276216784f8a911232db5fc62bb3', 'request_id': 'req-ae38dc1a-9748-4e4e-b338-d06316b5c276'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:30:11.839861 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-ae38dc1a-9748-4e4e-b338-d06316b5c276 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '542a276216784f8a911232db5fc62bb3', 'request_id': 'req-ae38dc1a-9748-4e4e-b338-d06316b5c276'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:30:11.848103 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-ae38dc1a-9748-4e4e-b338-d06316b5c276 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '542a276216784f8a911232db5fc62bb3', 'request_id': 'req-ae38dc1a-9748-4e4e-b338-d06316b5c276'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:30:11.877442 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-ae38dc1a-9748-4e4e-b338-d06316b5c276 admin admin] The token cache is being invalidate because project 542a276216784f8a911232db5fc62bb3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81361) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 02:30:11.877737 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-ae38dc1a-9748-4e4e-b338-d06316b5c276 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:30:11.878695 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-ae38dc1a-9748-4e4e-b338-d06316b5c276 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:30:11.883850 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 758/1514] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Oct 12 02:30:11 2022] DELETE /identity/v3/projects/542a276216784f8a911232db5fc62bb3 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 02:30:11.889590 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c677dff9-6700-46d3-b0d6-437d595c09e2 service cinder] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:30:11.907990 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c677dff9-6700-46d3-b0d6-437d595c09e2 service cinder] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:30:12.112234 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5541ea73-9d59-46ad-8ecd-1b56afd026b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:30:12.113028 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5541ea73-9d59-46ad-8ecd-1b56afd026b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:12.113313 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5541ea73-9d59-46ad-8ecd-1b56afd026b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:12.114226 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5541ea73-9d59-46ad-8ecd-1b56afd026b4 admin admin] PATH_INFO: `/v3/users/3bb834cf26dc4b5ea06444f927d583fc` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:12.115613 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5541ea73-9d59-46ad-8ecd-1b56afd026b4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3bb834cf26dc4b5ea06444f927d583fc)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:30:12.120060 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5541ea73-9d59-46ad-8ecd-1b56afd026b4 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:30:12.165345 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:30:12.219316 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-5541ea73-9d59-46ad-8ecd-1b56afd026b4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3bb834cf26dc4b5ea06444f927d583fc'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:30:12.239013 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-5541ea73-9d59-46ad-8ecd-1b56afd026b4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3bb834cf26dc4b5ea06444f927d583fc'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:30:12.281567 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-5541ea73-9d59-46ad-8ecd-1b56afd026b4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3bb834cf26dc4b5ea06444f927d583fc'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:30:12.299091 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-5541ea73-9d59-46ad-8ecd-1b56afd026b4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3bb834cf26dc4b5ea06444f927d583fc'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:30:12.300664 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-5541ea73-9d59-46ad-8ecd-1b56afd026b4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3bb834cf26dc4b5ea06444f927d583fc'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:30:12.314299 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 757/1515] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Oct 12 02:30:11 2022] DELETE /identity/v3/users/3bb834cf26dc4b5ea06444f927d583fc => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 02:30:13.412600 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae38dc1a-9748-4e4e-b338-d06316b5c276 admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:30:13.414097 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-ae38dc1a-9748-4e4e-b338-d06316b5c276 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:30:13.450771 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae38dc1a-9748-4e4e-b338-d06316b5c276 admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:30:13.498021 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:30:13.521077 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc30bf1-a1ee-4c97-a76f-16b868fb909a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:30:13.521729 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc30bf1-a1ee-4c97-a76f-16b868fb909a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:13.522112 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc30bf1-a1ee-4c97-a76f-16b868fb909a admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:13.522317 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc30bf1-a1ee-4c97-a76f-16b868fb909a admin admin] PATH_INFO: `/v3/projects/8e9e06ba48a24cc7930bf37c3cb87304` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:13.525409 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc30bf1-a1ee-4c97-a76f-16b868fb909a admin admin] RBAC: Authorizing `identity:delete_project(project_id=8e9e06ba48a24cc7930bf37c3cb87304)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:30:13.525665 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc30bf1-a1ee-4c97-a76f-16b868fb909a admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:30:13.641873 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-0fc30bf1-a1ee-4c97-a76f-16b868fb909a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8e9e06ba48a24cc7930bf37c3cb87304', 'request_id': 'req-0fc30bf1-a1ee-4c97-a76f-16b868fb909a'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:30:13.649618 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-0fc30bf1-a1ee-4c97-a76f-16b868fb909a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8e9e06ba48a24cc7930bf37c3cb87304', 'request_id': 'req-0fc30bf1-a1ee-4c97-a76f-16b868fb909a'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:30:13.659861 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-0fc30bf1-a1ee-4c97-a76f-16b868fb909a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8e9e06ba48a24cc7930bf37c3cb87304', 'request_id': 'req-0fc30bf1-a1ee-4c97-a76f-16b868fb909a'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:30:13.680905 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-0fc30bf1-a1ee-4c97-a76f-16b868fb909a admin admin] The token cache is being invalidate because project 8e9e06ba48a24cc7930bf37c3cb87304 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81361) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 02:30:13.681447 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-0fc30bf1-a1ee-4c97-a76f-16b868fb909a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:30:13.682200 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-0fc30bf1-a1ee-4c97-a76f-16b868fb909a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:30:13.685539 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 759/1516] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Oct 12 02:30:13 2022] DELETE /identity/v3/projects/8e9e06ba48a24cc7930bf37c3cb87304 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 02:30:13.691448 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73925e5f-9485-414e-8df5-c23bbe64a1ad None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:13.691931 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73925e5f-9485-414e-8df5-c23bbe64a1ad None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:13.692289 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73925e5f-9485-414e-8df5-c23bbe64a1ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:13.719621 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-73925e5f-9485-414e-8df5-c23bbe64a1ad None None] MFA Rules not processed for user `a326a5bb7364479382f528a592371656`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:30:13.721181 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-73925e5f-9485-414e-8df5-c23bbe64a1ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:30:13.786141 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 758/1517] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 02:30:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 02:30:13.794346 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615492e2-eaac-41b3-95bf-fdebddfac6db None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:13.794728 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615492e2-eaac-41b3-95bf-fdebddfac6db None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:13.795109 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615492e2-eaac-41b3-95bf-fdebddfac6db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:13.819907 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-615492e2-eaac-41b3-95bf-fdebddfac6db None None] MFA Rules not processed for user `a326a5bb7364479382f528a592371656`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:30:13.821003 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-615492e2-eaac-41b3-95bf-fdebddfac6db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:30:13.830867 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 760/1518] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 02:30:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 02:30:13.835222 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73925e5f-9485-414e-8df5-c23bbe64a1ad None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:30:13.848617 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73925e5f-9485-414e-8df5-c23bbe64a1ad None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:30:13.863888 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58881d9f-e946-4719-a950-37932d2f8df5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:30:13.864820 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58881d9f-e946-4719-a950-37932d2f8df5 admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:13.865099 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58881d9f-e946-4719-a950-37932d2f8df5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:13.865581 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58881d9f-e946-4719-a950-37932d2f8df5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:13.866474 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58881d9f-e946-4719-a950-37932d2f8df5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 02:30:13.866867 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58881d9f-e946-4719-a950-37932d2f8df5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:30:13.868622 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58881d9f-e946-4719-a950-37932d2f8df5 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:30:13.888606 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 759/1519] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Oct 12 02:30:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 02:30:13.889654 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615492e2-eaac-41b3-95bf-fdebddfac6db None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:30:13.898683 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615492e2-eaac-41b3-95bf-fdebddfac6db None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:30:13.904169 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57f351b-b718-4e95-b429-9565967103a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:30:13.904963 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57f351b-b718-4e95-b429-9565967103a5 admin admin] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:13.905753 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57f351b-b718-4e95-b429-9565967103a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:13.905753 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57f351b-b718-4e95-b429-9565967103a5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:13.906191 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57f351b-b718-4e95-b429-9565967103a5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:30:13.908208 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57f351b-b718-4e95-b429-9565967103a5 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:30:13.940954 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 761/1520] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Oct 12 02:30:13 2022] POST /identity/v3/projects => generated 401 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 02:30:13.944752 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58881d9f-e946-4719-a950-37932d2f8df5 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:30:13.956915 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58881d9f-e946-4719-a950-37932d2f8df5 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:30:14.044852 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ab9407-ac03-40e8-8121-01c21456c87c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:30:14.046001 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ab9407-ac03-40e8-8121-01c21456c87c admin admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:14.046280 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ab9407-ac03-40e8-8121-01c21456c87c admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:14.046584 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ab9407-ac03-40e8-8121-01c21456c87c admin admin] PATH_INFO: `/v3/users` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:14.047234 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ab9407-ac03-40e8-8121-01c21456c87c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:30:14.049167 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ab9407-ac03-40e8-8121-01c21456c87c admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:30:14.079308 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 760/1521] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Oct 12 02:30:13 2022] POST /identity/v3/users => generated 301 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 02:30:14.080553 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57f351b-b718-4e95-b429-9565967103a5 admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:30:14.090694 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57f351b-b718-4e95-b429-9565967103a5 admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:30:14.096174 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c92ae3-40e4-4580-91af-8231604056f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:30:14.096809 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c92ae3-40e4-4580-91af-8231604056f2 admin admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:14.097082 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c92ae3-40e4-4580-91af-8231604056f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:14.097346 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c92ae3-40e4-4580-91af-8231604056f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:14.097989 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c92ae3-40e4-4580-91af-8231604056f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:30:14.099576 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c92ae3-40e4-4580-91af-8231604056f2 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:30:14.110276 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 762/1522] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Oct 12 02:30:14 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 12 02:30:14.114289 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ab9407-ac03-40e8-8121-01c21456c87c admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:30:14.125582 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ab9407-ac03-40e8-8121-01c21456c87c admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:30:14.129845 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec73953-303a-42dc-ba4a-293849299db6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:30:14.130455 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec73953-303a-42dc-ba4a-293849299db6 admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:14.131057 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec73953-303a-42dc-ba4a-293849299db6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:14.131057 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec73953-303a-42dc-ba4a-293849299db6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:14.131632 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec73953-303a-42dc-ba4a-293849299db6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:30:14.133265 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec73953-303a-42dc-ba4a-293849299db6 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:30:14.144272 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 761/1523] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Oct 12 02:30:14 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 12 02:30:14.148505 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c92ae3-40e4-4580-91af-8231604056f2 admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:30:14.159200 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c92ae3-40e4-4580-91af-8231604056f2 admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:30:14.163786 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43177aca-e76d-4e60-bedd-0f06e777c198 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:30:14.164438 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43177aca-e76d-4e60-bedd-0f06e777c198 admin admin] REQUEST_METHOD: `PUT` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:14.164744 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43177aca-e76d-4e60-bedd-0f06e777c198 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:14.165018 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43177aca-e76d-4e60-bedd-0f06e777c198 admin admin] PATH_INFO: `/v3/projects/7ba73344b23c4cd99db44a10033a5363/users/548825f395d54f93be99ab36bf48dbb3/roles/3d75c4d7f1a849b9a771504d1583ab28` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:14.181453 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43177aca-e76d-4e60-bedd-0f06e777c198 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ba73344b23c4cd99db44a10033a5363, user_id=548825f395d54f93be99ab36bf48dbb3, role_id=3d75c4d7f1a849b9a771504d1583ab28)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:30:14.184101 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43177aca-e76d-4e60-bedd-0f06e777c198 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:30:14.199224 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 763/1524] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Oct 12 02:30:14 2022] PUT /identity/v3/projects/7ba73344b23c4cd99db44a10033a5363/users/548825f395d54f93be99ab36bf48dbb3/roles/3d75c4d7f1a849b9a771504d1583ab28 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 02:30:14.209877 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd669e3-509c-4384-8a12-ee285a150e2b None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:14.210273 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd669e3-509c-4384-8a12-ee285a150e2b None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:14.210613 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd669e3-509c-4384-8a12-ee285a150e2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:14.232449 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:30:14.241141 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-5dd669e3-509c-4384-8a12-ee285a150e2b None None] MFA Rules not processed for user `548825f395d54f93be99ab36bf48dbb3`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:30:14.242865 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-5dd669e3-509c-4384-8a12-ee285a150e2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:30:14.268286 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e24072-2e3a-471f-a402-44650fac553b None None] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:14.268745 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e24072-2e3a-471f-a402-44650fac553b None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:14.269163 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e24072-2e3a-471f-a402-44650fac553b None None] PATH_INFO: `/` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:14.270974 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 764/1525] 10.222.0.18 () {54 vars in 921 bytes} [Wed Oct 12 02:30:14 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 02:30:14.280581 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565cd319-d11f-47a7-a9f9-e80b9bcc7522 None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:14.281076 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565cd319-d11f-47a7-a9f9-e80b9bcc7522 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:14.281464 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565cd319-d11f-47a7-a9f9-e80b9bcc7522 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:14.303847 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-565cd319-d11f-47a7-a9f9-e80b9bcc7522 None None] MFA Rules not processed for user `f2fca96c111b45b795fb757f77908ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:30:14.305214 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-565cd319-d11f-47a7-a9f9-e80b9bcc7522 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:30:14.330773 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 762/1526] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 02:30:14 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 02:30:14.332315 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd669e3-509c-4384-8a12-ee285a150e2b None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:30:14.393354 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:30:14.416730 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 765/1527] 10.222.0.18 () {58 vars in 1018 bytes} [Wed Oct 12 02:30:14 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 02:30:14.425785 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd669e3-509c-4384-8a12-ee285a150e2b None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:30:14.435447 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565cd319-d11f-47a7-a9f9-e80b9bcc7522 None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:30:14.437427 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-565cd319-d11f-47a7-a9f9-e80b9bcc7522 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:30:14.439749 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d037e066-5545-499a-a2ca-8d4f66afce96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:30:14.440179 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d037e066-5545-499a-a2ca-8d4f66afce96 admin admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:14.440603 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d037e066-5545-499a-a2ca-8d4f66afce96 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:14.441256 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d037e066-5545-499a-a2ca-8d4f66afce96 admin admin] PATH_INFO: `/v3/projects` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:14.441731 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d037e066-5545-499a-a2ca-8d4f66afce96 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:30:14.444028 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d037e066-5545-499a-a2ca-8d4f66afce96 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:30:14.456107 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565cd319-d11f-47a7-a9f9-e80b9bcc7522 None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:30:14.466405 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4801131e-593d-4648-b737-cd8105e1c488 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fca96c111b45b795fb757f77908ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'beb6def6fcad45959e56425bb8bff4d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:30:14.467967 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4801131e-593d-4648-b737-cd8105e1c488 service nova] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:14.468255 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4801131e-593d-4648-b737-cd8105e1c488 service nova] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:14.469061 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4801131e-593d-4648-b737-cd8105e1c488 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:14.481279 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4801131e-593d-4648-b737-cd8105e1c488 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:30:14.483457 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4801131e-593d-4648-b737-cd8105e1c488 service nova] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:30:14.486787 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 763/1528] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Oct 12 02:30:14 2022] POST /identity/v3/projects => generated 401 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 02:30:14.492980 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d037e066-5545-499a-a2ca-8d4f66afce96 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:30:14.501147 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 766/1529] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 02:30:14 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 02:30:14.637410 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d037e066-5545-499a-a2ca-8d4f66afce96 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:30:14.657935 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed329bc1-b25f-4cd8-a5bb-c43a8b245f58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:30:14.659108 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed329bc1-b25f-4cd8-a5bb-c43a8b245f58 admin admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:14.659683 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed329bc1-b25f-4cd8-a5bb-c43a8b245f58 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:14.660331 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed329bc1-b25f-4cd8-a5bb-c43a8b245f58 admin admin] PATH_INFO: `/v3/users` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:14.661139 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed329bc1-b25f-4cd8-a5bb-c43a8b245f58 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:30:14.663256 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed329bc1-b25f-4cd8-a5bb-c43a8b245f58 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:30:14.711087 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 764/1530] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Oct 12 02:30:14 2022] POST /identity/v3/users => generated 307 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 02:30:14.714388 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4801131e-593d-4648-b737-cd8105e1c488 service nova] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:30:14.751498 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4801131e-593d-4648-b737-cd8105e1c488 service nova] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:30:14.766736 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02d9302-9f52-41b9-b239-6b6e5bd7b54e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:30:14.769728 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02d9302-9f52-41b9-b239-6b6e5bd7b54e admin admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:14.769886 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02d9302-9f52-41b9-b239-6b6e5bd7b54e admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:14.770457 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02d9302-9f52-41b9-b239-6b6e5bd7b54e admin admin] PATH_INFO: `/v3/roles` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:14.776684 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02d9302-9f52-41b9-b239-6b6e5bd7b54e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:30:14.776684 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02d9302-9f52-41b9-b239-6b6e5bd7b54e admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:30:14.806887 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed329bc1-b25f-4cd8-a5bb-c43a8b245f58 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:30:14.816394 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 767/1531] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Oct 12 02:30:14 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 02:30:14.823959 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed329bc1-b25f-4cd8-a5bb-c43a8b245f58 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:30:14.836082 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b36480e-56cd-426b-a6d1-98aff94cf69a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:30:14.837002 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b36480e-56cd-426b-a6d1-98aff94cf69a admin admin] REQUEST_METHOD: `PUT` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:14.837401 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b36480e-56cd-426b-a6d1-98aff94cf69a admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:14.839433 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b36480e-56cd-426b-a6d1-98aff94cf69a admin admin] PATH_INFO: `/v3/projects/a740ae5ce8514212936452750f5d558d/users/fb2a0f2dff1d429690b504900522c390/roles/39b1e8108dff402383def3c559f48189` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:14.870804 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:30:14.879070 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b36480e-56cd-426b-a6d1-98aff94cf69a admin admin] RBAC: Authorizing `identity:create_grant(project_id=a740ae5ce8514212936452750f5d558d, user_id=fb2a0f2dff1d429690b504900522c390, role_id=39b1e8108dff402383def3c559f48189)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:30:14.892045 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b36480e-56cd-426b-a6d1-98aff94cf69a admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:30:14.921282 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 765/1532] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Oct 12 02:30:14 2022] PUT /identity/v3/projects/a740ae5ce8514212936452750f5d558d/users/fb2a0f2dff1d429690b504900522c390/roles/39b1e8108dff402383def3c559f48189 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 02:30:14.922500 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02d9302-9f52-41b9-b239-6b6e5bd7b54e admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:30:14.935493 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02d9302-9f52-41b9-b239-6b6e5bd7b54e admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:30:15.020427 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b36480e-56cd-426b-a6d1-98aff94cf69a admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:30:15.023421 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-7b36480e-56cd-426b-a6d1-98aff94cf69a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:30:15.085167 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb99fbec-50bd-498d-bbc1-de4001cfcc65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:30:15.086071 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb99fbec-50bd-498d-bbc1-de4001cfcc65 admin admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:15.086439 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb99fbec-50bd-498d-bbc1-de4001cfcc65 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:15.087176 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb99fbec-50bd-498d-bbc1-de4001cfcc65 admin admin] PATH_INFO: `/v3/roles` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:15.087713 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb99fbec-50bd-498d-bbc1-de4001cfcc65 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:30:15.089654 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb99fbec-50bd-498d-bbc1-de4001cfcc65 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:30:15.104458 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 768/1533] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Oct 12 02:30:14 2022] GET /identity/v3/roles => generated 1420 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 12 02:30:15.108312 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb99fbec-50bd-498d-bbc1-de4001cfcc65 admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:30:15.123863 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb99fbec-50bd-498d-bbc1-de4001cfcc65 admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:30:15.129804 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c305aee-f443-431d-bc67-f5a9de4e2dea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:30:15.130752 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c305aee-f443-431d-bc67-f5a9de4e2dea admin admin] REQUEST_METHOD: `PUT` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:15.131198 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c305aee-f443-431d-bc67-f5a9de4e2dea admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:15.131607 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c305aee-f443-431d-bc67-f5a9de4e2dea admin admin] PATH_INFO: `/v3/projects/a740ae5ce8514212936452750f5d558d/users/fb2a0f2dff1d429690b504900522c390/roles/39b1e8108dff402383def3c559f48189` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:15.133869 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c305aee-f443-431d-bc67-f5a9de4e2dea admin admin] RBAC: Authorizing `identity:create_grant(project_id=a740ae5ce8514212936452750f5d558d, user_id=fb2a0f2dff1d429690b504900522c390, role_id=39b1e8108dff402383def3c559f48189)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:30:15.135760 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b36480e-56cd-426b-a6d1-98aff94cf69a admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:30:15.139283 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c305aee-f443-431d-bc67-f5a9de4e2dea admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:30:15.141518 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f522ae0c-e282-4466-a67d-951edeacf776 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:30:15.142597 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f522ae0c-e282-4466-a67d-951edeacf776 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:15.143098 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f522ae0c-e282-4466-a67d-951edeacf776 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:15.143618 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f522ae0c-e282-4466-a67d-951edeacf776 admin admin] PATH_INFO: `/v3/users/6811c913ed244889bbbbfb00635a5190` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:15.145291 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f522ae0c-e282-4466-a67d-951edeacf776 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6811c913ed244889bbbbfb00635a5190)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:30:15.147868 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f522ae0c-e282-4466-a67d-951edeacf776 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:30:15.157726 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 769/1534] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Oct 12 02:30:15 2022] PUT /identity/v3/projects/a740ae5ce8514212936452750f5d558d/users/fb2a0f2dff1d429690b504900522c390/roles/39b1e8108dff402383def3c559f48189 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 02:30:15.169909 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2118d140-3194-4846-b9b2-73842ad53295 None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:15.170999 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2118d140-3194-4846-b9b2-73842ad53295 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:15.171417 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2118d140-3194-4846-b9b2-73842ad53295 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:15.224220 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-f522ae0c-e282-4466-a67d-951edeacf776 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6811c913ed244889bbbbfb00635a5190'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:30:15.228803 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-2118d140-3194-4846-b9b2-73842ad53295 None None] MFA Rules not processed for user `fb2a0f2dff1d429690b504900522c390`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:30:15.232049 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-2118d140-3194-4846-b9b2-73842ad53295 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:30:15.242153 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-f522ae0c-e282-4466-a67d-951edeacf776 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6811c913ed244889bbbbfb00635a5190'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:30:15.270025 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-f522ae0c-e282-4466-a67d-951edeacf776 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6811c913ed244889bbbbfb00635a5190'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:30:15.284974 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-f522ae0c-e282-4466-a67d-951edeacf776 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6811c913ed244889bbbbfb00635a5190'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:30:15.289148 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-f522ae0c-e282-4466-a67d-951edeacf776 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6811c913ed244889bbbbfb00635a5190'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:30:15.307667 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 766/1535] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Oct 12 02:30:15 2022] DELETE /identity/v3/users/6811c913ed244889bbbbfb00635a5190 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 02:30:15.312491 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4765b9-5296-43e7-a406-eda60c061b7d None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:15.312945 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4765b9-5296-43e7-a406-eda60c061b7d None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:15.313327 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4765b9-5296-43e7-a406-eda60c061b7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:15.388760 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-0e4765b9-5296-43e7-a406-eda60c061b7d None None] MFA Rules not processed for user `a326a5bb7364479382f528a592371656`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:30:15.398322 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-0e4765b9-5296-43e7-a406-eda60c061b7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:30:15.442836 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 770/1536] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 02:30:15 2022] POST /identity/v3/auth/tokens => generated 3345 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 02:30:15.556070 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2118d140-3194-4846-b9b2-73842ad53295 None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:30:15.557633 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-2118d140-3194-4846-b9b2-73842ad53295 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:30:15.566580 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 767/1537] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 02:30:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 02:30:15.567616 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4765b9-5296-43e7-a406-eda60c061b7d None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:30:15.569832 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-0e4765b9-5296-43e7-a406-eda60c061b7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:30:15.587871 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:30:15.622738 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:30:15.636036 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2118d140-3194-4846-b9b2-73842ad53295 None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:30:15.664104 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4765b9-5296-43e7-a406-eda60c061b7d None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:30:15.667717 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b4d25c-acfc-4d04-8ea6-a27e935bc171 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5223b5cab3114e9b9a13c582f8ef8386', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'beb6def6fcad45959e56425bb8bff4d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:30:15.668334 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b4d25c-acfc-4d04-8ea6-a27e935bc171 service neutron] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:15.668642 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b4d25c-acfc-4d04-8ea6-a27e935bc171 service neutron] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:15.668945 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b4d25c-acfc-4d04-8ea6-a27e935bc171 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:15.682830 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b4d25c-acfc-4d04-8ea6-a27e935bc171 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:30:15.690278 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b4d25c-acfc-4d04-8ea6-a27e935bc171 service neutron] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:30:15.721492 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 768/1538] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 02:30:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 02:30:15.755807 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd7e900-8da2-4791-9058-fb237cf81b14 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ba688e0c4d44d13898539ee886f95fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'beb6def6fcad45959e56425bb8bff4d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:30:15.756447 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd7e900-8da2-4791-9058-fb237cf81b14 service cinder] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:15.756749 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd7e900-8da2-4791-9058-fb237cf81b14 service cinder] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:15.761518 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd7e900-8da2-4791-9058-fb237cf81b14 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:15.855509 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd7e900-8da2-4791-9058-fb237cf81b14 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:30:15.874282 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd7e900-8da2-4791-9058-fb237cf81b14 service cinder] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:30:15.901828 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 771/1539] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 02:30:15 2022] GET /identity/v3/auth/tokens => generated 3345 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 12 02:30:16.069336 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b4d25c-acfc-4d04-8ea6-a27e935bc171 service neutron] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:30:16.085756 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b4d25c-acfc-4d04-8ea6-a27e935bc171 service neutron] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:30:16.097585 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd7e900-8da2-4791-9058-fb237cf81b14 service cinder] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:30:16.099257 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-0bd7e900-8da2-4791-9058-fb237cf81b14 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:30:16.104845 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9e29df-8600-4789-90db-b50f542c365a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ba688e0c4d44d13898539ee886f95fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'beb6def6fcad45959e56425bb8bff4d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:30:16.105860 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9e29df-8600-4789-90db-b50f542c365a service cinder] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:16.106345 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9e29df-8600-4789-90db-b50f542c365a service cinder] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:16.108225 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9e29df-8600-4789-90db-b50f542c365a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:16.111646 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-bb9e29df-8600-4789-90db-b50f542c365a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:30:16.124761 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd7e900-8da2-4791-9058-fb237cf81b14 service cinder] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:30:16.136668 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6285e5-d4ac-4f39-b9b8-92c951e12d86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:30:16.137497 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6285e5-d4ac-4f39-b9b8-92c951e12d86 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:16.137851 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6285e5-d4ac-4f39-b9b8-92c951e12d86 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:16.138122 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6285e5-d4ac-4f39-b9b8-92c951e12d86 admin admin] PATH_INFO: `/v3/users/87585940940c4332b7bccea24454b194` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:16.140101 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6285e5-d4ac-4f39-b9b8-92c951e12d86 admin admin] RBAC: Authorizing `identity:delete_user(user_id=87585940940c4332b7bccea24454b194)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:30:16.142528 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6285e5-d4ac-4f39-b9b8-92c951e12d86 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:30:16.236841 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9e29df-8600-4789-90db-b50f542c365a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:30:16.240112 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9e29df-8600-4789-90db-b50f542c365a service cinder] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:30:16.242791 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-2a6285e5-d4ac-4f39-b9b8-92c951e12d86 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '87585940940c4332b7bccea24454b194'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:30:16.251675 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-2a6285e5-d4ac-4f39-b9b8-92c951e12d86 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '87585940940c4332b7bccea24454b194'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:30:16.254837 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 769/1540] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 02:30:16 2022] GET /identity/v3/auth/tokens => generated 3278 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 02:30:16.269324 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-2a6285e5-d4ac-4f39-b9b8-92c951e12d86 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '87585940940c4332b7bccea24454b194'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:30:16.278486 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-2a6285e5-d4ac-4f39-b9b8-92c951e12d86 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '87585940940c4332b7bccea24454b194'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:30:16.279497 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-2a6285e5-d4ac-4f39-b9b8-92c951e12d86 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '87585940940c4332b7bccea24454b194'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:30:16.287968 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 772/1541] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Oct 12 02:30:16 2022] DELETE /identity/v3/users/87585940940c4332b7bccea24454b194 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 02:30:16.292663 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a64cdbe-1424-4697-bf3b-ed0bbed4c45c None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:16.293164 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a64cdbe-1424-4697-bf3b-ed0bbed4c45c None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:16.293588 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a64cdbe-1424-4697-bf3b-ed0bbed4c45c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:16.329446 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-5a64cdbe-1424-4697-bf3b-ed0bbed4c45c None None] MFA Rules not processed for user `a326a5bb7364479382f528a592371656`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:30:16.334738 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6285e5-d4ac-4f39-b9b8-92c951e12d86 admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:30:16.335406 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-5a64cdbe-1424-4697-bf3b-ed0bbed4c45c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:30:16.336232 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-2a6285e5-d4ac-4f39-b9b8-92c951e12d86 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:30:16.370530 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:30:16.438344 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6285e5-d4ac-4f39-b9b8-92c951e12d86 admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:30:16.443988 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a875a30-2e3b-4452-bebe-2bad3a59ad09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:30:16.445788 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a875a30-2e3b-4452-bebe-2bad3a59ad09 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:16.446333 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a875a30-2e3b-4452-bebe-2bad3a59ad09 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:16.446749 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a875a30-2e3b-4452-bebe-2bad3a59ad09 admin admin] PATH_INFO: `/v3/projects/48771975a9a34947bc2c5cf92c5c84f4` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:16.448236 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a875a30-2e3b-4452-bebe-2bad3a59ad09 admin admin] RBAC: Authorizing `identity:delete_project(project_id=48771975a9a34947bc2c5cf92c5c84f4)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:30:16.450549 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a875a30-2e3b-4452-bebe-2bad3a59ad09 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:30:16.458168 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 770/1542] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 02:30:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 02:30:16.473638 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a64cdbe-1424-4697-bf3b-ed0bbed4c45c None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:30:16.475760 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-5a64cdbe-1424-4697-bf3b-ed0bbed4c45c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:30:16.542331 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-7a875a30-2e3b-4452-bebe-2bad3a59ad09 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '48771975a9a34947bc2c5cf92c5c84f4', 'request_id': 'req-7a875a30-2e3b-4452-bebe-2bad3a59ad09'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:30:16.552004 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-7a875a30-2e3b-4452-bebe-2bad3a59ad09 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '48771975a9a34947bc2c5cf92c5c84f4', 'request_id': 'req-7a875a30-2e3b-4452-bebe-2bad3a59ad09'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:30:16.559891 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-7a875a30-2e3b-4452-bebe-2bad3a59ad09 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '48771975a9a34947bc2c5cf92c5c84f4', 'request_id': 'req-7a875a30-2e3b-4452-bebe-2bad3a59ad09'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:30:16.582876 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-7a875a30-2e3b-4452-bebe-2bad3a59ad09 admin admin] The token cache is being invalidate because project 48771975a9a34947bc2c5cf92c5c84f4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81361) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 02:30:16.585727 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-7a875a30-2e3b-4452-bebe-2bad3a59ad09 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:30:16.586688 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-7a875a30-2e3b-4452-bebe-2bad3a59ad09 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:30:16.593554 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 773/1543] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Oct 12 02:30:16 2022] DELETE /identity/v3/projects/48771975a9a34947bc2c5cf92c5c84f4 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 02:30:16.598069 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94a17e7-642b-4041-be5c-054160303fe3 None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:16.598069 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94a17e7-642b-4041-be5c-054160303fe3 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:16.598289 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94a17e7-642b-4041-be5c-054160303fe3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:16.605336 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a64cdbe-1424-4697-bf3b-ed0bbed4c45c None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:30:16.621612 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:30:16.628639 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-f94a17e7-642b-4041-be5c-054160303fe3 None None] MFA Rules not processed for user `a326a5bb7364479382f528a592371656`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:30:16.630466 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-f94a17e7-642b-4041-be5c-054160303fe3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:30:16.711573 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 774/1544] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 02:30:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 02:30:16.713030 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f713b6d-a4b6-4b43-bdcc-f1602b9150fe None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:16.713403 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f713b6d-a4b6-4b43-bdcc-f1602b9150fe None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:16.713690 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f713b6d-a4b6-4b43-bdcc-f1602b9150fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:16.724538 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcef89f4-58f1-4b40-bfc5-d9d3db6208e4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5223b5cab3114e9b9a13c582f8ef8386', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'beb6def6fcad45959e56425bb8bff4d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:30:16.725168 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcef89f4-58f1-4b40-bfc5-d9d3db6208e4 service neutron] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:16.725495 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcef89f4-58f1-4b40-bfc5-d9d3db6208e4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:16.725766 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcef89f4-58f1-4b40-bfc5-d9d3db6208e4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:16.727510 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-dcef89f4-58f1-4b40-bfc5-d9d3db6208e4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:30:16.741424 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-3f713b6d-a4b6-4b43-bdcc-f1602b9150fe None None] MFA Rules not processed for user `a326a5bb7364479382f528a592371656`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:30:16.743050 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-3f713b6d-a4b6-4b43-bdcc-f1602b9150fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:30:16.753620 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 775/1545] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 02:30:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 02:30:16.755119 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcef89f4-58f1-4b40-bfc5-d9d3db6208e4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:30:16.756698 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcef89f4-58f1-4b40-bfc5-d9d3db6208e4 service neutron] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:30:16.757767 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f713b6d-a4b6-4b43-bdcc-f1602b9150fe None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:30:16.768809 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 771/1546] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 02:30:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 02:30:16.769412 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f713b6d-a4b6-4b43-bdcc-f1602b9150fe None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:30:16.780311 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bc354d-0405-44c2-8da1-63ce51799e15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:30:16.781270 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bc354d-0405-44c2-8da1-63ce51799e15 admin admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:16.781565 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bc354d-0405-44c2-8da1-63ce51799e15 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:16.781902 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bc354d-0405-44c2-8da1-63ce51799e15 admin admin] PATH_INFO: `/v3/domains` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:16.783569 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5bc354d-0405-44c2-8da1-63ce51799e15 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 02:30:16.783915 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5bc354d-0405-44c2-8da1-63ce51799e15 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:30:16.787508 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5bc354d-0405-44c2-8da1-63ce51799e15 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:30:16.806819 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 776/1547] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Oct 12 02:30:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 02:30:16.808000 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcef89f4-58f1-4b40-bfc5-d9d3db6208e4 service neutron] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:30:16.818816 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcef89f4-58f1-4b40-bfc5-d9d3db6208e4 service neutron] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:30:16.823789 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1331e624-a06b-49f8-8fc8-552a4d5cae09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:30:16.824409 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1331e624-a06b-49f8-8fc8-552a4d5cae09 admin admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:16.824736 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1331e624-a06b-49f8-8fc8-552a4d5cae09 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:16.825030 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1331e624-a06b-49f8-8fc8-552a4d5cae09 admin admin] PATH_INFO: `/v3/projects` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:16.825691 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1331e624-a06b-49f8-8fc8-552a4d5cae09 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:30:16.828603 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1331e624-a06b-49f8-8fc8-552a4d5cae09 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:30:16.858707 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 772/1548] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Oct 12 02:30:16 2022] POST /identity/v3/projects => generated 373 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 02:30:16.863390 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bc354d-0405-44c2-8da1-63ce51799e15 admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:30:16.874497 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bc354d-0405-44c2-8da1-63ce51799e15 admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:30:16.906026 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:30:16.940715 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb5519a-e8d2-40cf-9cb6-d4f8d0207e2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:30:16.941421 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb5519a-e8d2-40cf-9cb6-d4f8d0207e2d admin admin] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:16.941784 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb5519a-e8d2-40cf-9cb6-d4f8d0207e2d admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:16.942131 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb5519a-e8d2-40cf-9cb6-d4f8d0207e2d admin admin] PATH_INFO: `/v3/users` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:16.942841 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb5519a-e8d2-40cf-9cb6-d4f8d0207e2d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:30:16.945109 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb5519a-e8d2-40cf-9cb6-d4f8d0207e2d admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:30:16.969972 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 777/1549] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Oct 12 02:30:16 2022] POST /identity/v3/users => generated 287 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 02:30:16.974340 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1331e624-a06b-49f8-8fc8-552a4d5cae09 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:30:16.987150 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1331e624-a06b-49f8-8fc8-552a4d5cae09 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:30:16.991904 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36c28f2-afbb-4959-b12f-3c5392f832d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:30:16.992535 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36c28f2-afbb-4959-b12f-3c5392f832d7 admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:16.992814 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36c28f2-afbb-4959-b12f-3c5392f832d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:16.993084 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36c28f2-afbb-4959-b12f-3c5392f832d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:16.993731 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36c28f2-afbb-4959-b12f-3c5392f832d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:30:16.995332 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36c28f2-afbb-4959-b12f-3c5392f832d7 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:30:17.006877 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 773/1550] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Oct 12 02:30:16 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 12 02:30:17.010657 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb5519a-e8d2-40cf-9cb6-d4f8d0207e2d admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:30:17.022365 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb5519a-e8d2-40cf-9cb6-d4f8d0207e2d admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:30:17.028213 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e4ec2a-3c1d-4832-b000-a26996eb3e53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:30:17.028881 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e4ec2a-3c1d-4832-b000-a26996eb3e53 admin admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:17.029159 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e4ec2a-3c1d-4832-b000-a26996eb3e53 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:17.029429 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e4ec2a-3c1d-4832-b000-a26996eb3e53 admin admin] PATH_INFO: `/v3/roles` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:17.030553 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e4ec2a-3c1d-4832-b000-a26996eb3e53 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:30:17.032144 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e4ec2a-3c1d-4832-b000-a26996eb3e53 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:30:17.043387 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 778/1551] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Oct 12 02:30:17 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 02:30:17.048126 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36c28f2-afbb-4959-b12f-3c5392f832d7 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:30:17.066070 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36c28f2-afbb-4959-b12f-3c5392f832d7 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:30:17.066070 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08259439-79fa-4b48-a80e-c68f55465743 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:30:17.066817 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08259439-79fa-4b48-a80e-c68f55465743 admin admin] REQUEST_METHOD: `PUT` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:17.067474 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08259439-79fa-4b48-a80e-c68f55465743 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:17.067990 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08259439-79fa-4b48-a80e-c68f55465743 admin admin] PATH_INFO: `/v3/projects/561b67741285489eb920ed8d588afc43/users/c829034c1382437ea7439402cd812591/roles/3d75c4d7f1a849b9a771504d1583ab28` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:17.080761 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e4ec2a-3c1d-4832-b000-a26996eb3e53 admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:30:17.083854 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-28e4ec2a-3c1d-4832-b000-a26996eb3e53 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:30:17.092697 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08259439-79fa-4b48-a80e-c68f55465743 admin admin] RBAC: Authorizing `identity:create_grant(project_id=561b67741285489eb920ed8d588afc43, user_id=c829034c1382437ea7439402cd812591, role_id=3d75c4d7f1a849b9a771504d1583ab28)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:30:17.096522 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08259439-79fa-4b48-a80e-c68f55465743 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:30:17.113595 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 774/1552] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Oct 12 02:30:17 2022] PUT /identity/v3/projects/561b67741285489eb920ed8d588afc43/users/c829034c1382437ea7439402cd812591/roles/3d75c4d7f1a849b9a771504d1583ab28 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 02:30:17.119582 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e4ec2a-3c1d-4832-b000-a26996eb3e53 admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:30:17.124161 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c10677a-8e44-455c-a519-b3b88e201621 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:17.124438 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c10677a-8e44-455c-a519-b3b88e201621 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:17.124743 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c10677a-8e44-455c-a519-b3b88e201621 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:17.167150 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-4c10677a-8e44-455c-a519-b3b88e201621 None None] MFA Rules not processed for user `c829034c1382437ea7439402cd812591`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:30:17.168778 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-4c10677a-8e44-455c-a519-b3b88e201621 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:30:17.264890 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe381fd-7d79-4adb-8eaf-fd13c7da41fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:30:17.265541 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe381fd-7d79-4adb-8eaf-fd13c7da41fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:17.265820 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe381fd-7d79-4adb-8eaf-fd13c7da41fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:17.266093 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe381fd-7d79-4adb-8eaf-fd13c7da41fa admin admin] PATH_INFO: `/v3/projects/9161e45d2259477f8c756d903258dcd1` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:17.268131 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe381fd-7d79-4adb-8eaf-fd13c7da41fa admin admin] RBAC: Authorizing `identity:delete_project(project_id=9161e45d2259477f8c756d903258dcd1)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:30:17.270329 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe381fd-7d79-4adb-8eaf-fd13c7da41fa admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:30:17.291565 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 775/1553] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 02:30:17 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 02:30:17.303315 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c10677a-8e44-455c-a519-b3b88e201621 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:30:17.305288 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-4c10677a-8e44-455c-a519-b3b88e201621 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:30:17.365355 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:30:17.367124 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-bbe381fd-7d79-4adb-8eaf-fd13c7da41fa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9161e45d2259477f8c756d903258dcd1', 'request_id': 'req-bbe381fd-7d79-4adb-8eaf-fd13c7da41fa'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:30:17.380715 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-bbe381fd-7d79-4adb-8eaf-fd13c7da41fa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9161e45d2259477f8c756d903258dcd1', 'request_id': 'req-bbe381fd-7d79-4adb-8eaf-fd13c7da41fa'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:30:17.389849 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c10677a-8e44-455c-a519-b3b88e201621 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:30:17.393572 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-bbe381fd-7d79-4adb-8eaf-fd13c7da41fa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9161e45d2259477f8c756d903258dcd1', 'request_id': 'req-bbe381fd-7d79-4adb-8eaf-fd13c7da41fa'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:30:17.414795 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-bbe381fd-7d79-4adb-8eaf-fd13c7da41fa admin admin] The token cache is being invalidate because project 9161e45d2259477f8c756d903258dcd1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81361) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 02:30:17.415320 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-bbe381fd-7d79-4adb-8eaf-fd13c7da41fa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:30:17.415973 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-bbe381fd-7d79-4adb-8eaf-fd13c7da41fa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:30:17.417749 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 779/1554] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Oct 12 02:30:17 2022] DELETE /identity/v3/projects/9161e45d2259477f8c756d903258dcd1 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 02:30:17.421481 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe381fd-7d79-4adb-8eaf-fd13c7da41fa admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:30:17.422872 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-bbe381fd-7d79-4adb-8eaf-fd13c7da41fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:30:17.468707 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eaaf995-9dd8-43df-bdcc-86af025651e5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ba688e0c4d44d13898539ee886f95fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'beb6def6fcad45959e56425bb8bff4d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:30:17.469325 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eaaf995-9dd8-43df-bdcc-86af025651e5 service cinder] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:17.469604 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eaaf995-9dd8-43df-bdcc-86af025651e5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:17.469878 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eaaf995-9dd8-43df-bdcc-86af025651e5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:17.471649 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-4eaaf995-9dd8-43df-bdcc-86af025651e5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:30:17.475979 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:30:17.501155 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe381fd-7d79-4adb-8eaf-fd13c7da41fa admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:30:17.507356 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726322b1-f6e3-4240-b77a-fdbb86327c7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:30:17.507991 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726322b1-f6e3-4240-b77a-fdbb86327c7d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:17.508277 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726322b1-f6e3-4240-b77a-fdbb86327c7d admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:17.508579 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726322b1-f6e3-4240-b77a-fdbb86327c7d admin admin] PATH_INFO: `/v3/users/cf4b0e86867a47a6adfbc15ccbba2801` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:17.509724 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726322b1-f6e3-4240-b77a-fdbb86327c7d admin admin] RBAC: Authorizing `identity:delete_user(user_id=cf4b0e86867a47a6adfbc15ccbba2801)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:30:17.511664 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726322b1-f6e3-4240-b77a-fdbb86327c7d admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:30:17.549204 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eaaf995-9dd8-43df-bdcc-86af025651e5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:30:17.551126 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eaaf995-9dd8-43df-bdcc-86af025651e5 service cinder] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:30:17.561799 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 776/1555] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 02:30:17 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 259 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 02:30:17.566380 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-726322b1-f6e3-4240-b77a-fdbb86327c7d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cf4b0e86867a47a6adfbc15ccbba2801'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:30:17.573919 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-726322b1-f6e3-4240-b77a-fdbb86327c7d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cf4b0e86867a47a6adfbc15ccbba2801'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:30:17.587527 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eaaf995-9dd8-43df-bdcc-86af025651e5 service cinder] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:30:17.587919 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-726322b1-f6e3-4240-b77a-fdbb86327c7d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cf4b0e86867a47a6adfbc15ccbba2801'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:30:17.589451 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-4eaaf995-9dd8-43df-bdcc-86af025651e5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:30:17.595740 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-726322b1-f6e3-4240-b77a-fdbb86327c7d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cf4b0e86867a47a6adfbc15ccbba2801'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:30:17.596485 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-726322b1-f6e3-4240-b77a-fdbb86327c7d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cf4b0e86867a47a6adfbc15ccbba2801'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:30:17.602589 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 780/1556] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Oct 12 02:30:17 2022] DELETE /identity/v3/users/cf4b0e86867a47a6adfbc15ccbba2801 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 02:30:17.605703 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eaaf995-9dd8-43df-bdcc-86af025651e5 service cinder] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:30:17.672118 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb094b4b-0dc4-4d54-9a8b-30d2dabaa507 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:30:17.672798 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb094b4b-0dc4-4d54-9a8b-30d2dabaa507 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:17.673096 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb094b4b-0dc4-4d54-9a8b-30d2dabaa507 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:17.673379 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb094b4b-0dc4-4d54-9a8b-30d2dabaa507 admin admin] PATH_INFO: `/v3/users/c829034c1382437ea7439402cd812591` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:17.674683 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb094b4b-0dc4-4d54-9a8b-30d2dabaa507 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c829034c1382437ea7439402cd812591)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:30:17.677066 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb094b4b-0dc4-4d54-9a8b-30d2dabaa507 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:30:17.745499 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-cb094b4b-0dc4-4d54-9a8b-30d2dabaa507 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c829034c1382437ea7439402cd812591'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:30:17.776917 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-cb094b4b-0dc4-4d54-9a8b-30d2dabaa507 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c829034c1382437ea7439402cd812591'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:30:17.791412 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:30:17.832975 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-cb094b4b-0dc4-4d54-9a8b-30d2dabaa507 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c829034c1382437ea7439402cd812591'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:30:17.857449 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-cb094b4b-0dc4-4d54-9a8b-30d2dabaa507 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c829034c1382437ea7439402cd812591'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:30:17.859036 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-cb094b4b-0dc4-4d54-9a8b-30d2dabaa507 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c829034c1382437ea7439402cd812591'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:30:17.871813 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677caab8-83a1-474c-8d99-586c582c20a6 None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:17.872099 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677caab8-83a1-474c-8d99-586c582c20a6 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:17.872369 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677caab8-83a1-474c-8d99-586c582c20a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:17.875699 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 777/1557] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Oct 12 02:30:17 2022] DELETE /identity/v3/users/c829034c1382437ea7439402cd812591 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 02:30:17.893708 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-677caab8-83a1-474c-8d99-586c582c20a6 None None] MFA Rules not processed for user `a326a5bb7364479382f528a592371656`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:30:17.893708 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-677caab8-83a1-474c-8d99-586c582c20a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:30:17.994671 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 781/1558] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 02:30:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 02:30:18.006641 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb094b4b-0dc4-4d54-9a8b-30d2dabaa507 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:30:18.008231 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-cb094b4b-0dc4-4d54-9a8b-30d2dabaa507 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:30:18.070828 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677caab8-83a1-474c-8d99-586c582c20a6 None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:30:18.072205 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-677caab8-83a1-474c-8d99-586c582c20a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:30:18.105682 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677caab8-83a1-474c-8d99-586c582c20a6 None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:30:18.112595 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0730ebfd-c1bc-441e-9555-5abaf4c8db7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:30:18.113478 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0730ebfd-c1bc-441e-9555-5abaf4c8db7c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:18.113747 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0730ebfd-c1bc-441e-9555-5abaf4c8db7c admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:18.114022 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0730ebfd-c1bc-441e-9555-5abaf4c8db7c admin admin] PATH_INFO: `/v3/projects/d975a93035594514bfdd2e06449dc955` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:18.115459 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0730ebfd-c1bc-441e-9555-5abaf4c8db7c admin admin] RBAC: Authorizing `identity:delete_project(project_id=d975a93035594514bfdd2e06449dc955)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:30:18.118145 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0730ebfd-c1bc-441e-9555-5abaf4c8db7c admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:30:18.155774 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb094b4b-0dc4-4d54-9a8b-30d2dabaa507 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:30:18.165058 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284422b1-4cbe-4eda-9807-31147cb7f4be service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5223b5cab3114e9b9a13c582f8ef8386', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'beb6def6fcad45959e56425bb8bff4d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:30:18.165841 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284422b1-4cbe-4eda-9807-31147cb7f4be service neutron] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:18.166114 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284422b1-4cbe-4eda-9807-31147cb7f4be service neutron] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:18.166380 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284422b1-4cbe-4eda-9807-31147cb7f4be service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:18.184901 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284422b1-4cbe-4eda-9807-31147cb7f4be service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:30:18.188157 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284422b1-4cbe-4eda-9807-31147cb7f4be service neutron] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:30:18.207243 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 778/1559] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 02:30:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 02:30:18.208983 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-0730ebfd-c1bc-441e-9555-5abaf4c8db7c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd975a93035594514bfdd2e06449dc955', 'request_id': 'req-0730ebfd-c1bc-441e-9555-5abaf4c8db7c'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:30:18.215637 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:30:18.221070 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-0730ebfd-c1bc-441e-9555-5abaf4c8db7c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd975a93035594514bfdd2e06449dc955', 'request_id': 'req-0730ebfd-c1bc-441e-9555-5abaf4c8db7c'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:30:18.232123 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-0730ebfd-c1bc-441e-9555-5abaf4c8db7c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd975a93035594514bfdd2e06449dc955', 'request_id': 'req-0730ebfd-c1bc-441e-9555-5abaf4c8db7c'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:30:18.257841 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-0730ebfd-c1bc-441e-9555-5abaf4c8db7c admin admin] The token cache is being invalidate because project d975a93035594514bfdd2e06449dc955 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81361) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 02:30:18.259104 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-0730ebfd-c1bc-441e-9555-5abaf4c8db7c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:30:18.259719 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-0730ebfd-c1bc-441e-9555-5abaf4c8db7c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:30:18.262908 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 782/1560] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Oct 12 02:30:18 2022] DELETE /identity/v3/projects/d975a93035594514bfdd2e06449dc955 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 02:30:18.269155 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958f0027-bb04-493c-b743-bd0a2561176c None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:18.269658 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958f0027-bb04-493c-b743-bd0a2561176c None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:18.270426 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958f0027-bb04-493c-b743-bd0a2561176c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:18.302152 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-958f0027-bb04-493c-b743-bd0a2561176c None None] MFA Rules not processed for user `a326a5bb7364479382f528a592371656`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:30:18.303574 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-958f0027-bb04-493c-b743-bd0a2561176c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:30:18.386877 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 779/1561] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 02:30:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 02:30:18.397949 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cae18ea-0cee-48d6-8cc7-b01b3d669429 None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:18.398988 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cae18ea-0cee-48d6-8cc7-b01b3d669429 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:18.399348 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cae18ea-0cee-48d6-8cc7-b01b3d669429 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:18.425751 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-7cae18ea-0cee-48d6-8cc7-b01b3d669429 None None] MFA Rules not processed for user `a326a5bb7364479382f528a592371656`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:30:18.427501 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-7cae18ea-0cee-48d6-8cc7-b01b3d669429 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:30:18.441469 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 783/1562] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 02:30:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 02:30:18.445668 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958f0027-bb04-493c-b743-bd0a2561176c None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:30:18.496823 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958f0027-bb04-493c-b743-bd0a2561176c None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:30:18.510201 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8268c5-328e-460f-a793-4e7f2909dd59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:30:18.513240 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8268c5-328e-460f-a793-4e7f2909dd59 admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:18.513759 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8268c5-328e-460f-a793-4e7f2909dd59 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:18.516816 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8268c5-328e-460f-a793-4e7f2909dd59 admin admin] PATH_INFO: `/v3/domains` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:18.517521 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8268c5-328e-460f-a793-4e7f2909dd59 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 02:30:18.517829 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8268c5-328e-460f-a793-4e7f2909dd59 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:30:18.525738 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8268c5-328e-460f-a793-4e7f2909dd59 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:30:18.565644 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 780/1563] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Oct 12 02:30:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 02:30:18.567878 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cae18ea-0cee-48d6-8cc7-b01b3d669429 None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:30:18.580778 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cae18ea-0cee-48d6-8cc7-b01b3d669429 None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:30:18.590502 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92126eae-8ef6-4191-a51f-6005fdecc2e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:30:18.591338 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92126eae-8ef6-4191-a51f-6005fdecc2e3 admin admin] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:18.591794 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92126eae-8ef6-4191-a51f-6005fdecc2e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:18.592304 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92126eae-8ef6-4191-a51f-6005fdecc2e3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:18.593196 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92126eae-8ef6-4191-a51f-6005fdecc2e3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:30:18.595898 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92126eae-8ef6-4191-a51f-6005fdecc2e3 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:30:18.651357 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 784/1564] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Oct 12 02:30:18 2022] POST /identity/v3/projects => generated 385 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 02:30:18.651566 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8268c5-328e-460f-a793-4e7f2909dd59 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:30:18.666515 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8268c5-328e-460f-a793-4e7f2909dd59 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:30:18.729151 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92126eae-8ef6-4191-a51f-6005fdecc2e3 admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:30:18.732161 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-92126eae-8ef6-4191-a51f-6005fdecc2e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:30:18.798907 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aeaf666-63e0-491f-899f-aed69d274d61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:30:18.800972 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aeaf666-63e0-491f-899f-aed69d274d61 admin admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:18.801252 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aeaf666-63e0-491f-899f-aed69d274d61 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:18.801526 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aeaf666-63e0-491f-899f-aed69d274d61 admin admin] PATH_INFO: `/v3/users` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:18.802188 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aeaf666-63e0-491f-899f-aed69d274d61 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:30:18.808204 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aeaf666-63e0-491f-899f-aed69d274d61 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:30:18.835463 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=96,keystone:DELETE=2,keystone:INSERT=2 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:30:18.871890 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 781/1565] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Oct 12 02:30:18 2022] POST /identity/v3/users => generated 293 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 02:30:18.877084 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aeaf666-63e0-491f-899f-aed69d274d61 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:30:18.898244 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aeaf666-63e0-491f-899f-aed69d274d61 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:30:18.912617 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92126eae-8ef6-4191-a51f-6005fdecc2e3 admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:30:18.914165 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2639a8-55e6-4d71-be13-1f349b31e8d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:30:18.915295 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2639a8-55e6-4d71-be13-1f349b31e8d5 admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:18.915691 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2639a8-55e6-4d71-be13-1f349b31e8d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:18.916182 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2639a8-55e6-4d71-be13-1f349b31e8d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:18.917075 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2639a8-55e6-4d71-be13-1f349b31e8d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:30:18.919794 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2639a8-55e6-4d71-be13-1f349b31e8d5 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:30:18.924333 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aedb215-d8de-442d-9d63-faf08a0b26c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:30:18.925016 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aedb215-d8de-442d-9d63-faf08a0b26c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:18.925299 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aedb215-d8de-442d-9d63-faf08a0b26c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:18.925575 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aedb215-d8de-442d-9d63-faf08a0b26c1 admin admin] PATH_INFO: `/v3/projects/561b67741285489eb920ed8d588afc43` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:18.927008 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aedb215-d8de-442d-9d63-faf08a0b26c1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=561b67741285489eb920ed8d588afc43)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:30:18.933287 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aedb215-d8de-442d-9d63-faf08a0b26c1 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:30:18.937165 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 782/1566] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Oct 12 02:30:18 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 02:30:18.939966 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2639a8-55e6-4d71-be13-1f349b31e8d5 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:30:18.951206 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2639a8-55e6-4d71-be13-1f349b31e8d5 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:30:18.957663 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f59aed-1289-49fd-b06b-7f4a312a5699 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:30:18.958430 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f59aed-1289-49fd-b06b-7f4a312a5699 admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:18.960066 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f59aed-1289-49fd-b06b-7f4a312a5699 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:18.960066 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f59aed-1289-49fd-b06b-7f4a312a5699 admin admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:18.960066 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f59aed-1289-49fd-b06b-7f4a312a5699 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:30:18.962825 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f59aed-1289-49fd-b06b-7f4a312a5699 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:30:18.981464 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 783/1567] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Oct 12 02:30:18 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 12 02:30:18.995663 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f59aed-1289-49fd-b06b-7f4a312a5699 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:30:19.011179 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f59aed-1289-49fd-b06b-7f4a312a5699 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:30:19.019417 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9b02f7-7215-4fe3-9e41-779460180790 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:30:19.020662 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9b02f7-7215-4fe3-9e41-779460180790 admin admin] REQUEST_METHOD: `PUT` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:19.021044 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9b02f7-7215-4fe3-9e41-779460180790 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:19.021447 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9b02f7-7215-4fe3-9e41-779460180790 admin admin] PATH_INFO: `/v3/projects/72af44aa74bd411faf01e0f3dc3034f6/users/3426639214614a268cc8fd5531321633/roles/3d75c4d7f1a849b9a771504d1583ab28` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:19.041074 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9b02f7-7215-4fe3-9e41-779460180790 admin admin] RBAC: Authorizing `identity:create_grant(project_id=72af44aa74bd411faf01e0f3dc3034f6, user_id=3426639214614a268cc8fd5531321633, role_id=3d75c4d7f1a849b9a771504d1583ab28)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:30:19.044266 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9b02f7-7215-4fe3-9e41-779460180790 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:30:19.059388 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-2aedb215-d8de-442d-9d63-faf08a0b26c1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '561b67741285489eb920ed8d588afc43', 'request_id': 'req-2aedb215-d8de-442d-9d63-faf08a0b26c1'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:30:19.076171 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-2aedb215-d8de-442d-9d63-faf08a0b26c1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '561b67741285489eb920ed8d588afc43', 'request_id': 'req-2aedb215-d8de-442d-9d63-faf08a0b26c1'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:30:19.094981 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 784/1568] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Oct 12 02:30:18 2022] PUT /identity/v3/projects/72af44aa74bd411faf01e0f3dc3034f6/users/3426639214614a268cc8fd5531321633/roles/3d75c4d7f1a849b9a771504d1583ab28 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 02:30:19.100683 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816085fb-53e7-43fb-90ab-30c94b06ece4 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:19.101014 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816085fb-53e7-43fb-90ab-30c94b06ece4 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:19.102332 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816085fb-53e7-43fb-90ab-30c94b06ece4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:19.108145 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-2aedb215-d8de-442d-9d63-faf08a0b26c1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '561b67741285489eb920ed8d588afc43', 'request_id': 'req-2aedb215-d8de-442d-9d63-faf08a0b26c1'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:30:19.131815 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-2aedb215-d8de-442d-9d63-faf08a0b26c1 admin admin] The token cache is being invalidate because project 561b67741285489eb920ed8d588afc43 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81361) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 02:30:19.132910 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-2aedb215-d8de-442d-9d63-faf08a0b26c1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:30:19.134359 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-2aedb215-d8de-442d-9d63-faf08a0b26c1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:30:19.136828 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 785/1569] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Oct 12 02:30:18 2022] DELETE /identity/v3/projects/561b67741285489eb920ed8d588afc43 => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 02:30:19.145534 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58eb045-1067-4d0a-a596-6bd8a0b0a673 None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:19.145821 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58eb045-1067-4d0a-a596-6bd8a0b0a673 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:19.146170 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58eb045-1067-4d0a-a596-6bd8a0b0a673 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:19.169861 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-c58eb045-1067-4d0a-a596-6bd8a0b0a673 None None] MFA Rules not processed for user `a326a5bb7364479382f528a592371656`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:30:19.172256 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-c58eb045-1067-4d0a-a596-6bd8a0b0a673 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:30:19.183759 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-816085fb-53e7-43fb-90ab-30c94b06ece4 None None] MFA Rules not processed for user `3426639214614a268cc8fd5531321633`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:30:19.185301 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-816085fb-53e7-43fb-90ab-30c94b06ece4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:30:19.244605 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=89,keystone:INSERT=3,keystone:DELETE=8 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:30:19.318596 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 786/1570] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 02:30:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 02:30:19.322889 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3e8a54-d60c-4144-b8dc-184d7031b550 None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:19.323973 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3e8a54-d60c-4144-b8dc-184d7031b550 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:19.324258 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3e8a54-d60c-4144-b8dc-184d7031b550 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:19.369840 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-8d3e8a54-d60c-4144-b8dc-184d7031b550 None None] MFA Rules not processed for user `a326a5bb7364479382f528a592371656`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:30:19.374884 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 785/1571] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 02:30:19 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 02:30:19.376677 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816085fb-53e7-43fb-90ab-30c94b06ece4 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:30:19.377925 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-8d3e8a54-d60c-4144-b8dc-184d7031b550 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:30:19.378152 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-816085fb-53e7-43fb-90ab-30c94b06ece4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:30:19.406274 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816085fb-53e7-43fb-90ab-30c94b06ece4 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:30:19.418085 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae44f4e-0d28-487e-bf69-6c65a7cb16b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:30:19.418714 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae44f4e-0d28-487e-bf69-6c65a7cb16b3 admin admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:19.419044 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae44f4e-0d28-487e-bf69-6c65a7cb16b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:19.419258 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae44f4e-0d28-487e-bf69-6c65a7cb16b3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:19.420075 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae44f4e-0d28-487e-bf69-6c65a7cb16b3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:30:19.424119 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae44f4e-0d28-487e-bf69-6c65a7cb16b3 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:30:19.425908 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 787/1572] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 02:30:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 02:30:19.438075 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3e8a54-d60c-4144-b8dc-184d7031b550 None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:30:19.456963 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3e8a54-d60c-4144-b8dc-184d7031b550 None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:30:19.463813 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cf2a3e-c41d-4d47-b9f1-9641e4867541 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:30:19.465403 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cf2a3e-c41d-4d47-b9f1-9641e4867541 admin admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:19.465717 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cf2a3e-c41d-4d47-b9f1-9641e4867541 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:19.466369 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cf2a3e-c41d-4d47-b9f1-9641e4867541 admin admin] PATH_INFO: `/v3/domains` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:19.467450 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54cf2a3e-c41d-4d47-b9f1-9641e4867541 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 02:30:19.468644 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54cf2a3e-c41d-4d47-b9f1-9641e4867541 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:30:19.471602 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54cf2a3e-c41d-4d47-b9f1-9641e4867541 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:30:19.498820 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 788/1573] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Oct 12 02:30:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 02:30:19.500531 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cf2a3e-c41d-4d47-b9f1-9641e4867541 admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:30:19.511655 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 786/1574] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Oct 12 02:30:19 2022] POST /identity/v3/projects => generated 385 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 02:30:19.512888 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae44f4e-0d28-487e-bf69-6c65a7cb16b3 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:30:19.533061 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cf2a3e-c41d-4d47-b9f1-9641e4867541 admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:30:19.631328 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae44f4e-0d28-487e-bf69-6c65a7cb16b3 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:30:19.636648 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b0a562-d446-4e56-8440-d0097dbcf4c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:30:19.637248 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b0a562-d446-4e56-8440-d0097dbcf4c8 admin admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:19.637589 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b0a562-d446-4e56-8440-d0097dbcf4c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:19.637848 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b0a562-d446-4e56-8440-d0097dbcf4c8 admin admin] PATH_INFO: `/v3/users` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:19.638492 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b0a562-d446-4e56-8440-d0097dbcf4c8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:30:19.640778 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b0a562-d446-4e56-8440-d0097dbcf4c8 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:30:19.650631 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfdb437-31b4-4d50-8c88-9a60e7d5ce98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:30:19.652800 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfdb437-31b4-4d50-8c88-9a60e7d5ce98 admin admin] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:19.653086 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfdb437-31b4-4d50-8c88-9a60e7d5ce98 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:19.653360 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfdb437-31b4-4d50-8c88-9a60e7d5ce98 admin admin] PATH_INFO: `/v3/projects` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:19.655335 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfdb437-31b4-4d50-8c88-9a60e7d5ce98 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:30:19.659013 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfdb437-31b4-4d50-8c88-9a60e7d5ce98 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:30:19.672402 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 787/1575] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Oct 12 02:30:19 2022] POST /identity/v3/users => generated 293 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 02:30:19.682757 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b0a562-d446-4e56-8440-d0097dbcf4c8 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:30:19.692048 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:INSERT=6,keystone:SELECT=94 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:30:19.699108 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 789/1576] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Oct 12 02:30:19 2022] POST /identity/v3/projects => generated 399 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 02:30:19.699275 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b0a562-d446-4e56-8440-d0097dbcf4c8 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:30:19.700862 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfdb437-31b4-4d50-8c88-9a60e7d5ce98 admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:30:19.792685 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfdb437-31b4-4d50-8c88-9a60e7d5ce98 admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:30:19.801933 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07688ce3-b694-4bba-b00a-1baa9e583ffd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:30:19.802571 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07688ce3-b694-4bba-b00a-1baa9e583ffd admin admin] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:19.802890 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07688ce3-b694-4bba-b00a-1baa9e583ffd admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:19.803216 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07688ce3-b694-4bba-b00a-1baa9e583ffd admin admin] PATH_INFO: `/v3/users` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:19.803785 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07688ce3-b694-4bba-b00a-1baa9e583ffd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:30:19.805899 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07688ce3-b694-4bba-b00a-1baa9e583ffd admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:30:19.818243 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0911b9d5-6e96-40b5-a4e2-976816a5fc83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:30:19.819419 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0911b9d5-6e96-40b5-a4e2-976816a5fc83 admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:19.819833 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0911b9d5-6e96-40b5-a4e2-976816a5fc83 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:19.820245 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0911b9d5-6e96-40b5-a4e2-976816a5fc83 admin admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:19.821104 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0911b9d5-6e96-40b5-a4e2-976816a5fc83 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:30:19.822699 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0911b9d5-6e96-40b5-a4e2-976816a5fc83 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:30:19.835777 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 788/1577] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Oct 12 02:30:19 2022] GET /identity/v3/roles => generated 1420 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 12 02:30:19.839433 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0911b9d5-6e96-40b5-a4e2-976816a5fc83 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:30:19.846232 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 790/1578] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Oct 12 02:30:19 2022] POST /identity/v3/users => generated 300 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 02:30:19.850687 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07688ce3-b694-4bba-b00a-1baa9e583ffd admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:30:19.851435 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0911b9d5-6e96-40b5-a4e2-976816a5fc83 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:30:19.856722 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d25d08-9bbb-4a56-8eda-cba949d9b4c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:30:19.857364 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d25d08-9bbb-4a56-8eda-cba949d9b4c9 admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:19.858575 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d25d08-9bbb-4a56-8eda-cba949d9b4c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:19.858939 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d25d08-9bbb-4a56-8eda-cba949d9b4c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:19.859881 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d25d08-9bbb-4a56-8eda-cba949d9b4c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:30:19.862483 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d25d08-9bbb-4a56-8eda-cba949d9b4c9 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:30:19.866248 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07688ce3-b694-4bba-b00a-1baa9e583ffd admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:30:19.873178 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39c05ac-68da-46ec-b040-518521a12d20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:30:19.873971 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39c05ac-68da-46ec-b040-518521a12d20 admin admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:19.875010 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39c05ac-68da-46ec-b040-518521a12d20 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:19.875391 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39c05ac-68da-46ec-b040-518521a12d20 admin admin] PATH_INFO: `/v3/roles` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:19.876084 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39c05ac-68da-46ec-b040-518521a12d20 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:30:19.878149 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39c05ac-68da-46ec-b040-518521a12d20 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:30:19.891364 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 791/1579] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Oct 12 02:30:19 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 02:30:19.895419 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39c05ac-68da-46ec-b040-518521a12d20 admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:30:19.896440 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 789/1580] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Oct 12 02:30:19 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 02:30:19.900735 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d25d08-9bbb-4a56-8eda-cba949d9b4c9 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:30:19.912182 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39c05ac-68da-46ec-b040-518521a12d20 admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:30:19.917188 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e08a313-bf6a-4fb8-98b0-48d985e70529 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:30:19.918447 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e08a313-bf6a-4fb8-98b0-48d985e70529 admin admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:19.918628 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e08a313-bf6a-4fb8-98b0-48d985e70529 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:19.919028 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e08a313-bf6a-4fb8-98b0-48d985e70529 admin admin] PATH_INFO: `/v3/roles` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:19.919690 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e08a313-bf6a-4fb8-98b0-48d985e70529 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:30:19.924408 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e08a313-bf6a-4fb8-98b0-48d985e70529 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:30:19.934548 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d25d08-9bbb-4a56-8eda-cba949d9b4c9 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:30:19.947390 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ab4fe9-50d8-45b1-a2f5-f8cda5a5e9b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:30:19.948133 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ab4fe9-50d8-45b1-a2f5-f8cda5a5e9b5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:19.948524 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ab4fe9-50d8-45b1-a2f5-f8cda5a5e9b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:19.948869 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ab4fe9-50d8-45b1-a2f5-f8cda5a5e9b5 admin admin] PATH_INFO: `/v3/projects/7d9b8f577d4840fba000dcf5c62181cf/users/ec29ddb9eece44b6b81191a7cb4ec7ee/roles/3d75c4d7f1a849b9a771504d1583ab28` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:19.952958 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 792/1581] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Oct 12 02:30:19 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 02:30:19.955306 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e08a313-bf6a-4fb8-98b0-48d985e70529 admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:30:19.973363 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ab4fe9-50d8-45b1-a2f5-f8cda5a5e9b5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7d9b8f577d4840fba000dcf5c62181cf, user_id=ec29ddb9eece44b6b81191a7cb4ec7ee, role_id=3d75c4d7f1a849b9a771504d1583ab28)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:30:19.976271 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ab4fe9-50d8-45b1-a2f5-f8cda5a5e9b5 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:30:19.982371 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e08a313-bf6a-4fb8-98b0-48d985e70529 admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:30:19.991171 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5072888e-4f37-49e0-aa98-be1f5716e4ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:30:19.991979 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5072888e-4f37-49e0-aa98-be1f5716e4ee admin admin] REQUEST_METHOD: `PUT` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:19.992456 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5072888e-4f37-49e0-aa98-be1f5716e4ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:19.992594 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5072888e-4f37-49e0-aa98-be1f5716e4ee admin admin] PATH_INFO: `/v3/projects/a3ca859be8b54083af44c382e88c8e71/users/34bfc7464ef44ca7ad5c80772673fa91/roles/3d75c4d7f1a849b9a771504d1583ab28` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:20.001558 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 790/1582] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Oct 12 02:30:19 2022] PUT /identity/v3/projects/7d9b8f577d4840fba000dcf5c62181cf/users/ec29ddb9eece44b6b81191a7cb4ec7ee/roles/3d75c4d7f1a849b9a771504d1583ab28 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 02:30:20.012691 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2421ade-ac52-4324-ba15-be84894fae58 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:20.012968 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2421ade-ac52-4324-ba15-be84894fae58 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:20.013297 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2421ade-ac52-4324-ba15-be84894fae58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:20.023620 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5072888e-4f37-49e0-aa98-be1f5716e4ee admin admin] RBAC: Authorizing `identity:create_grant(project_id=a3ca859be8b54083af44c382e88c8e71, user_id=34bfc7464ef44ca7ad5c80772673fa91, role_id=3d75c4d7f1a849b9a771504d1583ab28)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:30:20.026560 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5072888e-4f37-49e0-aa98-be1f5716e4ee admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:30:20.030869 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:30:20.051746 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 793/1583] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Oct 12 02:30:19 2022] PUT /identity/v3/projects/a3ca859be8b54083af44c382e88c8e71/users/34bfc7464ef44ca7ad5c80772673fa91/roles/3d75c4d7f1a849b9a771504d1583ab28 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 02:30:20.054259 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a388ae9f-540c-473b-917d-efcb077777e5 None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:20.054734 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a388ae9f-540c-473b-917d-efcb077777e5 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:20.055193 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a388ae9f-540c-473b-917d-efcb077777e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:20.058630 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-e2421ade-ac52-4324-ba15-be84894fae58 None None] MFA Rules not processed for user `ec29ddb9eece44b6b81191a7cb4ec7ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:30:20.060152 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-e2421ade-ac52-4324-ba15-be84894fae58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:30:20.087833 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-a388ae9f-540c-473b-917d-efcb077777e5 None None] MFA Rules not processed for user `34bfc7464ef44ca7ad5c80772673fa91`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:30:20.089213 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-a388ae9f-540c-473b-917d-efcb077777e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:30:20.154344 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 791/1584] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 02:30:20 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 02:30:20.160349 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2421ade-ac52-4324-ba15-be84894fae58 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:30:20.175415 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 794/1585] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 02:30:20 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 02:30:20.183807 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a388ae9f-540c-473b-917d-efcb077777e5 None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:30:20.186581 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-a388ae9f-540c-473b-917d-efcb077777e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:30:20.257447 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a388ae9f-540c-473b-917d-efcb077777e5 None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:30:20.257658 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:30:20.261270 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ec6234-83ef-43e3-80b3-d6057ab63c6e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ba688e0c4d44d13898539ee886f95fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'beb6def6fcad45959e56425bb8bff4d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:30:20.261942 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ec6234-83ef-43e3-80b3-d6057ab63c6e service cinder] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:20.262222 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ec6234-83ef-43e3-80b3-d6057ab63c6e service cinder] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:20.262493 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ec6234-83ef-43e3-80b3-d6057ab63c6e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:20.271688 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ec6234-83ef-43e3-80b3-d6057ab63c6e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:30:20.272774 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2421ade-ac52-4324-ba15-be84894fae58 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:30:20.280160 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce75a4cb-6f5b-4eb6-8c7e-0b8ab272a17b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:30:20.281123 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce75a4cb-6f5b-4eb6-8c7e-0b8ab272a17b admin admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:20.281498 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce75a4cb-6f5b-4eb6-8c7e-0b8ab272a17b admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:20.281840 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce75a4cb-6f5b-4eb6-8c7e-0b8ab272a17b admin admin] PATH_INFO: `/v3/projects` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:20.282553 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce75a4cb-6f5b-4eb6-8c7e-0b8ab272a17b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:30:20.284571 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ec6234-83ef-43e3-80b3-d6057ab63c6e service cinder] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:30:20.284987 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce75a4cb-6f5b-4eb6-8c7e-0b8ab272a17b admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:30:20.309642 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 795/1586] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 02:30:20 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 12 02:30:20.340627 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 792/1587] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Oct 12 02:30:20 2022] POST /identity/v3/projects => generated 385 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 02:30:20.342748 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ec6234-83ef-43e3-80b3-d6057ab63c6e service cinder] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:30:20.355495 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ec6234-83ef-43e3-80b3-d6057ab63c6e service cinder] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:30:20.435230 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aab4b7c-43bc-470c-a172-4dee6c08c200 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:30:20.435991 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aab4b7c-43bc-470c-a172-4dee6c08c200 admin admin] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:20.435991 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aab4b7c-43bc-470c-a172-4dee6c08c200 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:20.436775 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aab4b7c-43bc-470c-a172-4dee6c08c200 admin admin] PATH_INFO: `/v3/users` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:20.437606 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aab4b7c-43bc-470c-a172-4dee6c08c200 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:30:20.439744 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aab4b7c-43bc-470c-a172-4dee6c08c200 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:30:20.469008 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 796/1588] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Oct 12 02:30:20 2022] POST /identity/v3/users => generated 299 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 02:30:20.474814 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce75a4cb-6f5b-4eb6-8c7e-0b8ab272a17b admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:30:20.489156 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce75a4cb-6f5b-4eb6-8c7e-0b8ab272a17b admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:30:20.510296 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ede344-90be-4995-aac7-d63586c7656a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:30:20.511294 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ede344-90be-4995-aac7-d63586c7656a admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:20.511726 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ede344-90be-4995-aac7-d63586c7656a admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:20.512150 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ede344-90be-4995-aac7-d63586c7656a admin admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:20.514993 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ede344-90be-4995-aac7-d63586c7656a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:30:20.520688 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ede344-90be-4995-aac7-d63586c7656a admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:30:20.552524 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 793/1589] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Oct 12 02:30:20 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 12 02:30:20.555990 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aab4b7c-43bc-470c-a172-4dee6c08c200 admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:30:20.571614 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aab4b7c-43bc-470c-a172-4dee6c08c200 admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:30:20.578514 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2010c0-50f7-4d0f-b024-245f655c6bee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:30:20.579586 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2010c0-50f7-4d0f-b024-245f655c6bee admin admin] REQUEST_METHOD: `PUT` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:20.580072 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2010c0-50f7-4d0f-b024-245f655c6bee admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:20.580725 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2010c0-50f7-4d0f-b024-245f655c6bee admin admin] PATH_INFO: `/v3/projects/3b3e3bd91ac0480e8ff0e32d5f0416ba/users/7a0aa53f48f248ef86d14b3b1b4b7e6f/roles/39b1e8108dff402383def3c559f48189` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:20.601526 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2010c0-50f7-4d0f-b024-245f655c6bee admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b3e3bd91ac0480e8ff0e32d5f0416ba, user_id=7a0aa53f48f248ef86d14b3b1b4b7e6f, role_id=39b1e8108dff402383def3c559f48189)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:30:20.613316 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2010c0-50f7-4d0f-b024-245f655c6bee admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:30:20.617105 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:30:20.638438 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 797/1590] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Oct 12 02:30:20 2022] PUT /identity/v3/projects/3b3e3bd91ac0480e8ff0e32d5f0416ba/users/7a0aa53f48f248ef86d14b3b1b4b7e6f/roles/39b1e8108dff402383def3c559f48189 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 02:30:20.643561 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ede344-90be-4995-aac7-d63586c7656a admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:30:20.657534 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ede344-90be-4995-aac7-d63586c7656a admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:30:20.749981 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8d3427-93e4-4171-b67b-684a404a40b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:30:20.750627 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8d3427-93e4-4171-b67b-684a404a40b1 admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:20.750905 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8d3427-93e4-4171-b67b-684a404a40b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:20.751173 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8d3427-93e4-4171-b67b-684a404a40b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:20.751823 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8d3427-93e4-4171-b67b-684a404a40b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:30:20.753445 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8d3427-93e4-4171-b67b-684a404a40b1 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:30:20.775771 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 794/1591] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Oct 12 02:30:20 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 02:30:20.777043 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2010c0-50f7-4d0f-b024-245f655c6bee admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:30:20.789661 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2010c0-50f7-4d0f-b024-245f655c6bee admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:30:20.796530 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60253ac-8ef8-4b19-a22f-230e1b1cd5e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:30:20.797378 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60253ac-8ef8-4b19-a22f-230e1b1cd5e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:20.797597 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60253ac-8ef8-4b19-a22f-230e1b1cd5e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:20.797862 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60253ac-8ef8-4b19-a22f-230e1b1cd5e2 admin admin] PATH_INFO: `/v3/projects/3b3e3bd91ac0480e8ff0e32d5f0416ba/users/7a0aa53f48f248ef86d14b3b1b4b7e6f/roles/39b1e8108dff402383def3c559f48189` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:20.799934 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60253ac-8ef8-4b19-a22f-230e1b1cd5e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b3e3bd91ac0480e8ff0e32d5f0416ba, user_id=7a0aa53f48f248ef86d14b3b1b4b7e6f, role_id=39b1e8108dff402383def3c559f48189)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:30:20.803636 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60253ac-8ef8-4b19-a22f-230e1b1cd5e2 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:30:20.822446 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 798/1592] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Oct 12 02:30:20 2022] PUT /identity/v3/projects/3b3e3bd91ac0480e8ff0e32d5f0416ba/users/7a0aa53f48f248ef86d14b3b1b4b7e6f/roles/39b1e8108dff402383def3c559f48189 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 02:30:20.833603 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95b0afb-d8d5-4711-bc49-242a11aa9fd8 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:20.834092 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95b0afb-d8d5-4711-bc49-242a11aa9fd8 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:20.834170 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95b0afb-d8d5-4711-bc49-242a11aa9fd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:20.869461 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-b95b0afb-d8d5-4711-bc49-242a11aa9fd8 None None] MFA Rules not processed for user `7a0aa53f48f248ef86d14b3b1b4b7e6f`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:30:20.869461 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-b95b0afb-d8d5-4711-bc49-242a11aa9fd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:30:20.955535 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 795/1593] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 02:30:20 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 02:30:20.973068 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60253ac-8ef8-4b19-a22f-230e1b1cd5e2 admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:30:21.056187 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60253ac-8ef8-4b19-a22f-230e1b1cd5e2 admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:30:21.060414 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479bf1b5-1186-422c-91a9-ff28b36516bc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ba688e0c4d44d13898539ee886f95fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'beb6def6fcad45959e56425bb8bff4d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:30:21.061976 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479bf1b5-1186-422c-91a9-ff28b36516bc service cinder] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:21.062329 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479bf1b5-1186-422c-91a9-ff28b36516bc service cinder] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:21.062718 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479bf1b5-1186-422c-91a9-ff28b36516bc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:21.082090 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479bf1b5-1186-422c-91a9-ff28b36516bc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:30:21.084449 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479bf1b5-1186-422c-91a9-ff28b36516bc service cinder] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:30:21.112431 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 799/1594] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 02:30:20 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 02:30:21.139330 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95b0afb-d8d5-4711-bc49-242a11aa9fd8 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:30:21.142818 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-b95b0afb-d8d5-4711-bc49-242a11aa9fd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:30:21.284258 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:30:21.307619 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95b0afb-d8d5-4711-bc49-242a11aa9fd8 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:30:21.314828 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4327b6-330c-4246-9119-dac1cf70393e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:30:21.315899 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4327b6-330c-4246-9119-dac1cf70393e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:21.316389 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4327b6-330c-4246-9119-dac1cf70393e admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:21.317122 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4327b6-330c-4246-9119-dac1cf70393e admin admin] PATH_INFO: `/v3/users/548825f395d54f93be99ab36bf48dbb3` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:21.318797 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4327b6-330c-4246-9119-dac1cf70393e admin admin] RBAC: Authorizing `identity:delete_user(user_id=548825f395d54f93be99ab36bf48dbb3)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:30:21.321558 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4327b6-330c-4246-9119-dac1cf70393e admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:30:21.427533 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-3d4327b6-330c-4246-9119-dac1cf70393e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '548825f395d54f93be99ab36bf48dbb3'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:30:21.445779 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-3d4327b6-330c-4246-9119-dac1cf70393e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '548825f395d54f93be99ab36bf48dbb3'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:30:21.469010 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-3d4327b6-330c-4246-9119-dac1cf70393e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '548825f395d54f93be99ab36bf48dbb3'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:30:21.481762 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-3d4327b6-330c-4246-9119-dac1cf70393e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '548825f395d54f93be99ab36bf48dbb3'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:30:21.483253 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-3d4327b6-330c-4246-9119-dac1cf70393e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '548825f395d54f93be99ab36bf48dbb3'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:30:21.494424 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 796/1595] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Oct 12 02:30:21 2022] DELETE /identity/v3/users/548825f395d54f93be99ab36bf48dbb3 => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 02:30:21.500218 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8e8c56-eddd-4a19-8019-7e05c432bb65 None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:21.500873 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8e8c56-eddd-4a19-8019-7e05c432bb65 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:21.501271 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8e8c56-eddd-4a19-8019-7e05c432bb65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:21.534569 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-cf8e8c56-eddd-4a19-8019-7e05c432bb65 None None] MFA Rules not processed for user `a326a5bb7364479382f528a592371656`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:30:21.535945 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-cf8e8c56-eddd-4a19-8019-7e05c432bb65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:30:21.637425 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 800/1596] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 02:30:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 02:30:21.654711 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4327b6-330c-4246-9119-dac1cf70393e admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:30:21.658163 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-3d4327b6-330c-4246-9119-dac1cf70393e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:30:21.749765 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4327b6-330c-4246-9119-dac1cf70393e admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:30:21.753999 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba72858-2a50-459d-8cc9-c0a8df69d853 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5223b5cab3114e9b9a13c582f8ef8386', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'beb6def6fcad45959e56425bb8bff4d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:30:21.754702 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba72858-2a50-459d-8cc9-c0a8df69d853 service neutron] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:21.755082 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba72858-2a50-459d-8cc9-c0a8df69d853 service neutron] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:21.755423 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba72858-2a50-459d-8cc9-c0a8df69d853 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:21.767574 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba72858-2a50-459d-8cc9-c0a8df69d853 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:30:21.769939 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba72858-2a50-459d-8cc9-c0a8df69d853 service neutron] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:30:21.781677 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 797/1597] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 02:30:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 02:30:22.200144 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8e8c56-eddd-4a19-8019-7e05c432bb65 None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:30:22.203046 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-cf8e8c56-eddd-4a19-8019-7e05c432bb65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:30:22.213864 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba72858-2a50-459d-8cc9-c0a8df69d853 service neutron] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:30:22.216633 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-0ba72858-2a50-459d-8cc9-c0a8df69d853 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:30:22.243541 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba72858-2a50-459d-8cc9-c0a8df69d853 service neutron] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:30:22.249872 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a0ce2f-f03a-470b-b6e4-eef825489bec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:30:22.250586 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a0ce2f-f03a-470b-b6e4-eef825489bec admin admin] REQUEST_METHOD: `DELETE` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:22.250832 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a0ce2f-f03a-470b-b6e4-eef825489bec admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:22.251103 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a0ce2f-f03a-470b-b6e4-eef825489bec admin admin] PATH_INFO: `/v3/projects/7ba73344b23c4cd99db44a10033a5363` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:22.252356 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a0ce2f-f03a-470b-b6e4-eef825489bec admin admin] RBAC: Authorizing `identity:delete_project(project_id=7ba73344b23c4cd99db44a10033a5363)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:30:22.254324 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a0ce2f-f03a-470b-b6e4-eef825489bec admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:30:22.301695 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8e8c56-eddd-4a19-8019-7e05c432bb65 None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:30:22.353322 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-29a0ce2f-f03a-470b-b6e4-eef825489bec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7ba73344b23c4cd99db44a10033a5363', 'request_id': 'req-29a0ce2f-f03a-470b-b6e4-eef825489bec'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:30:22.366761 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:30:22.374953 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-29a0ce2f-f03a-470b-b6e4-eef825489bec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7ba73344b23c4cd99db44a10033a5363', 'request_id': 'req-29a0ce2f-f03a-470b-b6e4-eef825489bec'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:30:22.388457 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18253b71-f888-47f1-8396-4c48b96033cc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ba688e0c4d44d13898539ee886f95fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'beb6def6fcad45959e56425bb8bff4d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:30:22.389968 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-29a0ce2f-f03a-470b-b6e4-eef825489bec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7ba73344b23c4cd99db44a10033a5363', 'request_id': 'req-29a0ce2f-f03a-470b-b6e4-eef825489bec'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:30:22.390445 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18253b71-f888-47f1-8396-4c48b96033cc service cinder] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:22.390740 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18253b71-f888-47f1-8396-4c48b96033cc service cinder] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:22.391002 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18253b71-f888-47f1-8396-4c48b96033cc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:22.393551 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-18253b71-f888-47f1-8396-4c48b96033cc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:30:22.403049 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:30:22.419192 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-29a0ce2f-f03a-470b-b6e4-eef825489bec admin admin] The token cache is being invalidate because project 7ba73344b23c4cd99db44a10033a5363 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81362) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 02:30:22.419870 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-29a0ce2f-f03a-470b-b6e4-eef825489bec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:30:22.421133 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-29a0ce2f-f03a-470b-b6e4-eef825489bec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:30:22.424235 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 798/1598] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Oct 12 02:30:22 2022] DELETE /identity/v3/projects/7ba73344b23c4cd99db44a10033a5363 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 02:30:22.428121 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a0ce2f-f03a-470b-b6e4-eef825489bec admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:30:22.433914 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-29a0ce2f-f03a-470b-b6e4-eef825489bec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:30:22.495754 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18253b71-f888-47f1-8396-4c48b96033cc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:30:22.497643 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18253b71-f888-47f1-8396-4c48b96033cc service cinder] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:30:22.517661 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 801/1599] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 02:30:22 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 02:30:22.553226 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a0ce2f-f03a-470b-b6e4-eef825489bec admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:30:22.557745 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c27fe9-152d-40f8-82eb-3be7b5003013 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:30:22.558991 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c27fe9-152d-40f8-82eb-3be7b5003013 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:22.559272 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c27fe9-152d-40f8-82eb-3be7b5003013 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:22.559543 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c27fe9-152d-40f8-82eb-3be7b5003013 admin admin] PATH_INFO: `/v3/users/fb2a0f2dff1d429690b504900522c390` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:22.561610 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c27fe9-152d-40f8-82eb-3be7b5003013 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fb2a0f2dff1d429690b504900522c390)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:30:22.563689 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c27fe9-152d-40f8-82eb-3be7b5003013 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:30:22.638016 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-b9c27fe9-152d-40f8-82eb-3be7b5003013 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fb2a0f2dff1d429690b504900522c390'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:30:22.646984 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-b9c27fe9-152d-40f8-82eb-3be7b5003013 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fb2a0f2dff1d429690b504900522c390'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:30:22.662676 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-b9c27fe9-152d-40f8-82eb-3be7b5003013 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fb2a0f2dff1d429690b504900522c390'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:30:22.672589 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-b9c27fe9-152d-40f8-82eb-3be7b5003013 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fb2a0f2dff1d429690b504900522c390'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:30:22.673388 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-b9c27fe9-152d-40f8-82eb-3be7b5003013 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fb2a0f2dff1d429690b504900522c390'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:30:22.682816 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 799/1600] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Oct 12 02:30:22 2022] DELETE /identity/v3/users/fb2a0f2dff1d429690b504900522c390 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 02:30:23.093214 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18253b71-f888-47f1-8396-4c48b96033cc service cinder] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:30:23.105698 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18253b71-f888-47f1-8396-4c48b96033cc service cinder] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:30:23.168523 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8533ce7a-59af-4849-883f-5d6bc5602029 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:30:23.169164 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8533ce7a-59af-4849-883f-5d6bc5602029 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:23.169444 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8533ce7a-59af-4849-883f-5d6bc5602029 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:23.169719 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8533ce7a-59af-4849-883f-5d6bc5602029 admin admin] PATH_INFO: `/v3/projects/a740ae5ce8514212936452750f5d558d` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:23.171248 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8533ce7a-59af-4849-883f-5d6bc5602029 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a740ae5ce8514212936452750f5d558d)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:30:23.173202 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8533ce7a-59af-4849-883f-5d6bc5602029 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:30:23.226319 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-8533ce7a-59af-4849-883f-5d6bc5602029 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a740ae5ce8514212936452750f5d558d', 'request_id': 'req-8533ce7a-59af-4849-883f-5d6bc5602029'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:30:23.232100 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-8533ce7a-59af-4849-883f-5d6bc5602029 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a740ae5ce8514212936452750f5d558d', 'request_id': 'req-8533ce7a-59af-4849-883f-5d6bc5602029'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:30:23.239024 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-8533ce7a-59af-4849-883f-5d6bc5602029 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a740ae5ce8514212936452750f5d558d', 'request_id': 'req-8533ce7a-59af-4849-883f-5d6bc5602029'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:30:23.252012 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-8533ce7a-59af-4849-883f-5d6bc5602029 admin admin] The token cache is being invalidate because project a740ae5ce8514212936452750f5d558d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81361) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 02:30:23.252299 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-8533ce7a-59af-4849-883f-5d6bc5602029 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:30:23.252936 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-8533ce7a-59af-4849-883f-5d6bc5602029 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:30:23.254403 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 802/1601] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Oct 12 02:30:23 2022] DELETE /identity/v3/projects/a740ae5ce8514212936452750f5d558d => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 02:30:23.259346 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ce60dd-588e-4b13-a6ba-fd8db3809454 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:23.259801 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ce60dd-588e-4b13-a6ba-fd8db3809454 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:23.259889 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ce60dd-588e-4b13-a6ba-fd8db3809454 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:23.279973 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-81ce60dd-588e-4b13-a6ba-fd8db3809454 None None] MFA Rules not processed for user `a326a5bb7364479382f528a592371656`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:30:23.281202 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-81ce60dd-588e-4b13-a6ba-fd8db3809454 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:30:23.339112 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 800/1602] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 02:30:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 02:30:23.347011 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246d53e6-b5c3-43aa-bcd1-e3007fa19621 None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:23.347315 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246d53e6-b5c3-43aa-bcd1-e3007fa19621 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:23.347583 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246d53e6-b5c3-43aa-bcd1-e3007fa19621 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:23.367241 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-246d53e6-b5c3-43aa-bcd1-e3007fa19621 None None] MFA Rules not processed for user `a326a5bb7364479382f528a592371656`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:30:23.368426 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-246d53e6-b5c3-43aa-bcd1-e3007fa19621 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:30:23.377086 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 803/1603] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 02:30:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 02:30:23.381239 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ce60dd-588e-4b13-a6ba-fd8db3809454 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:30:23.391455 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ce60dd-588e-4b13-a6ba-fd8db3809454 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:30:23.395968 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0af228-c96a-46c4-a735-0902de7cac7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:30:23.396582 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0af228-c96a-46c4-a735-0902de7cac7f admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:23.396862 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0af228-c96a-46c4-a735-0902de7cac7f admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:23.397133 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0af228-c96a-46c4-a735-0902de7cac7f admin admin] PATH_INFO: `/v3/domains` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:23.397803 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0af228-c96a-46c4-a735-0902de7cac7f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 02:30:23.398084 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0af228-c96a-46c4-a735-0902de7cac7f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:30:23.399657 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0af228-c96a-46c4-a735-0902de7cac7f admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:30:23.411491 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 801/1604] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Oct 12 02:30:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 02:30:23.416078 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246d53e6-b5c3-43aa-bcd1-e3007fa19621 None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:30:23.425607 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246d53e6-b5c3-43aa-bcd1-e3007fa19621 None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:30:23.436241 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c11c992-81ce-4559-9981-819d3be78345 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:30:23.436881 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c11c992-81ce-4559-9981-819d3be78345 admin admin] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:23.437169 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c11c992-81ce-4559-9981-819d3be78345 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:23.437441 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c11c992-81ce-4559-9981-819d3be78345 admin admin] PATH_INFO: `/v3/projects` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:23.438087 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c11c992-81ce-4559-9981-819d3be78345 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:30:23.439968 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c11c992-81ce-4559-9981-819d3be78345 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:30:23.457522 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:30:23.475387 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 804/1605] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Oct 12 02:30:23 2022] POST /identity/v3/projects => generated 383 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 02:30:23.476502 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0af228-c96a-46c4-a735-0902de7cac7f admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:30:23.481799 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:30:23.489037 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0af228-c96a-46c4-a735-0902de7cac7f admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:30:23.556382 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3e8462-98ba-496b-a4d5-55aab49390b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:30:23.557025 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3e8462-98ba-496b-a4d5-55aab49390b5 admin admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:23.557394 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3e8462-98ba-496b-a4d5-55aab49390b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:23.557669 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3e8462-98ba-496b-a4d5-55aab49390b5 admin admin] PATH_INFO: `/v3/users` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:23.558289 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3e8462-98ba-496b-a4d5-55aab49390b5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:30:23.560536 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3e8462-98ba-496b-a4d5-55aab49390b5 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:30:23.595513 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 802/1606] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Oct 12 02:30:23 2022] POST /identity/v3/users => generated 292 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 02:30:23.600987 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c11c992-81ce-4559-9981-819d3be78345 admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:30:23.612646 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c11c992-81ce-4559-9981-819d3be78345 admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:30:23.617901 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd67bc6d-2dae-4166-93e0-12c2f4dc5804 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:30:23.618605 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd67bc6d-2dae-4166-93e0-12c2f4dc5804 admin admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:23.618891 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd67bc6d-2dae-4166-93e0-12c2f4dc5804 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:23.619182 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd67bc6d-2dae-4166-93e0-12c2f4dc5804 admin admin] PATH_INFO: `/v3/roles` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:23.619886 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd67bc6d-2dae-4166-93e0-12c2f4dc5804 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:30:23.622321 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd67bc6d-2dae-4166-93e0-12c2f4dc5804 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:30:23.637796 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 805/1607] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Oct 12 02:30:23 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 02:30:23.642813 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3e8462-98ba-496b-a4d5-55aab49390b5 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:30:23.652985 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3e8462-98ba-496b-a4d5-55aab49390b5 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:30:23.659459 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e866a31-98ab-4d6c-806a-2f04a5b84e72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:30:23.660154 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e866a31-98ab-4d6c-806a-2f04a5b84e72 admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:23.660533 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e866a31-98ab-4d6c-806a-2f04a5b84e72 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:23.660907 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e866a31-98ab-4d6c-806a-2f04a5b84e72 admin admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:23.661744 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e866a31-98ab-4d6c-806a-2f04a5b84e72 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:30:23.663448 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e866a31-98ab-4d6c-806a-2f04a5b84e72 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:30:23.675929 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 803/1608] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Oct 12 02:30:23 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 02:30:23.680330 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd67bc6d-2dae-4166-93e0-12c2f4dc5804 admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:30:23.694450 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd67bc6d-2dae-4166-93e0-12c2f4dc5804 admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:30:23.699194 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d5688e-ec9c-4f02-a7d0-77deb439d5a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:30:23.699832 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d5688e-ec9c-4f02-a7d0-77deb439d5a9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:23.700114 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d5688e-ec9c-4f02-a7d0-77deb439d5a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:23.700390 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d5688e-ec9c-4f02-a7d0-77deb439d5a9 admin admin] PATH_INFO: `/v3/projects/eadcdfd888eb4a91896b88ed3fdcb348/users/53379dc9b0064b3891fad6eef1ff5bfc/roles/3d75c4d7f1a849b9a771504d1583ab28` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:23.718607 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d5688e-ec9c-4f02-a7d0-77deb439d5a9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eadcdfd888eb4a91896b88ed3fdcb348, user_id=53379dc9b0064b3891fad6eef1ff5bfc, role_id=3d75c4d7f1a849b9a771504d1583ab28)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:30:23.721845 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d5688e-ec9c-4f02-a7d0-77deb439d5a9 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:30:23.739824 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 806/1609] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Oct 12 02:30:23 2022] PUT /identity/v3/projects/eadcdfd888eb4a91896b88ed3fdcb348/users/53379dc9b0064b3891fad6eef1ff5bfc/roles/3d75c4d7f1a849b9a771504d1583ab28 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 02:30:23.752210 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391b94f4-1477-4883-9b2a-f5dd783f257d None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:23.752531 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391b94f4-1477-4883-9b2a-f5dd783f257d None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:23.752815 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391b94f4-1477-4883-9b2a-f5dd783f257d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:23.783294 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-391b94f4-1477-4883-9b2a-f5dd783f257d None None] MFA Rules not processed for user `53379dc9b0064b3891fad6eef1ff5bfc`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:30:23.784551 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-391b94f4-1477-4883-9b2a-f5dd783f257d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:30:23.863417 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 804/1610] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 02:30:23 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 02:30:23.868053 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d5688e-ec9c-4f02-a7d0-77deb439d5a9 admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:30:23.937019 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d5688e-ec9c-4f02-a7d0-77deb439d5a9 admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:30:23.943453 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182fd89a-29ae-4928-abc4-bef9339325e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:30:23.944435 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182fd89a-29ae-4928-abc4-bef9339325e1 admin admin] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:23.944941 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182fd89a-29ae-4928-abc4-bef9339325e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:23.945409 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182fd89a-29ae-4928-abc4-bef9339325e1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:23.946505 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182fd89a-29ae-4928-abc4-bef9339325e1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:30:23.948921 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182fd89a-29ae-4928-abc4-bef9339325e1 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:30:23.997538 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 807/1611] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Oct 12 02:30:23 2022] POST /identity/v3/projects => generated 383 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 02:30:24.001670 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391b94f4-1477-4883-9b2a-f5dd783f257d None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:30:24.016907 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391b94f4-1477-4883-9b2a-f5dd783f257d None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:30:24.093368 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adebbcee-87ff-4d2c-8978-cb254e3d132d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:30:24.094026 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adebbcee-87ff-4d2c-8978-cb254e3d132d admin admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:24.094293 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adebbcee-87ff-4d2c-8978-cb254e3d132d admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:24.094563 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adebbcee-87ff-4d2c-8978-cb254e3d132d admin admin] PATH_INFO: `/v3/users` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:24.095200 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adebbcee-87ff-4d2c-8978-cb254e3d132d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:30:24.097155 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adebbcee-87ff-4d2c-8978-cb254e3d132d admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:30:24.124019 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:30:24.134342 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 805/1612] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Oct 12 02:30:24 2022] POST /identity/v3/users => generated 292 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 02:30:24.138745 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182fd89a-29ae-4928-abc4-bef9339325e1 admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:30:24.150384 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182fd89a-29ae-4928-abc4-bef9339325e1 admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:30:24.155992 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2d55cc-98a0-44e9-8c7d-a00d48a777f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:30:24.156672 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2d55cc-98a0-44e9-8c7d-a00d48a777f5 admin admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:24.156953 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2d55cc-98a0-44e9-8c7d-a00d48a777f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:24.157224 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2d55cc-98a0-44e9-8c7d-a00d48a777f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:24.157870 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2d55cc-98a0-44e9-8c7d-a00d48a777f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:30:24.159502 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2d55cc-98a0-44e9-8c7d-a00d48a777f5 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:30:24.172517 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 808/1613] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Oct 12 02:30:24 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 02:30:24.176192 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adebbcee-87ff-4d2c-8978-cb254e3d132d admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:30:24.187424 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adebbcee-87ff-4d2c-8978-cb254e3d132d admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:30:24.193160 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c2a11d-a090-4a01-a153-3fa89a4b6bdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:30:24.193794 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c2a11d-a090-4a01-a153-3fa89a4b6bdb admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:24.194025 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c2a11d-a090-4a01-a153-3fa89a4b6bdb admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:24.194333 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c2a11d-a090-4a01-a153-3fa89a4b6bdb admin admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:24.195064 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c2a11d-a090-4a01-a153-3fa89a4b6bdb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:30:24.196823 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c2a11d-a090-4a01-a153-3fa89a4b6bdb admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:30:24.209115 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 806/1614] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Oct 12 02:30:24 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 02:30:24.213265 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2d55cc-98a0-44e9-8c7d-a00d48a777f5 admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:30:24.224160 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2d55cc-98a0-44e9-8c7d-a00d48a777f5 admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:30:24.228784 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d12a04-4483-43e8-9047-2d7d3a38d802 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:30:24.229529 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d12a04-4483-43e8-9047-2d7d3a38d802 admin admin] REQUEST_METHOD: `PUT` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:24.229807 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d12a04-4483-43e8-9047-2d7d3a38d802 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:24.230080 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d12a04-4483-43e8-9047-2d7d3a38d802 admin admin] PATH_INFO: `/v3/projects/3ecb3bc942ae427fb1aea118551718d3/users/d1261389fc8f4054b0083a6415508fc7/roles/3d75c4d7f1a849b9a771504d1583ab28` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:24.244689 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d12a04-4483-43e8-9047-2d7d3a38d802 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3ecb3bc942ae427fb1aea118551718d3, user_id=d1261389fc8f4054b0083a6415508fc7, role_id=3d75c4d7f1a849b9a771504d1583ab28)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:30:24.247469 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d12a04-4483-43e8-9047-2d7d3a38d802 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:30:24.261091 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 809/1615] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Oct 12 02:30:24 2022] PUT /identity/v3/projects/3ecb3bc942ae427fb1aea118551718d3/users/d1261389fc8f4054b0083a6415508fc7/roles/3d75c4d7f1a849b9a771504d1583ab28 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 02:30:24.272077 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580c8901-0e84-42b8-a3f1-d09ada381e70 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:24.272608 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580c8901-0e84-42b8-a3f1-d09ada381e70 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:24.272800 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580c8901-0e84-42b8-a3f1-d09ada381e70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:24.302799 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-580c8901-0e84-42b8-a3f1-d09ada381e70 None None] MFA Rules not processed for user `d1261389fc8f4054b0083a6415508fc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:30:24.304021 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-580c8901-0e84-42b8-a3f1-d09ada381e70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:30:24.371686 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 807/1616] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 02:30:24 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 02:30:24.376556 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d12a04-4483-43e8-9047-2d7d3a38d802 admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:30:24.445442 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d12a04-4483-43e8-9047-2d7d3a38d802 admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:30:24.450205 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc365031-9cc2-4561-aab1-126d82df2f0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:30:24.451655 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc365031-9cc2-4561-aab1-126d82df2f0f admin admin] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:24.452781 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc365031-9cc2-4561-aab1-126d82df2f0f admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:24.453103 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc365031-9cc2-4561-aab1-126d82df2f0f admin admin] PATH_INFO: `/v3/projects` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:24.453952 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc365031-9cc2-4561-aab1-126d82df2f0f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:30:24.456392 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc365031-9cc2-4561-aab1-126d82df2f0f admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:30:24.474636 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:30:24.494801 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 810/1617] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Oct 12 02:30:24 2022] POST /identity/v3/projects => generated 385 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 02:30:24.496039 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580c8901-0e84-42b8-a3f1-d09ada381e70 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:30:24.507636 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580c8901-0e84-42b8-a3f1-d09ada381e70 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:30:24.572272 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0f7f64-41cf-4815-9591-d3ca1278777a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:30:24.572921 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0f7f64-41cf-4815-9591-d3ca1278777a admin admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:24.573204 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0f7f64-41cf-4815-9591-d3ca1278777a admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:24.573476 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0f7f64-41cf-4815-9591-d3ca1278777a admin admin] PATH_INFO: `/v3/users` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:24.574116 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0f7f64-41cf-4815-9591-d3ca1278777a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:30:24.576605 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0f7f64-41cf-4815-9591-d3ca1278777a admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:30:24.598419 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 808/1618] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Oct 12 02:30:24 2022] POST /identity/v3/users => generated 299 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 02:30:24.602312 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc365031-9cc2-4561-aab1-126d82df2f0f admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:30:24.613383 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc365031-9cc2-4561-aab1-126d82df2f0f admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:30:24.621167 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c7773f-d4e0-4280-88f4-34088faeeb4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:30:24.622071 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c7773f-d4e0-4280-88f4-34088faeeb4b admin admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:24.622417 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c7773f-d4e0-4280-88f4-34088faeeb4b admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:24.622779 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c7773f-d4e0-4280-88f4-34088faeeb4b admin admin] PATH_INFO: `/v3/roles` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:24.625132 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c7773f-d4e0-4280-88f4-34088faeeb4b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:30:24.626743 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c7773f-d4e0-4280-88f4-34088faeeb4b admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:30:24.647931 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 811/1619] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Oct 12 02:30:24 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 02:30:24.649124 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0f7f64-41cf-4815-9591-d3ca1278777a admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:30:24.661489 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0f7f64-41cf-4815-9591-d3ca1278777a admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:30:24.668063 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf7555a-2881-4b08-8986-011b868c6686 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:30:24.668771 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf7555a-2881-4b08-8986-011b868c6686 admin admin] REQUEST_METHOD: `PUT` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:24.669047 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf7555a-2881-4b08-8986-011b868c6686 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:24.669577 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf7555a-2881-4b08-8986-011b868c6686 admin admin] PATH_INFO: `/v3/projects/de2d1c131e8d4fe096aeb064ff6b28eb/users/5b81c107bb3644b9af9e7bcda780c3c3/roles/39b1e8108dff402383def3c559f48189` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:24.688042 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf7555a-2881-4b08-8986-011b868c6686 admin admin] RBAC: Authorizing `identity:create_grant(project_id=de2d1c131e8d4fe096aeb064ff6b28eb, user_id=5b81c107bb3644b9af9e7bcda780c3c3, role_id=39b1e8108dff402383def3c559f48189)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:30:24.690740 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf7555a-2881-4b08-8986-011b868c6686 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:30:24.705227 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 809/1620] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Oct 12 02:30:24 2022] PUT /identity/v3/projects/de2d1c131e8d4fe096aeb064ff6b28eb/users/5b81c107bb3644b9af9e7bcda780c3c3/roles/39b1e8108dff402383def3c559f48189 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 02:30:24.709225 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c7773f-d4e0-4280-88f4-34088faeeb4b admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:30:24.719805 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c7773f-d4e0-4280-88f4-34088faeeb4b admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:30:24.781447 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fb2f51-8b4b-4077-a2bf-554035cfd9ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:30:24.781977 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fb2f51-8b4b-4077-a2bf-554035cfd9ba admin admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:24.782254 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fb2f51-8b4b-4077-a2bf-554035cfd9ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:24.782527 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fb2f51-8b4b-4077-a2bf-554035cfd9ba admin admin] PATH_INFO: `/v3/roles` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:24.783165 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56fb2f51-8b4b-4077-a2bf-554035cfd9ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:30:24.784800 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56fb2f51-8b4b-4077-a2bf-554035cfd9ba admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:30:24.794569 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 812/1621] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Oct 12 02:30:24 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 12 02:30:24.799445 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf7555a-2881-4b08-8986-011b868c6686 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:30:24.810023 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf7555a-2881-4b08-8986-011b868c6686 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:30:24.815447 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aff0af4-cfb3-4415-8198-5005f91829e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:30:24.816150 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aff0af4-cfb3-4415-8198-5005f91829e1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:24.816432 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aff0af4-cfb3-4415-8198-5005f91829e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:24.816761 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aff0af4-cfb3-4415-8198-5005f91829e1 admin admin] PATH_INFO: `/v3/projects/de2d1c131e8d4fe096aeb064ff6b28eb/users/5b81c107bb3644b9af9e7bcda780c3c3/roles/39b1e8108dff402383def3c559f48189` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:24.818685 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aff0af4-cfb3-4415-8198-5005f91829e1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=de2d1c131e8d4fe096aeb064ff6b28eb, user_id=5b81c107bb3644b9af9e7bcda780c3c3, role_id=39b1e8108dff402383def3c559f48189)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:30:24.821400 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aff0af4-cfb3-4415-8198-5005f91829e1 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:30:24.832731 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 810/1622] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Oct 12 02:30:24 2022] PUT /identity/v3/projects/de2d1c131e8d4fe096aeb064ff6b28eb/users/5b81c107bb3644b9af9e7bcda780c3c3/roles/39b1e8108dff402383def3c559f48189 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 02:30:24.843709 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb39c81-3aeb-48f5-989b-b2abe793f2c4 None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:24.844143 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb39c81-3aeb-48f5-989b-b2abe793f2c4 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:24.844969 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb39c81-3aeb-48f5-989b-b2abe793f2c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:24.878413 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-4bb39c81-3aeb-48f5-989b-b2abe793f2c4 None None] MFA Rules not processed for user `5b81c107bb3644b9af9e7bcda780c3c3`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:30:24.879633 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-4bb39c81-3aeb-48f5-989b-b2abe793f2c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:30:24.961666 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 813/1623] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 02:30:24 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 02:30:24.973333 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aff0af4-cfb3-4415-8198-5005f91829e1 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:30:24.974910 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-4aff0af4-cfb3-4415-8198-5005f91829e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:30:25.011828 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:30:25.041999 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aff0af4-cfb3-4415-8198-5005f91829e1 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:30:25.053703 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fa2228-1aae-4ae6-ac8b-43f0048eeda6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ba688e0c4d44d13898539ee886f95fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'beb6def6fcad45959e56425bb8bff4d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:30:25.054667 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fa2228-1aae-4ae6-ac8b-43f0048eeda6 service cinder] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:25.055293 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fa2228-1aae-4ae6-ac8b-43f0048eeda6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:25.056028 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fa2228-1aae-4ae6-ac8b-43f0048eeda6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:25.121545 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3fa2228-1aae-4ae6-ac8b-43f0048eeda6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:30:25.123150 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3fa2228-1aae-4ae6-ac8b-43f0048eeda6 service cinder] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:30:25.135811 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 811/1624] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 02:30:24 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 02:30:25.770036 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb39c81-3aeb-48f5-989b-b2abe793f2c4 None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:30:25.771741 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-4bb39c81-3aeb-48f5-989b-b2abe793f2c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:30:25.914446 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb39c81-3aeb-48f5-989b-b2abe793f2c4 None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:30:25.927209 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba362b54-495a-4819-9cf7-b9c8921c93b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:30:25.928218 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba362b54-495a-4819-9cf7-b9c8921c93b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:25.928741 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba362b54-495a-4819-9cf7-b9c8921c93b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:25.931358 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba362b54-495a-4819-9cf7-b9c8921c93b6 admin admin] PATH_INFO: `/v3/users/34bfc7464ef44ca7ad5c80772673fa91` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:25.933164 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba362b54-495a-4819-9cf7-b9c8921c93b6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=34bfc7464ef44ca7ad5c80772673fa91)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:30:25.936054 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba362b54-495a-4819-9cf7-b9c8921c93b6 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:30:25.946651 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:30:26.009875 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-ba362b54-495a-4819-9cf7-b9c8921c93b6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '34bfc7464ef44ca7ad5c80772673fa91'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:30:26.026586 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-ba362b54-495a-4819-9cf7-b9c8921c93b6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '34bfc7464ef44ca7ad5c80772673fa91'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:30:26.052437 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-ba362b54-495a-4819-9cf7-b9c8921c93b6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '34bfc7464ef44ca7ad5c80772673fa91'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:30:26.061397 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-ba362b54-495a-4819-9cf7-b9c8921c93b6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '34bfc7464ef44ca7ad5c80772673fa91'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:30:26.081463 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-ba362b54-495a-4819-9cf7-b9c8921c93b6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '34bfc7464ef44ca7ad5c80772673fa91'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:30:26.099043 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 814/1625] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Oct 12 02:30:25 2022] DELETE /identity/v3/users/34bfc7464ef44ca7ad5c80772673fa91 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 02:30:26.100580 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1fed3e-6725-4f5e-bdee-beaf60ff6693 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:26.101065 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1fed3e-6725-4f5e-bdee-beaf60ff6693 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:26.101282 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1fed3e-6725-4f5e-bdee-beaf60ff6693 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:26.123615 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-5e1fed3e-6725-4f5e-bdee-beaf60ff6693 None None] MFA Rules not processed for user `a326a5bb7364479382f528a592371656`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:30:26.125361 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-5e1fed3e-6725-4f5e-bdee-beaf60ff6693 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:30:26.213335 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 812/1626] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 02:30:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 02:30:26.227128 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba362b54-495a-4819-9cf7-b9c8921c93b6 admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:30:26.228802 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-ba362b54-495a-4819-9cf7-b9c8921c93b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:30:26.290379 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba362b54-495a-4819-9cf7-b9c8921c93b6 admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:30:26.295956 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8102546-7120-4b14-869b-b69bdd95eeb2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5223b5cab3114e9b9a13c582f8ef8386', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'beb6def6fcad45959e56425bb8bff4d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:30:26.296619 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8102546-7120-4b14-869b-b69bdd95eeb2 service neutron] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:26.296900 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8102546-7120-4b14-869b-b69bdd95eeb2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:26.297170 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8102546-7120-4b14-869b-b69bdd95eeb2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:26.308832 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8102546-7120-4b14-869b-b69bdd95eeb2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:30:26.310968 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8102546-7120-4b14-869b-b69bdd95eeb2 service neutron] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:30:26.321751 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 815/1627] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 02:30:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 02:30:27.276548 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1fed3e-6725-4f5e-bdee-beaf60ff6693 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:30:27.278023 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-5e1fed3e-6725-4f5e-bdee-beaf60ff6693 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:30:27.360460 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8102546-7120-4b14-869b-b69bdd95eeb2 service neutron] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:30:27.361938 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-a8102546-7120-4b14-869b-b69bdd95eeb2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:30:27.382905 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1fed3e-6725-4f5e-bdee-beaf60ff6693 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:30:27.402021 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99aed5dc-be2b-4777-aa29-04d5e5a40dec service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ba688e0c4d44d13898539ee886f95fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'beb6def6fcad45959e56425bb8bff4d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:30:27.403493 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99aed5dc-be2b-4777-aa29-04d5e5a40dec service cinder] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:27.403980 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99aed5dc-be2b-4777-aa29-04d5e5a40dec service cinder] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:27.404693 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99aed5dc-be2b-4777-aa29-04d5e5a40dec service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:27.408377 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-99aed5dc-be2b-4777-aa29-04d5e5a40dec service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:30:27.455257 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8102546-7120-4b14-869b-b69bdd95eeb2 service neutron] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:30:27.459444 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422ea079-cb6c-457f-a70f-205b5d85d7c2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ba688e0c4d44d13898539ee886f95fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'beb6def6fcad45959e56425bb8bff4d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:30:27.460227 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422ea079-cb6c-457f-a70f-205b5d85d7c2 service cinder] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:27.460550 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422ea079-cb6c-457f-a70f-205b5d85d7c2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:27.460828 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422ea079-cb6c-457f-a70f-205b5d85d7c2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:27.463030 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-422ea079-cb6c-457f-a70f-205b5d85d7c2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:30:27.503830 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:30:27.524734 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:30:27.563619 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99aed5dc-be2b-4777-aa29-04d5e5a40dec service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:30:27.566619 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99aed5dc-be2b-4777-aa29-04d5e5a40dec service cinder] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:30:27.585683 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422ea079-cb6c-457f-a70f-205b5d85d7c2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:30:27.587098 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422ea079-cb6c-457f-a70f-205b5d85d7c2 service cinder] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:30:27.594940 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 813/1628] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 02:30:27 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 02:30:27.603077 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 816/1629] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 02:30:27 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 243 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 12 02:30:27.615952 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99aed5dc-be2b-4777-aa29-04d5e5a40dec service cinder] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:30:27.617545 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-99aed5dc-be2b-4777-aa29-04d5e5a40dec service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:30:27.634863 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99aed5dc-be2b-4777-aa29-04d5e5a40dec service cinder] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:30:27.642119 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af2799e-eafd-47b8-a191-aff31553dc21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:30:27.642646 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af2799e-eafd-47b8-a191-aff31553dc21 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:27.642999 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af2799e-eafd-47b8-a191-aff31553dc21 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:27.643344 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af2799e-eafd-47b8-a191-aff31553dc21 admin admin] PATH_INFO: `/v3/projects/a3ca859be8b54083af44c382e88c8e71` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:27.644668 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af2799e-eafd-47b8-a191-aff31553dc21 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a3ca859be8b54083af44c382e88c8e71)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:30:27.647754 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af2799e-eafd-47b8-a191-aff31553dc21 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:30:27.745515 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-7af2799e-eafd-47b8-a191-aff31553dc21 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a3ca859be8b54083af44c382e88c8e71', 'request_id': 'req-7af2799e-eafd-47b8-a191-aff31553dc21'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:30:27.761833 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-7af2799e-eafd-47b8-a191-aff31553dc21 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a3ca859be8b54083af44c382e88c8e71', 'request_id': 'req-7af2799e-eafd-47b8-a191-aff31553dc21'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:30:27.777348 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-7af2799e-eafd-47b8-a191-aff31553dc21 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a3ca859be8b54083af44c382e88c8e71', 'request_id': 'req-7af2799e-eafd-47b8-a191-aff31553dc21'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:30:27.824101 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-7af2799e-eafd-47b8-a191-aff31553dc21 admin admin] The token cache is being invalidate because project a3ca859be8b54083af44c382e88c8e71 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81362) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 02:30:27.824424 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-7af2799e-eafd-47b8-a191-aff31553dc21 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:30:27.825987 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-7af2799e-eafd-47b8-a191-aff31553dc21 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:30:27.829390 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 814/1630] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Oct 12 02:30:27 2022] DELETE /identity/v3/projects/a3ca859be8b54083af44c382e88c8e71 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 02:30:29.110038 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422ea079-cb6c-457f-a70f-205b5d85d7c2 service cinder] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:30:29.121820 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422ea079-cb6c-457f-a70f-205b5d85d7c2 service cinder] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:30:29.209985 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc8da98-b7f6-473d-89da-0b45648183be service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ba688e0c4d44d13898539ee886f95fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'beb6def6fcad45959e56425bb8bff4d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:30:29.210904 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc8da98-b7f6-473d-89da-0b45648183be service cinder] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:29.211381 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc8da98-b7f6-473d-89da-0b45648183be service cinder] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:29.212068 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc8da98-b7f6-473d-89da-0b45648183be service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:29.214297 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-bfc8da98-b7f6-473d-89da-0b45648183be service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:30:29.287766 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af2799e-eafd-47b8-a191-aff31553dc21 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:30:29.289261 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-7af2799e-eafd-47b8-a191-aff31553dc21 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:30:29.349343 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc8da98-b7f6-473d-89da-0b45648183be service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:30:29.350817 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc8da98-b7f6-473d-89da-0b45648183be service cinder] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:30:29.370837 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 817/1631] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 02:30:29 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 262 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 02:30:29.406914 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af2799e-eafd-47b8-a191-aff31553dc21 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:30:29.414550 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a733cbe-cbfb-41bd-a235-9275a5bb6c37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:30:29.415222 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a733cbe-cbfb-41bd-a235-9275a5bb6c37 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:29.415497 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a733cbe-cbfb-41bd-a235-9275a5bb6c37 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:29.416322 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a733cbe-cbfb-41bd-a235-9275a5bb6c37 admin admin] PATH_INFO: `/v3/users/b5218e2cb11d4d83a341830292f273e4` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:29.417536 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a733cbe-cbfb-41bd-a235-9275a5bb6c37 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b5218e2cb11d4d83a341830292f273e4)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:30:29.420021 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a733cbe-cbfb-41bd-a235-9275a5bb6c37 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:30:29.500685 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-4a733cbe-cbfb-41bd-a235-9275a5bb6c37 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b5218e2cb11d4d83a341830292f273e4'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:30:29.511657 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-4a733cbe-cbfb-41bd-a235-9275a5bb6c37 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b5218e2cb11d4d83a341830292f273e4'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:30:29.532515 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:30:29.534311 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-4a733cbe-cbfb-41bd-a235-9275a5bb6c37 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b5218e2cb11d4d83a341830292f273e4'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:30:29.565037 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-4a733cbe-cbfb-41bd-a235-9275a5bb6c37 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b5218e2cb11d4d83a341830292f273e4'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:30:29.568871 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-4a733cbe-cbfb-41bd-a235-9275a5bb6c37 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b5218e2cb11d4d83a341830292f273e4'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:30:29.580432 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 815/1632] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Oct 12 02:30:29 2022] DELETE /identity/v3/users/b5218e2cb11d4d83a341830292f273e4 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 02:30:29.582556 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a00b82-2a72-4312-abe5-6da845932efc None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:29.582556 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a00b82-2a72-4312-abe5-6da845932efc None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:29.582556 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a00b82-2a72-4312-abe5-6da845932efc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:29.610217 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-25a00b82-2a72-4312-abe5-6da845932efc None None] MFA Rules not processed for user `a326a5bb7364479382f528a592371656`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:30:29.612061 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-25a00b82-2a72-4312-abe5-6da845932efc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:30:29.746170 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 818/1633] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 02:30:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 02:30:29.755091 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a733cbe-cbfb-41bd-a235-9275a5bb6c37 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:30:29.756607 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-4a733cbe-cbfb-41bd-a235-9275a5bb6c37 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:30:29.856697 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a733cbe-cbfb-41bd-a235-9275a5bb6c37 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:30:29.861831 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a869c48f-d703-4067-ab13-01d31fa7e6c4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5223b5cab3114e9b9a13c582f8ef8386', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'beb6def6fcad45959e56425bb8bff4d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:30:29.863405 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a869c48f-d703-4067-ab13-01d31fa7e6c4 service neutron] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:29.863737 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a869c48f-d703-4067-ab13-01d31fa7e6c4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:29.863942 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a869c48f-d703-4067-ab13-01d31fa7e6c4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:29.875677 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a869c48f-d703-4067-ab13-01d31fa7e6c4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:30:29.877278 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a869c48f-d703-4067-ab13-01d31fa7e6c4 service neutron] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:30:29.894328 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 816/1634] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 02:30:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 02:30:30.297605 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a00b82-2a72-4312-abe5-6da845932efc None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:30:30.299292 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-25a00b82-2a72-4312-abe5-6da845932efc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:30:30.313977 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a00b82-2a72-4312-abe5-6da845932efc None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:30:30.326573 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243fb298-719e-45f1-be4a-103d4a27e046 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:30:30.328286 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243fb298-719e-45f1-be4a-103d4a27e046 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:30.328286 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243fb298-719e-45f1-be4a-103d4a27e046 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:30.328286 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243fb298-719e-45f1-be4a-103d4a27e046 admin admin] PATH_INFO: `/v3/projects/ebceedff7fe84bd2b785841c0425735d` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:30.329967 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243fb298-719e-45f1-be4a-103d4a27e046 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ebceedff7fe84bd2b785841c0425735d)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:30:30.331923 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243fb298-719e-45f1-be4a-103d4a27e046 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:30:30.378039 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:30:30.406459 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-243fb298-719e-45f1-be4a-103d4a27e046 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ebceedff7fe84bd2b785841c0425735d', 'request_id': 'req-243fb298-719e-45f1-be4a-103d4a27e046'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:30:30.417807 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-243fb298-719e-45f1-be4a-103d4a27e046 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ebceedff7fe84bd2b785841c0425735d', 'request_id': 'req-243fb298-719e-45f1-be4a-103d4a27e046'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:30:30.431122 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-243fb298-719e-45f1-be4a-103d4a27e046 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ebceedff7fe84bd2b785841c0425735d', 'request_id': 'req-243fb298-719e-45f1-be4a-103d4a27e046'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:30:30.452626 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-243fb298-719e-45f1-be4a-103d4a27e046 admin admin] The token cache is being invalidate because project ebceedff7fe84bd2b785841c0425735d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81361) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 02:30:30.452924 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-243fb298-719e-45f1-be4a-103d4a27e046 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:30:30.453764 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-243fb298-719e-45f1-be4a-103d4a27e046 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:30:30.455637 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 819/1635] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Oct 12 02:30:30 2022] DELETE /identity/v3/projects/ebceedff7fe84bd2b785841c0425735d => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 02:30:30.460735 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a869c48f-d703-4067-ab13-01d31fa7e6c4 service neutron] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:30:30.474696 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a869c48f-d703-4067-ab13-01d31fa7e6c4 service neutron] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:30:30.554654 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe712060-0564-409e-853d-408f851495f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:30:30.555452 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe712060-0564-409e-853d-408f851495f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:30.555851 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe712060-0564-409e-853d-408f851495f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:30.556009 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe712060-0564-409e-853d-408f851495f5 admin admin] PATH_INFO: `/v3/users/88bf77bb0daf4d2388c96a2a48d0bc95` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:30.557616 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe712060-0564-409e-853d-408f851495f5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=88bf77bb0daf4d2388c96a2a48d0bc95)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:30:30.559580 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe712060-0564-409e-853d-408f851495f5 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:30:30.626142 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-fe712060-0564-409e-853d-408f851495f5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '88bf77bb0daf4d2388c96a2a48d0bc95'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:30:30.638099 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-fe712060-0564-409e-853d-408f851495f5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '88bf77bb0daf4d2388c96a2a48d0bc95'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:30:30.661800 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-fe712060-0564-409e-853d-408f851495f5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '88bf77bb0daf4d2388c96a2a48d0bc95'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:30:30.672715 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-fe712060-0564-409e-853d-408f851495f5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '88bf77bb0daf4d2388c96a2a48d0bc95'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:30:30.673676 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-fe712060-0564-409e-853d-408f851495f5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '88bf77bb0daf4d2388c96a2a48d0bc95'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:30:30.688150 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243fb298-719e-45f1-be4a-103d4a27e046 admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:30:30.689904 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 817/1636] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Oct 12 02:30:30 2022] DELETE /identity/v3/users/88bf77bb0daf4d2388c96a2a48d0bc95 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 02:30:30.690769 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-243fb298-719e-45f1-be4a-103d4a27e046 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:30:30.707083 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243fb298-719e-45f1-be4a-103d4a27e046 admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:30:30.795886 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eefae24-2edb-482f-926e-8701bff5097d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:30:30.796994 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eefae24-2edb-482f-926e-8701bff5097d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:30.797465 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eefae24-2edb-482f-926e-8701bff5097d admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:30.797950 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eefae24-2edb-482f-926e-8701bff5097d admin admin] PATH_INFO: `/v3/users/3426639214614a268cc8fd5531321633` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:30.799650 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eefae24-2edb-482f-926e-8701bff5097d admin admin] RBAC: Authorizing `identity:delete_user(user_id=3426639214614a268cc8fd5531321633)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:30:30.802025 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eefae24-2edb-482f-926e-8701bff5097d admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:30:30.896897 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-2eefae24-2edb-482f-926e-8701bff5097d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3426639214614a268cc8fd5531321633'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:30:30.907343 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-2eefae24-2edb-482f-926e-8701bff5097d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3426639214614a268cc8fd5531321633'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:30:30.940948 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-2eefae24-2edb-482f-926e-8701bff5097d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3426639214614a268cc8fd5531321633'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:30:30.975777 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-2eefae24-2edb-482f-926e-8701bff5097d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3426639214614a268cc8fd5531321633'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:30:30.975777 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-2eefae24-2edb-482f-926e-8701bff5097d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3426639214614a268cc8fd5531321633'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:30:30.977612 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 820/1637] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Oct 12 02:30:30 2022] DELETE /identity/v3/users/3426639214614a268cc8fd5531321633 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 02:30:30.982403 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9049ed76-cbe5-4697-9590-609a97fbdef0 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:30.982775 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9049ed76-cbe5-4697-9590-609a97fbdef0 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:30.983086 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9049ed76-cbe5-4697-9590-609a97fbdef0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:30.994187 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:30:31.009034 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-9049ed76-cbe5-4697-9590-609a97fbdef0 None None] MFA Rules not processed for user `a326a5bb7364479382f528a592371656`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:30:31.011305 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-9049ed76-cbe5-4697-9590-609a97fbdef0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:30:31.082858 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 818/1638] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 02:30:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 02:30:31.093213 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eefae24-2edb-482f-926e-8701bff5097d admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:30:31.094276 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9049ed76-cbe5-4697-9590-609a97fbdef0 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:30:31.094602 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-2eefae24-2edb-482f-926e-8701bff5097d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:30:31.095747 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-9049ed76-cbe5-4697-9590-609a97fbdef0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:30:31.111631 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9049ed76-cbe5-4697-9590-609a97fbdef0 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:30:31.117265 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8243c1-7bbc-43d8-9d90-3015b3da35de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:30:31.118247 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8243c1-7bbc-43d8-9d90-3015b3da35de admin admin] REQUEST_METHOD: `DELETE` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:31.118732 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8243c1-7bbc-43d8-9d90-3015b3da35de admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:31.119191 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8243c1-7bbc-43d8-9d90-3015b3da35de admin admin] PATH_INFO: `/v3/projects/00e9bff6c613490686e78b5210e6c989` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:31.121543 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8243c1-7bbc-43d8-9d90-3015b3da35de admin admin] RBAC: Authorizing `identity:delete_project(project_id=00e9bff6c613490686e78b5210e6c989)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:30:31.124124 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8243c1-7bbc-43d8-9d90-3015b3da35de admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:30:31.144984 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:30:31.167861 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eefae24-2edb-482f-926e-8701bff5097d admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:30:31.174830 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-6d8243c1-7bbc-43d8-9d90-3015b3da35de admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '00e9bff6c613490686e78b5210e6c989', 'request_id': 'req-6d8243c1-7bbc-43d8-9d90-3015b3da35de'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:30:31.181304 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-6d8243c1-7bbc-43d8-9d90-3015b3da35de admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '00e9bff6c613490686e78b5210e6c989', 'request_id': 'req-6d8243c1-7bbc-43d8-9d90-3015b3da35de'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:30:31.188578 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-6d8243c1-7bbc-43d8-9d90-3015b3da35de admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '00e9bff6c613490686e78b5210e6c989', 'request_id': 'req-6d8243c1-7bbc-43d8-9d90-3015b3da35de'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:30:31.203186 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-6d8243c1-7bbc-43d8-9d90-3015b3da35de admin admin] The token cache is being invalidate because project 00e9bff6c613490686e78b5210e6c989 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81362) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 02:30:31.203482 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-6d8243c1-7bbc-43d8-9d90-3015b3da35de admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:30:31.204383 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-6d8243c1-7bbc-43d8-9d90-3015b3da35de admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:30:31.206418 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 819/1639] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Oct 12 02:30:31 2022] DELETE /identity/v3/projects/00e9bff6c613490686e78b5210e6c989 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 02:30:31.211322 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91ae368-ca88-4e06-8279-8f894e13e42c None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:31.211563 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91ae368-ca88-4e06-8279-8f894e13e42c None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:31.212409 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91ae368-ca88-4e06-8279-8f894e13e42c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:31.226401 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e511436b-c5f0-4a72-8217-1244c076d4ba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5223b5cab3114e9b9a13c582f8ef8386', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'beb6def6fcad45959e56425bb8bff4d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:30:31.227259 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e511436b-c5f0-4a72-8217-1244c076d4ba service neutron] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:31.227681 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e511436b-c5f0-4a72-8217-1244c076d4ba service neutron] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:31.227963 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e511436b-c5f0-4a72-8217-1244c076d4ba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:31.231352 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-e511436b-c5f0-4a72-8217-1244c076d4ba service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:30:31.237216 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-b91ae368-ca88-4e06-8279-8f894e13e42c None None] MFA Rules not processed for user `a326a5bb7364479382f528a592371656`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:30:31.238579 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-b91ae368-ca88-4e06-8279-8f894e13e42c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:30:31.304749 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 820/1640] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 02:30:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 02:30:31.312171 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e511436b-c5f0-4a72-8217-1244c076d4ba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:30:31.312735 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4014a433-2c36-473e-add8-03474e6c6b41 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:31.312735 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4014a433-2c36-473e-add8-03474e6c6b41 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:31.312953 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4014a433-2c36-473e-add8-03474e6c6b41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:31.313944 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e511436b-c5f0-4a72-8217-1244c076d4ba service neutron] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:30:31.325454 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 821/1641] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 02:30:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 02:30:31.333242 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-4014a433-2c36-473e-add8-03474e6c6b41 None None] MFA Rules not processed for user `a326a5bb7364479382f528a592371656`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:30:31.334496 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-4014a433-2c36-473e-add8-03474e6c6b41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:30:31.342631 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 821/1642] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 02:30:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 02:30:31.346650 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e511436b-c5f0-4a72-8217-1244c076d4ba service neutron] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:30:31.357639 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e511436b-c5f0-4a72-8217-1244c076d4ba service neutron] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:30:31.362883 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c18ce1-c712-4cfc-9d49-588a9f34554f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:30:31.363485 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c18ce1-c712-4cfc-9d49-588a9f34554f admin admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:31.363754 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c18ce1-c712-4cfc-9d49-588a9f34554f admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:31.364025 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c18ce1-c712-4cfc-9d49-588a9f34554f admin admin] PATH_INFO: `/v3/domains` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:31.364693 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c18ce1-c712-4cfc-9d49-588a9f34554f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 02:30:31.364991 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c18ce1-c712-4cfc-9d49-588a9f34554f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:30:31.366589 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c18ce1-c712-4cfc-9d49-588a9f34554f admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:30:31.379478 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 822/1643] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Oct 12 02:30:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 02:30:31.383958 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4014a433-2c36-473e-add8-03474e6c6b41 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:30:31.395507 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4014a433-2c36-473e-add8-03474e6c6b41 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:30:31.400861 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b49f2af-3356-4372-be90-2510be2d1756 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:30:31.401297 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b49f2af-3356-4372-be90-2510be2d1756 admin admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:31.401708 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b49f2af-3356-4372-be90-2510be2d1756 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:31.402103 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b49f2af-3356-4372-be90-2510be2d1756 admin admin] PATH_INFO: `/v3/projects` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:31.402753 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b49f2af-3356-4372-be90-2510be2d1756 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:30:31.405034 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b49f2af-3356-4372-be90-2510be2d1756 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:30:31.431883 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:30:31.443004 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 822/1644] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Oct 12 02:30:31 2022] POST /identity/v3/projects => generated 381 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 02:30:31.444918 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c18ce1-c712-4cfc-9d49-588a9f34554f admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:30:31.455779 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c18ce1-c712-4cfc-9d49-588a9f34554f admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:30:31.518506 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af12914-6ea3-44e1-98b3-68117e73b382 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:30:31.519124 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af12914-6ea3-44e1-98b3-68117e73b382 admin admin] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:31.519404 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af12914-6ea3-44e1-98b3-68117e73b382 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:31.519721 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af12914-6ea3-44e1-98b3-68117e73b382 admin admin] PATH_INFO: `/v3/users` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:31.520423 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af12914-6ea3-44e1-98b3-68117e73b382 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:30:31.522538 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af12914-6ea3-44e1-98b3-68117e73b382 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:30:31.559550 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 823/1645] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Oct 12 02:30:31 2022] POST /identity/v3/users => generated 291 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 02:30:31.560919 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b49f2af-3356-4372-be90-2510be2d1756 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:30:31.573305 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b49f2af-3356-4372-be90-2510be2d1756 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:30:31.579031 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cbdf41-8a82-4cb4-8d9b-eec2971e5218 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:30:31.579667 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cbdf41-8a82-4cb4-8d9b-eec2971e5218 admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:31.579943 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cbdf41-8a82-4cb4-8d9b-eec2971e5218 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:31.580238 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cbdf41-8a82-4cb4-8d9b-eec2971e5218 admin admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:31.580912 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8cbdf41-8a82-4cb4-8d9b-eec2971e5218 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:30:31.582497 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8cbdf41-8a82-4cb4-8d9b-eec2971e5218 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:30:31.593810 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 823/1646] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Oct 12 02:30:31 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 02:30:31.598245 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af12914-6ea3-44e1-98b3-68117e73b382 admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:30:31.610122 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af12914-6ea3-44e1-98b3-68117e73b382 admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:30:31.614716 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141b0e20-bbde-4b06-9554-1f73df915480 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:30:31.615323 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141b0e20-bbde-4b06-9554-1f73df915480 admin admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:31.615653 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141b0e20-bbde-4b06-9554-1f73df915480 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:31.615934 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141b0e20-bbde-4b06-9554-1f73df915480 admin admin] PATH_INFO: `/v3/roles` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:31.616707 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141b0e20-bbde-4b06-9554-1f73df915480 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:30:31.618520 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141b0e20-bbde-4b06-9554-1f73df915480 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:30:31.630911 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 824/1647] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Oct 12 02:30:31 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 02:30:31.635488 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cbdf41-8a82-4cb4-8d9b-eec2971e5218 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:30:31.643958 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141b0e20-bbde-4b06-9554-1f73df915480 admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:30:31.646017 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-141b0e20-bbde-4b06-9554-1f73df915480 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:30:31.647124 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cbdf41-8a82-4cb4-8d9b-eec2971e5218 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:30:31.653027 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d282e78-0e74-4e68-b8f2-5c66e7229eec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:30:31.653739 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d282e78-0e74-4e68-b8f2-5c66e7229eec admin admin] REQUEST_METHOD: `PUT` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:31.654818 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d282e78-0e74-4e68-b8f2-5c66e7229eec admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:31.655183 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d282e78-0e74-4e68-b8f2-5c66e7229eec admin admin] PATH_INFO: `/v3/projects/23e234f9ed4244dba13f90f21e5edf50/users/b537eebca10040d99e18841963da2505/roles/3d75c4d7f1a849b9a771504d1583ab28` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:31.661350 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141b0e20-bbde-4b06-9554-1f73df915480 admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:30:31.666851 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9e5ac4-7d61-4372-81fb-6ae2cfd9e018 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:30:31.667487 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9e5ac4-7d61-4372-81fb-6ae2cfd9e018 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:31.667764 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9e5ac4-7d61-4372-81fb-6ae2cfd9e018 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:31.668032 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9e5ac4-7d61-4372-81fb-6ae2cfd9e018 admin admin] PATH_INFO: `/v3/projects/72af44aa74bd411faf01e0f3dc3034f6` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:31.669295 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9e5ac4-7d61-4372-81fb-6ae2cfd9e018 admin admin] RBAC: Authorizing `identity:delete_project(project_id=72af44aa74bd411faf01e0f3dc3034f6)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:30:31.671151 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9e5ac4-7d61-4372-81fb-6ae2cfd9e018 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:30:31.673084 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:30:31.678587 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d282e78-0e74-4e68-b8f2-5c66e7229eec admin admin] RBAC: Authorizing `identity:create_grant(project_id=23e234f9ed4244dba13f90f21e5edf50, user_id=b537eebca10040d99e18841963da2505, role_id=3d75c4d7f1a849b9a771504d1583ab28)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:30:31.681387 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d282e78-0e74-4e68-b8f2-5c66e7229eec admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:30:31.696027 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 824/1648] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Oct 12 02:30:31 2022] PUT /identity/v3/projects/23e234f9ed4244dba13f90f21e5edf50/users/b537eebca10040d99e18841963da2505/roles/3d75c4d7f1a849b9a771504d1583ab28 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 02:30:31.706622 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7351b98d-45aa-4005-8a30-5e93325a0672 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:31.707100 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7351b98d-45aa-4005-8a30-5e93325a0672 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:31.707379 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7351b98d-45aa-4005-8a30-5e93325a0672 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:31.728400 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-7d9e5ac4-7d61-4372-81fb-6ae2cfd9e018 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '72af44aa74bd411faf01e0f3dc3034f6', 'request_id': 'req-7d9e5ac4-7d61-4372-81fb-6ae2cfd9e018'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:30:31.735048 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-7d9e5ac4-7d61-4372-81fb-6ae2cfd9e018 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '72af44aa74bd411faf01e0f3dc3034f6', 'request_id': 'req-7d9e5ac4-7d61-4372-81fb-6ae2cfd9e018'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:30:31.736901 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-7351b98d-45aa-4005-8a30-5e93325a0672 None None] MFA Rules not processed for user `b537eebca10040d99e18841963da2505`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:30:31.738131 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-7351b98d-45aa-4005-8a30-5e93325a0672 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:30:31.741916 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-7d9e5ac4-7d61-4372-81fb-6ae2cfd9e018 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '72af44aa74bd411faf01e0f3dc3034f6', 'request_id': 'req-7d9e5ac4-7d61-4372-81fb-6ae2cfd9e018'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:30:31.754797 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-7d9e5ac4-7d61-4372-81fb-6ae2cfd9e018 admin admin] The token cache is being invalidate because project 72af44aa74bd411faf01e0f3dc3034f6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81361) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 02:30:31.755089 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-7d9e5ac4-7d61-4372-81fb-6ae2cfd9e018 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:30:31.755730 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-7d9e5ac4-7d61-4372-81fb-6ae2cfd9e018 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:30:31.757289 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 825/1649] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Oct 12 02:30:31 2022] DELETE /identity/v3/projects/72af44aa74bd411faf01e0f3dc3034f6 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 02:30:31.761114 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9e5ac4-7d61-4372-81fb-6ae2cfd9e018 admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:30:31.762453 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-7d9e5ac4-7d61-4372-81fb-6ae2cfd9e018 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:30:31.812029 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 825/1650] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 02:30:31 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 02:30:31.816792 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7351b98d-45aa-4005-8a30-5e93325a0672 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:30:31.818328 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-7351b98d-45aa-4005-8a30-5e93325a0672 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:30:31.831752 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9e5ac4-7d61-4372-81fb-6ae2cfd9e018 admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:30:31.833383 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7351b98d-45aa-4005-8a30-5e93325a0672 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:30:31.836539 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea825f9-9c98-4db2-855c-c5e045c4fd84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:30:31.837176 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea825f9-9c98-4db2-855c-c5e045c4fd84 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:31.837453 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea825f9-9c98-4db2-855c-c5e045c4fd84 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:31.837733 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea825f9-9c98-4db2-855c-c5e045c4fd84 admin admin] PATH_INFO: `/v3/users/ec29ddb9eece44b6b81191a7cb4ec7ee` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:31.838482 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6eda8d6-7cad-4002-92bb-f0eaa4d71e28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:30:31.839984 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea825f9-9c98-4db2-855c-c5e045c4fd84 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ec29ddb9eece44b6b81191a7cb4ec7ee)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:30:31.840111 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6eda8d6-7cad-4002-92bb-f0eaa4d71e28 admin admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:31.840111 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6eda8d6-7cad-4002-92bb-f0eaa4d71e28 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:31.840111 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6eda8d6-7cad-4002-92bb-f0eaa4d71e28 admin admin] PATH_INFO: `/v3/projects` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:31.840461 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6eda8d6-7cad-4002-92bb-f0eaa4d71e28 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:30:31.840830 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea825f9-9c98-4db2-855c-c5e045c4fd84 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:30:31.843268 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6eda8d6-7cad-4002-92bb-f0eaa4d71e28 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:30:31.877913 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 826/1651] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Oct 12 02:30:31 2022] POST /identity/v3/projects => generated 379 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 02:30:31.879138 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6eda8d6-7cad-4002-92bb-f0eaa4d71e28 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:30:31.894796 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-aea825f9-9c98-4db2-855c-c5e045c4fd84 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ec29ddb9eece44b6b81191a7cb4ec7ee'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:30:31.902406 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-aea825f9-9c98-4db2-855c-c5e045c4fd84 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ec29ddb9eece44b6b81191a7cb4ec7ee'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:30:31.916222 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-aea825f9-9c98-4db2-855c-c5e045c4fd84 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ec29ddb9eece44b6b81191a7cb4ec7ee'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:30:31.923160 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-aea825f9-9c98-4db2-855c-c5e045c4fd84 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ec29ddb9eece44b6b81191a7cb4ec7ee'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:30:31.923873 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-aea825f9-9c98-4db2-855c-c5e045c4fd84 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ec29ddb9eece44b6b81191a7cb4ec7ee'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:30:31.930477 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 826/1652] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Oct 12 02:30:31 2022] DELETE /identity/v3/users/ec29ddb9eece44b6b81191a7cb4ec7ee => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 02:30:31.945643 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6eda8d6-7cad-4002-92bb-f0eaa4d71e28 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:30:32.002582 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:30:32.027880 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771f6397-f099-453b-94da-f2119698e121 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:30:32.028608 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771f6397-f099-453b-94da-f2119698e121 admin admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:32.030402 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771f6397-f099-453b-94da-f2119698e121 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:32.030611 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771f6397-f099-453b-94da-f2119698e121 admin admin] PATH_INFO: `/v3/users` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:32.031319 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771f6397-f099-453b-94da-f2119698e121 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:30:32.034086 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771f6397-f099-453b-94da-f2119698e121 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:30:32.067936 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 827/1653] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Oct 12 02:30:31 2022] POST /identity/v3/users => generated 296 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 02:30:32.071764 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea825f9-9c98-4db2-855c-c5e045c4fd84 admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:30:32.073227 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-aea825f9-9c98-4db2-855c-c5e045c4fd84 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:30:32.088337 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea825f9-9c98-4db2-855c-c5e045c4fd84 admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:30:32.100740 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c96815-ceb7-4c22-a71d-6ecb05a1fef8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:30:32.102173 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c96815-ceb7-4c22-a71d-6ecb05a1fef8 admin admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:32.102452 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c96815-ceb7-4c22-a71d-6ecb05a1fef8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:32.102741 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c96815-ceb7-4c22-a71d-6ecb05a1fef8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:32.103372 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c96815-ceb7-4c22-a71d-6ecb05a1fef8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:30:32.105014 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c96815-ceb7-4c22-a71d-6ecb05a1fef8 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:30:32.111753 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:30:32.120669 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 827/1654] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Oct 12 02:30:32 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 02:30:32.121510 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771f6397-f099-453b-94da-f2119698e121 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:30:32.146528 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771f6397-f099-453b-94da-f2119698e121 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:30:32.156269 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6fc65a-7cfa-40be-95e8-6bd7818bd3d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:30:32.157282 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6fc65a-7cfa-40be-95e8-6bd7818bd3d8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:32.158654 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6fc65a-7cfa-40be-95e8-6bd7818bd3d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:32.159071 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6fc65a-7cfa-40be-95e8-6bd7818bd3d8 admin admin] PATH_INFO: `/v3/projects/3b2d6f22389b457bba0795cfb0d46d7f/users/f1274e1d91784dd9b0f16de7cd18f61a/roles/39b1e8108dff402383def3c559f48189` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:32.180229 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6fc65a-7cfa-40be-95e8-6bd7818bd3d8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b2d6f22389b457bba0795cfb0d46d7f, user_id=f1274e1d91784dd9b0f16de7cd18f61a, role_id=39b1e8108dff402383def3c559f48189)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:30:32.183205 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6fc65a-7cfa-40be-95e8-6bd7818bd3d8 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:30:32.207271 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 828/1655] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Oct 12 02:30:32 2022] PUT /identity/v3/projects/3b2d6f22389b457bba0795cfb0d46d7f/users/f1274e1d91784dd9b0f16de7cd18f61a/roles/39b1e8108dff402383def3c559f48189 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 02:30:32.211224 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c96815-ceb7-4c22-a71d-6ecb05a1fef8 admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:30:32.222156 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c96815-ceb7-4c22-a71d-6ecb05a1fef8 admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:30:32.293466 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db9c4f7-cf0f-4719-bb64-b36f99ed0720 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:30:32.294350 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db9c4f7-cf0f-4719-bb64-b36f99ed0720 admin admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:32.294350 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db9c4f7-cf0f-4719-bb64-b36f99ed0720 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:32.294632 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db9c4f7-cf0f-4719-bb64-b36f99ed0720 admin admin] PATH_INFO: `/v3/roles` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:32.295281 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db9c4f7-cf0f-4719-bb64-b36f99ed0720 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:30:32.297134 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db9c4f7-cf0f-4719-bb64-b36f99ed0720 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:30:32.313289 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 828/1656] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Oct 12 02:30:32 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 02:30:32.318339 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6fc65a-7cfa-40be-95e8-6bd7818bd3d8 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:30:32.333076 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6fc65a-7cfa-40be-95e8-6bd7818bd3d8 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:30:32.334529 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db9c4f7-cf0f-4719-bb64-b36f99ed0720 admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:30:32.336718 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-1db9c4f7-cf0f-4719-bb64-b36f99ed0720 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:30:32.343472 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4214cc-c7d4-49ab-a8cd-ed573480145d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:30:32.344512 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4214cc-c7d4-49ab-a8cd-ed573480145d admin admin] REQUEST_METHOD: `PUT` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:32.344994 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4214cc-c7d4-49ab-a8cd-ed573480145d admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:32.345670 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4214cc-c7d4-49ab-a8cd-ed573480145d admin admin] PATH_INFO: `/v3/projects/3b2d6f22389b457bba0795cfb0d46d7f/users/f1274e1d91784dd9b0f16de7cd18f61a/roles/39b1e8108dff402383def3c559f48189` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:32.348742 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4214cc-c7d4-49ab-a8cd-ed573480145d admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b2d6f22389b457bba0795cfb0d46d7f, user_id=f1274e1d91784dd9b0f16de7cd18f61a, role_id=39b1e8108dff402383def3c559f48189)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:30:32.352097 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4214cc-c7d4-49ab-a8cd-ed573480145d admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:30:32.352337 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db9c4f7-cf0f-4719-bb64-b36f99ed0720 admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:30:32.358232 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ac36be-6664-40c1-9330-e8514b8e5a18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:30:32.359008 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ac36be-6664-40c1-9330-e8514b8e5a18 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:32.359634 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ac36be-6664-40c1-9330-e8514b8e5a18 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:32.360017 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ac36be-6664-40c1-9330-e8514b8e5a18 admin admin] PATH_INFO: `/v3/projects/7d9b8f577d4840fba000dcf5c62181cf` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:32.361383 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ac36be-6664-40c1-9330-e8514b8e5a18 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7d9b8f577d4840fba000dcf5c62181cf)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:30:32.363393 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ac36be-6664-40c1-9330-e8514b8e5a18 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:30:32.369197 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 829/1657] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Oct 12 02:30:32 2022] PUT /identity/v3/projects/3b2d6f22389b457bba0795cfb0d46d7f/users/f1274e1d91784dd9b0f16de7cd18f61a/roles/39b1e8108dff402383def3c559f48189 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 02:30:32.381039 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58eaaa0c-28a8-40ed-ae93-13041a84ad7b None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:32.381531 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58eaaa0c-28a8-40ed-ae93-13041a84ad7b None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:32.381803 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58eaaa0c-28a8-40ed-ae93-13041a84ad7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:32.437584 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-83ac36be-6664-40c1-9330-e8514b8e5a18 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7d9b8f577d4840fba000dcf5c62181cf', 'request_id': 'req-83ac36be-6664-40c1-9330-e8514b8e5a18'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:30:32.443514 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-58eaaa0c-28a8-40ed-ae93-13041a84ad7b None None] MFA Rules not processed for user `f1274e1d91784dd9b0f16de7cd18f61a`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:30:32.448891 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-83ac36be-6664-40c1-9330-e8514b8e5a18 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7d9b8f577d4840fba000dcf5c62181cf', 'request_id': 'req-83ac36be-6664-40c1-9330-e8514b8e5a18'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:30:32.449357 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-58eaaa0c-28a8-40ed-ae93-13041a84ad7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:30:32.459286 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-83ac36be-6664-40c1-9330-e8514b8e5a18 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7d9b8f577d4840fba000dcf5c62181cf', 'request_id': 'req-83ac36be-6664-40c1-9330-e8514b8e5a18'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:30:32.483617 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-83ac36be-6664-40c1-9330-e8514b8e5a18 admin admin] The token cache is being invalidate because project 7d9b8f577d4840fba000dcf5c62181cf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81361) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 02:30:32.483911 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-83ac36be-6664-40c1-9330-e8514b8e5a18 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:30:32.485946 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-83ac36be-6664-40c1-9330-e8514b8e5a18 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:30:32.492883 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 829/1658] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Oct 12 02:30:32 2022] DELETE /identity/v3/projects/7d9b8f577d4840fba000dcf5c62181cf => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 02:30:32.496362 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ac36be-6664-40c1-9330-e8514b8e5a18 admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:30:32.498523 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-83ac36be-6664-40c1-9330-e8514b8e5a18 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:30:32.605816 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 830/1659] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 02:30:32 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 02:30:32.609584 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ac36be-6664-40c1-9330-e8514b8e5a18 admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:30:32.614582 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc29ab55-629a-4a3a-ba83-033886553410 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:30:32.615345 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc29ab55-629a-4a3a-ba83-033886553410 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:32.615863 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc29ab55-629a-4a3a-ba83-033886553410 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:32.616293 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc29ab55-629a-4a3a-ba83-033886553410 admin admin] PATH_INFO: `/v3/users/7a0aa53f48f248ef86d14b3b1b4b7e6f` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:32.617656 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc29ab55-629a-4a3a-ba83-033886553410 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7a0aa53f48f248ef86d14b3b1b4b7e6f)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:30:32.618481 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58eaaa0c-28a8-40ed-ae93-13041a84ad7b None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:30:32.619917 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc29ab55-629a-4a3a-ba83-033886553410 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:30:32.622307 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-58eaaa0c-28a8-40ed-ae93-13041a84ad7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:30:32.661768 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:30:32.710792 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-fc29ab55-629a-4a3a-ba83-033886553410 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7a0aa53f48f248ef86d14b3b1b4b7e6f'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:30:32.712194 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58eaaa0c-28a8-40ed-ae93-13041a84ad7b None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:30:32.715509 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357359d4-03af-4cff-9291-081823abfa35 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ba688e0c4d44d13898539ee886f95fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'beb6def6fcad45959e56425bb8bff4d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:30:32.716255 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357359d4-03af-4cff-9291-081823abfa35 service cinder] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:32.717401 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357359d4-03af-4cff-9291-081823abfa35 service cinder] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:32.717661 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357359d4-03af-4cff-9291-081823abfa35 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:32.721995 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-fc29ab55-629a-4a3a-ba83-033886553410 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7a0aa53f48f248ef86d14b3b1b4b7e6f'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:30:32.728590 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357359d4-03af-4cff-9291-081823abfa35 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:30:32.730156 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357359d4-03af-4cff-9291-081823abfa35 service cinder] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:30:32.742281 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 831/1660] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 02:30:32 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 12 02:30:32.744357 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-fc29ab55-629a-4a3a-ba83-033886553410 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7a0aa53f48f248ef86d14b3b1b4b7e6f'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:30:32.753405 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-fc29ab55-629a-4a3a-ba83-033886553410 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7a0aa53f48f248ef86d14b3b1b4b7e6f'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:30:32.754389 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-fc29ab55-629a-4a3a-ba83-033886553410 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7a0aa53f48f248ef86d14b3b1b4b7e6f'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:30:32.761845 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 830/1661] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Oct 12 02:30:32 2022] DELETE /identity/v3/users/7a0aa53f48f248ef86d14b3b1b4b7e6f => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 02:30:32.845202 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357359d4-03af-4cff-9291-081823abfa35 service cinder] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:30:32.859960 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357359d4-03af-4cff-9291-081823abfa35 service cinder] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:30:32.880463 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:30:32.967989 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84dae635-2267-4484-b291-7daf5ff1b65b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ba688e0c4d44d13898539ee886f95fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'beb6def6fcad45959e56425bb8bff4d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:30:32.968689 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dae635-2267-4484-b291-7daf5ff1b65b service cinder] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:32.968971 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dae635-2267-4484-b291-7daf5ff1b65b service cinder] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:32.969239 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dae635-2267-4484-b291-7daf5ff1b65b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:32.978011 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-84dae635-2267-4484-b291-7daf5ff1b65b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:30:33.077591 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84dae635-2267-4484-b291-7daf5ff1b65b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:30:33.083294 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84dae635-2267-4484-b291-7daf5ff1b65b service cinder] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:30:33.109973 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 832/1662] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 02:30:32 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 265 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 02:30:33.215650 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc29ab55-629a-4a3a-ba83-033886553410 admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:30:33.217697 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-fc29ab55-629a-4a3a-ba83-033886553410 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:30:33.405391 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc29ab55-629a-4a3a-ba83-033886553410 admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:30:33.421362 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4234862c-082f-4620-889b-c3ba813dd216 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:30:33.421963 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4234862c-082f-4620-889b-c3ba813dd216 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:33.422242 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4234862c-082f-4620-889b-c3ba813dd216 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:33.422515 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4234862c-082f-4620-889b-c3ba813dd216 admin admin] PATH_INFO: `/v3/projects/3b3e3bd91ac0480e8ff0e32d5f0416ba` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:33.423742 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4234862c-082f-4620-889b-c3ba813dd216 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3b3e3bd91ac0480e8ff0e32d5f0416ba)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:30:33.425696 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4234862c-082f-4620-889b-c3ba813dd216 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:30:33.505187 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-4234862c-082f-4620-889b-c3ba813dd216 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3b3e3bd91ac0480e8ff0e32d5f0416ba', 'request_id': 'req-4234862c-082f-4620-889b-c3ba813dd216'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:30:33.511063 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-4234862c-082f-4620-889b-c3ba813dd216 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3b3e3bd91ac0480e8ff0e32d5f0416ba', 'request_id': 'req-4234862c-082f-4620-889b-c3ba813dd216'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:30:33.517704 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-4234862c-082f-4620-889b-c3ba813dd216 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3b3e3bd91ac0480e8ff0e32d5f0416ba', 'request_id': 'req-4234862c-082f-4620-889b-c3ba813dd216'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:30:33.542403 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-4234862c-082f-4620-889b-c3ba813dd216 admin admin] The token cache is being invalidate because project 3b3e3bd91ac0480e8ff0e32d5f0416ba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81361) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 02:30:33.542803 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-4234862c-082f-4620-889b-c3ba813dd216 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:30:33.545170 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-4234862c-082f-4620-889b-c3ba813dd216 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:30:33.548518 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 831/1663] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Oct 12 02:30:33 2022] DELETE /identity/v3/projects/3b3e3bd91ac0480e8ff0e32d5f0416ba => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 02:30:33.556889 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a67444-1dc1-4232-8375-10f295e565b3 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:33.557684 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a67444-1dc1-4232-8375-10f295e565b3 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:33.557981 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a67444-1dc1-4232-8375-10f295e565b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:33.582927 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-36a67444-1dc1-4232-8375-10f295e565b3 None None] MFA Rules not processed for user `a326a5bb7364479382f528a592371656`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:30:33.583759 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-36a67444-1dc1-4232-8375-10f295e565b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:30:33.621920 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4234862c-082f-4620-889b-c3ba813dd216 admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:30:33.624352 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-4234862c-082f-4620-889b-c3ba813dd216 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:30:33.660770 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 833/1664] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 02:30:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 02:30:33.673644 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1515a405-7de2-460e-93fa-d2c8edc22350 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:33.674138 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1515a405-7de2-460e-93fa-d2c8edc22350 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:33.674582 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1515a405-7de2-460e-93fa-d2c8edc22350 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:33.685586 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:DELETE=15,keystone:SELECT=83,keystone:INSERT=2 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:30:33.707047 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-1515a405-7de2-460e-93fa-d2c8edc22350 None None] MFA Rules not processed for user `a326a5bb7364479382f528a592371656`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:30:33.709540 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-1515a405-7de2-460e-93fa-d2c8edc22350 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:30:33.725034 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 834/1665] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 02:30:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 02:30:33.726172 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1515a405-7de2-460e-93fa-d2c8edc22350 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:30:33.741122 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1515a405-7de2-460e-93fa-d2c8edc22350 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:30:33.750368 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ef44ff-22b3-4f49-be2d-a52765f44d72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:30:33.752738 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ef44ff-22b3-4f49-be2d-a52765f44d72 admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:33.753319 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ef44ff-22b3-4f49-be2d-a52765f44d72 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:33.754098 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4234862c-082f-4620-889b-c3ba813dd216 admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:30:33.754485 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ef44ff-22b3-4f49-be2d-a52765f44d72 admin admin] PATH_INFO: `/v3/domains` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:33.755252 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ef44ff-22b3-4f49-be2d-a52765f44d72 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 02:30:33.756148 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ef44ff-22b3-4f49-be2d-a52765f44d72 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:30:33.763411 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ef44ff-22b3-4f49-be2d-a52765f44d72 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:30:33.766689 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c108fab-4856-4a50-a5dc-2e8550cdb758 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:30:33.767359 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c108fab-4856-4a50-a5dc-2e8550cdb758 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:33.771865 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c108fab-4856-4a50-a5dc-2e8550cdb758 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:33.772240 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c108fab-4856-4a50-a5dc-2e8550cdb758 admin admin] PATH_INFO: `/v3/users/53379dc9b0064b3891fad6eef1ff5bfc` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:33.775749 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c108fab-4856-4a50-a5dc-2e8550cdb758 admin admin] RBAC: Authorizing `identity:delete_user(user_id=53379dc9b0064b3891fad6eef1ff5bfc)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:30:33.782458 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c108fab-4856-4a50-a5dc-2e8550cdb758 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:30:33.803752 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 835/1666] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Oct 12 02:30:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 02:30:33.804716 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ef44ff-22b3-4f49-be2d-a52765f44d72 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:30:33.815610 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ef44ff-22b3-4f49-be2d-a52765f44d72 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:30:33.823147 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a07cae-6483-4e17-8976-a68356896331 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:30:33.824011 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a07cae-6483-4e17-8976-a68356896331 admin admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:33.824633 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a07cae-6483-4e17-8976-a68356896331 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:33.825537 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a07cae-6483-4e17-8976-a68356896331 admin admin] PATH_INFO: `/v3/projects` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:33.827564 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a07cae-6483-4e17-8976-a68356896331 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:30:33.830609 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a07cae-6483-4e17-8976-a68356896331 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:30:33.905818 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-0c108fab-4856-4a50-a5dc-2e8550cdb758 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '53379dc9b0064b3891fad6eef1ff5bfc'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:30:33.910587 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 836/1667] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Oct 12 02:30:33 2022] POST /identity/v3/projects => generated 383 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 02:30:33.914093 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a07cae-6483-4e17-8976-a68356896331 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:30:33.917536 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-0c108fab-4856-4a50-a5dc-2e8550cdb758 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '53379dc9b0064b3891fad6eef1ff5bfc'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:30:33.975768 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:30:33.985215 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-0c108fab-4856-4a50-a5dc-2e8550cdb758 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '53379dc9b0064b3891fad6eef1ff5bfc'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:30:34.002535 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-0c108fab-4856-4a50-a5dc-2e8550cdb758 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '53379dc9b0064b3891fad6eef1ff5bfc'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:30:34.003358 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-0c108fab-4856-4a50-a5dc-2e8550cdb758 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '53379dc9b0064b3891fad6eef1ff5bfc'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:30:34.014630 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 832/1668] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Oct 12 02:30:33 2022] DELETE /identity/v3/users/53379dc9b0064b3891fad6eef1ff5bfc => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 02:30:34.016229 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969cbc86-09da-4131-bc9d-2d56fe39f542 None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:34.016725 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969cbc86-09da-4131-bc9d-2d56fe39f542 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:34.017142 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969cbc86-09da-4131-bc9d-2d56fe39f542 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:34.033723 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a07cae-6483-4e17-8976-a68356896331 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:30:34.065794 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-969cbc86-09da-4131-bc9d-2d56fe39f542 None None] MFA Rules not processed for user `a326a5bb7364479382f528a592371656`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:30:34.067645 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-969cbc86-09da-4131-bc9d-2d56fe39f542 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:30:34.128417 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6051275-780a-47b1-baab-fa2451386b1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:30:34.129415 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6051275-780a-47b1-baab-fa2451386b1d admin admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:34.129855 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6051275-780a-47b1-baab-fa2451386b1d admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:34.130127 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6051275-780a-47b1-baab-fa2451386b1d admin admin] PATH_INFO: `/v3/users` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:34.130774 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6051275-780a-47b1-baab-fa2451386b1d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:30:34.132941 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6051275-780a-47b1-baab-fa2451386b1d admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:30:34.144295 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 833/1669] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 02:30:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 02:30:34.155239 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969cbc86-09da-4131-bc9d-2d56fe39f542 None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:30:34.156672 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-969cbc86-09da-4131-bc9d-2d56fe39f542 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:30:34.157119 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 837/1670] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Oct 12 02:30:33 2022] POST /identity/v3/users => generated 292 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 02:30:34.160980 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6051275-780a-47b1-baab-fa2451386b1d admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:30:34.162532 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-e6051275-780a-47b1-baab-fa2451386b1d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:30:34.174119 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6051275-780a-47b1-baab-fa2451386b1d admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:30:34.179106 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c35bdd-73e5-42be-a2cc-eb7aad5c0162 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:30:34.179725 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c35bdd-73e5-42be-a2cc-eb7aad5c0162 admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:34.179999 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c35bdd-73e5-42be-a2cc-eb7aad5c0162 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:34.180270 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c35bdd-73e5-42be-a2cc-eb7aad5c0162 admin admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:34.180940 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c35bdd-73e5-42be-a2cc-eb7aad5c0162 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:30:34.182510 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c35bdd-73e5-42be-a2cc-eb7aad5c0162 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:30:34.193127 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 838/1671] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Oct 12 02:30:34 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 12 02:30:34.197203 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c35bdd-73e5-42be-a2cc-eb7aad5c0162 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:30:34.211563 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c35bdd-73e5-42be-a2cc-eb7aad5c0162 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:30:34.217136 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250105ce-0b92-47ff-be68-9d8a956f5ec2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:30:34.217743 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250105ce-0b92-47ff-be68-9d8a956f5ec2 admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:34.218021 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250105ce-0b92-47ff-be68-9d8a956f5ec2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:34.218291 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250105ce-0b92-47ff-be68-9d8a956f5ec2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:34.218929 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250105ce-0b92-47ff-be68-9d8a956f5ec2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:30:34.220258 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:30:34.220549 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250105ce-0b92-47ff-be68-9d8a956f5ec2 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:30:34.226886 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969cbc86-09da-4131-bc9d-2d56fe39f542 None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:30:34.231233 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 839/1672] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Oct 12 02:30:34 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 02:30:34.231433 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a977a705-7532-49f7-9d6e-af8743672400 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5223b5cab3114e9b9a13c582f8ef8386', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'beb6def6fcad45959e56425bb8bff4d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:30:34.232359 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a977a705-7532-49f7-9d6e-af8743672400 service neutron] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:34.232754 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a977a705-7532-49f7-9d6e-af8743672400 service neutron] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:34.233032 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a977a705-7532-49f7-9d6e-af8743672400 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:34.235824 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250105ce-0b92-47ff-be68-9d8a956f5ec2 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:30:34.243091 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a977a705-7532-49f7-9d6e-af8743672400 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:30:34.244550 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a977a705-7532-49f7-9d6e-af8743672400 service neutron] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:30:34.245931 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250105ce-0b92-47ff-be68-9d8a956f5ec2 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:30:34.251202 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea97235-1859-4558-b6cc-eb237ce757ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:30:34.251832 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea97235-1859-4558-b6cc-eb237ce757ed admin admin] REQUEST_METHOD: `PUT` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:34.252107 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea97235-1859-4558-b6cc-eb237ce757ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:34.252381 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea97235-1859-4558-b6cc-eb237ce757ed admin admin] PATH_INFO: `/v3/projects/00e8e46ac67f44e687a3332bd50b5b9d/users/db355001581d4e9e888456d82f127021/roles/3d75c4d7f1a849b9a771504d1583ab28` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:34.254125 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 834/1673] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 02:30:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 12 02:30:34.267389 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea97235-1859-4558-b6cc-eb237ce757ed admin admin] RBAC: Authorizing `identity:create_grant(project_id=00e8e46ac67f44e687a3332bd50b5b9d, user_id=db355001581d4e9e888456d82f127021, role_id=3d75c4d7f1a849b9a771504d1583ab28)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:30:34.270053 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea97235-1859-4558-b6cc-eb237ce757ed admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:30:34.283713 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 840/1674] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Oct 12 02:30:34 2022] PUT /identity/v3/projects/00e8e46ac67f44e687a3332bd50b5b9d/users/db355001581d4e9e888456d82f127021/roles/3d75c4d7f1a849b9a771504d1583ab28 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 02:30:34.297095 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b97d884-ec24-4f1b-99f9-52d4e960b84f None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:34.297399 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b97d884-ec24-4f1b-99f9-52d4e960b84f None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:34.297651 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b97d884-ec24-4f1b-99f9-52d4e960b84f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:34.336987 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-1b97d884-ec24-4f1b-99f9-52d4e960b84f None None] MFA Rules not processed for user `db355001581d4e9e888456d82f127021`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:30:34.338455 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-1b97d884-ec24-4f1b-99f9-52d4e960b84f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:30:34.414216 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 835/1675] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 02:30:34 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 02:30:34.419452 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea97235-1859-4558-b6cc-eb237ce757ed admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:30:34.518804 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea97235-1859-4558-b6cc-eb237ce757ed admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:30:34.526130 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187bb9d2-6c67-4a27-87d1-2cf924c0b1cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:30:34.527392 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187bb9d2-6c67-4a27-87d1-2cf924c0b1cb admin admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:34.527679 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187bb9d2-6c67-4a27-87d1-2cf924c0b1cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:34.527954 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187bb9d2-6c67-4a27-87d1-2cf924c0b1cb admin admin] PATH_INFO: `/v3/projects` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:34.528683 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187bb9d2-6c67-4a27-87d1-2cf924c0b1cb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:30:34.530782 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187bb9d2-6c67-4a27-87d1-2cf924c0b1cb admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:30:34.571399 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 841/1676] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Oct 12 02:30:34 2022] POST /identity/v3/projects => generated 381 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 02:30:34.575555 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b97d884-ec24-4f1b-99f9-52d4e960b84f None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:30:34.590993 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b97d884-ec24-4f1b-99f9-52d4e960b84f None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:30:34.607874 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187bb9d2-6c67-4a27-87d1-2cf924c0b1cb admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:30:34.610516 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-187bb9d2-6c67-4a27-87d1-2cf924c0b1cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:30:34.622261 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:30:34.688322 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce86b411-4667-4856-9c35-a0c7bfa42079 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:30:34.688978 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce86b411-4667-4856-9c35-a0c7bfa42079 admin admin] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:34.689255 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce86b411-4667-4856-9c35-a0c7bfa42079 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:34.689531 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce86b411-4667-4856-9c35-a0c7bfa42079 admin admin] PATH_INFO: `/v3/users` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:34.690220 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce86b411-4667-4856-9c35-a0c7bfa42079 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:30:34.692331 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce86b411-4667-4856-9c35-a0c7bfa42079 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:30:34.697810 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187bb9d2-6c67-4a27-87d1-2cf924c0b1cb admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:30:34.706051 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe27de2-5e1c-4931-8b31-8bbaaa4156f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:30:34.706994 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe27de2-5e1c-4931-8b31-8bbaaa4156f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:34.707307 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe27de2-5e1c-4931-8b31-8bbaaa4156f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:34.707921 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe27de2-5e1c-4931-8b31-8bbaaa4156f3 admin admin] PATH_INFO: `/v3/projects/eadcdfd888eb4a91896b88ed3fdcb348` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:34.709583 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe27de2-5e1c-4931-8b31-8bbaaa4156f3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eadcdfd888eb4a91896b88ed3fdcb348)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:30:34.713977 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe27de2-5e1c-4931-8b31-8bbaaa4156f3 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:30:34.720953 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 836/1677] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Oct 12 02:30:34 2022] POST /identity/v3/users => generated 297 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 02:30:34.721968 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce86b411-4667-4856-9c35-a0c7bfa42079 admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:30:34.737451 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce86b411-4667-4856-9c35-a0c7bfa42079 admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:30:34.745435 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba670d9-2142-46c5-bc55-5431cd092fbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:30:34.746168 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba670d9-2142-46c5-bc55-5431cd092fbc admin admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:34.746500 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba670d9-2142-46c5-bc55-5431cd092fbc admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:34.746778 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba670d9-2142-46c5-bc55-5431cd092fbc admin admin] PATH_INFO: `/v3/roles` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:34.748643 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba670d9-2142-46c5-bc55-5431cd092fbc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:30:34.752626 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba670d9-2142-46c5-bc55-5431cd092fbc admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:30:34.768386 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 837/1678] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Oct 12 02:30:34 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 02:30:34.772182 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba670d9-2142-46c5-bc55-5431cd092fbc admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:30:34.784863 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba670d9-2142-46c5-bc55-5431cd092fbc admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:30:34.803315 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-ebe27de2-5e1c-4931-8b31-8bbaaa4156f3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eadcdfd888eb4a91896b88ed3fdcb348', 'request_id': 'req-ebe27de2-5e1c-4931-8b31-8bbaaa4156f3'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:30:34.812588 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-ebe27de2-5e1c-4931-8b31-8bbaaa4156f3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eadcdfd888eb4a91896b88ed3fdcb348', 'request_id': 'req-ebe27de2-5e1c-4931-8b31-8bbaaa4156f3'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:30:34.821861 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-ebe27de2-5e1c-4931-8b31-8bbaaa4156f3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eadcdfd888eb4a91896b88ed3fdcb348', 'request_id': 'req-ebe27de2-5e1c-4931-8b31-8bbaaa4156f3'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:30:34.852858 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-ebe27de2-5e1c-4931-8b31-8bbaaa4156f3 admin admin] The token cache is being invalidate because project eadcdfd888eb4a91896b88ed3fdcb348 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81362) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 02:30:34.853374 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-ebe27de2-5e1c-4931-8b31-8bbaaa4156f3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:30:34.854336 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-ebe27de2-5e1c-4931-8b31-8bbaaa4156f3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:30:34.856633 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 842/1679] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Oct 12 02:30:34 2022] DELETE /identity/v3/projects/eadcdfd888eb4a91896b88ed3fdcb348 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 02:30:34.861404 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe27de2-5e1c-4931-8b31-8bbaaa4156f3 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:30:34.862844 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-ebe27de2-5e1c-4931-8b31-8bbaaa4156f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:30:34.866557 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:30:34.876355 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a19f999-81a2-4b82-9102-3cab38d3f6b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:30:34.877274 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a19f999-81a2-4b82-9102-3cab38d3f6b9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:34.877704 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a19f999-81a2-4b82-9102-3cab38d3f6b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:34.878444 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a19f999-81a2-4b82-9102-3cab38d3f6b9 admin admin] PATH_INFO: `/v3/projects/0b60354a2ba74f078678864aae64a6e1/users/4f68dadf5bdc463eb5e3b506fceb0058/roles/39b1e8108dff402383def3c559f48189` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:34.902388 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a19f999-81a2-4b82-9102-3cab38d3f6b9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0b60354a2ba74f078678864aae64a6e1, user_id=4f68dadf5bdc463eb5e3b506fceb0058, role_id=39b1e8108dff402383def3c559f48189)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:30:34.905240 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a19f999-81a2-4b82-9102-3cab38d3f6b9 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:30:34.931975 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 838/1680] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Oct 12 02:30:34 2022] PUT /identity/v3/projects/0b60354a2ba74f078678864aae64a6e1/users/4f68dadf5bdc463eb5e3b506fceb0058/roles/39b1e8108dff402383def3c559f48189 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 02:30:34.934272 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a19f999-81a2-4b82-9102-3cab38d3f6b9 admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:30:34.937144 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-9a19f999-81a2-4b82-9102-3cab38d3f6b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:30:34.967504 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe27de2-5e1c-4931-8b31-8bbaaa4156f3 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:30:35.041626 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a19f999-81a2-4b82-9102-3cab38d3f6b9 admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:30:35.041859 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:30:35.047550 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f3d708-4f40-4cac-b04b-24fe156531df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:30:35.048156 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f3d708-4f40-4cac-b04b-24fe156531df admin admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:35.048433 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f3d708-4f40-4cac-b04b-24fe156531df admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:35.048734 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f3d708-4f40-4cac-b04b-24fe156531df admin admin] PATH_INFO: `/v3/roles` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:35.049438 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f3d708-4f40-4cac-b04b-24fe156531df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:30:35.051746 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f3d708-4f40-4cac-b04b-24fe156531df admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:30:35.068983 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 839/1681] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Oct 12 02:30:34 2022] GET /identity/v3/roles => generated 1420 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 02:30:35.070653 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0679ba0-c655-416f-a0ff-e32703f81ab8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:30:35.071307 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0679ba0-c655-416f-a0ff-e32703f81ab8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:35.071587 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0679ba0-c655-416f-a0ff-e32703f81ab8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:35.071856 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0679ba0-c655-416f-a0ff-e32703f81ab8 admin admin] PATH_INFO: `/v3/users/d1261389fc8f4054b0083a6415508fc7` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:35.073121 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0679ba0-c655-416f-a0ff-e32703f81ab8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d1261389fc8f4054b0083a6415508fc7)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:30:35.073369 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f3d708-4f40-4cac-b04b-24fe156531df admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:30:35.076106 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0679ba0-c655-416f-a0ff-e32703f81ab8 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:30:35.084412 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f3d708-4f40-4cac-b04b-24fe156531df admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:30:35.089617 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523fde6c-2da2-4705-8744-5687e6ee9a84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:30:35.090269 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523fde6c-2da2-4705-8744-5687e6ee9a84 admin admin] REQUEST_METHOD: `PUT` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:35.090542 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523fde6c-2da2-4705-8744-5687e6ee9a84 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:35.090810 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523fde6c-2da2-4705-8744-5687e6ee9a84 admin admin] PATH_INFO: `/v3/projects/0b60354a2ba74f078678864aae64a6e1/users/4f68dadf5bdc463eb5e3b506fceb0058/roles/39b1e8108dff402383def3c559f48189` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:35.093365 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523fde6c-2da2-4705-8744-5687e6ee9a84 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0b60354a2ba74f078678864aae64a6e1, user_id=4f68dadf5bdc463eb5e3b506fceb0058, role_id=39b1e8108dff402383def3c559f48189)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:30:35.096128 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523fde6c-2da2-4705-8744-5687e6ee9a84 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:30:35.113421 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 840/1682] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Oct 12 02:30:35 2022] PUT /identity/v3/projects/0b60354a2ba74f078678864aae64a6e1/users/4f68dadf5bdc463eb5e3b506fceb0058/roles/39b1e8108dff402383def3c559f48189 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 02:30:35.125255 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989d5b8b-d992-46b6-ad07-103021a2c94f None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:35.125636 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989d5b8b-d992-46b6-ad07-103021a2c94f None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:35.126016 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989d5b8b-d992-46b6-ad07-103021a2c94f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:35.146406 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-a0679ba0-c655-416f-a0ff-e32703f81ab8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd1261389fc8f4054b0083a6415508fc7'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:30:35.157207 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-a0679ba0-c655-416f-a0ff-e32703f81ab8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd1261389fc8f4054b0083a6415508fc7'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:30:35.164781 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-989d5b8b-d992-46b6-ad07-103021a2c94f None None] MFA Rules not processed for user `4f68dadf5bdc463eb5e3b506fceb0058`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:30:35.167247 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-989d5b8b-d992-46b6-ad07-103021a2c94f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:30:35.180405 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-a0679ba0-c655-416f-a0ff-e32703f81ab8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd1261389fc8f4054b0083a6415508fc7'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:30:35.189815 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-a0679ba0-c655-416f-a0ff-e32703f81ab8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd1261389fc8f4054b0083a6415508fc7'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:30:35.190551 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-a0679ba0-c655-416f-a0ff-e32703f81ab8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd1261389fc8f4054b0083a6415508fc7'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:30:35.198019 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 843/1683] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Oct 12 02:30:34 2022] DELETE /identity/v3/users/d1261389fc8f4054b0083a6415508fc7 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 02:30:35.263009 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 841/1684] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 02:30:35 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 02:30:35.283287 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0679ba0-c655-416f-a0ff-e32703f81ab8 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:30:35.285055 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-a0679ba0-c655-416f-a0ff-e32703f81ab8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:30:35.412353 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0679ba0-c655-416f-a0ff-e32703f81ab8 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:30:35.424872 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3930350-844a-4e70-8c05-69dbcc89a091 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ba688e0c4d44d13898539ee886f95fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'beb6def6fcad45959e56425bb8bff4d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:30:35.425519 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3930350-844a-4e70-8c05-69dbcc89a091 service cinder] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:35.425808 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3930350-844a-4e70-8c05-69dbcc89a091 service cinder] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:35.426084 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3930350-844a-4e70-8c05-69dbcc89a091 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:35.514953 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3930350-844a-4e70-8c05-69dbcc89a091 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:30:35.516616 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3930350-844a-4e70-8c05-69dbcc89a091 service cinder] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:30:35.529548 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 844/1685] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 02:30:35 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 246 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 02:30:35.558098 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989d5b8b-d992-46b6-ad07-103021a2c94f None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:30:35.560266 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-989d5b8b-d992-46b6-ad07-103021a2c94f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:30:35.631119 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:30:35.649180 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989d5b8b-d992-46b6-ad07-103021a2c94f None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:30:35.650681 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3930350-844a-4e70-8c05-69dbcc89a091 service cinder] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:30:35.659867 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3930350-844a-4e70-8c05-69dbcc89a091 service cinder] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:30:35.664014 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613d6a41-fd80-4d25-b021-91dbbc231188 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ba688e0c4d44d13898539ee886f95fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'beb6def6fcad45959e56425bb8bff4d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:30:35.664768 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613d6a41-fd80-4d25-b021-91dbbc231188 service cinder] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:35.665123 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613d6a41-fd80-4d25-b021-91dbbc231188 service cinder] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:35.665467 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613d6a41-fd80-4d25-b021-91dbbc231188 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:35.667638 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-613d6a41-fd80-4d25-b021-91dbbc231188 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:30:35.682982 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:30:35.713419 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b6f953-5a06-443b-baba-e37df4b76baa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:30:35.714320 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b6f953-5a06-443b-baba-e37df4b76baa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:35.714666 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b6f953-5a06-443b-baba-e37df4b76baa admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:35.714953 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b6f953-5a06-443b-baba-e37df4b76baa admin admin] PATH_INFO: `/v3/projects/3ecb3bc942ae427fb1aea118551718d3` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:35.716241 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b6f953-5a06-443b-baba-e37df4b76baa admin admin] RBAC: Authorizing `identity:delete_project(project_id=3ecb3bc942ae427fb1aea118551718d3)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:30:35.718531 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b6f953-5a06-443b-baba-e37df4b76baa admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:30:35.747053 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613d6a41-fd80-4d25-b021-91dbbc231188 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:30:35.749131 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613d6a41-fd80-4d25-b021-91dbbc231188 service cinder] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:30:35.759458 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 845/1686] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 02:30:35 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 02:30:35.770514 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-02b6f953-5a06-443b-baba-e37df4b76baa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3ecb3bc942ae427fb1aea118551718d3', 'request_id': 'req-02b6f953-5a06-443b-baba-e37df4b76baa'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:30:35.776459 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-02b6f953-5a06-443b-baba-e37df4b76baa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3ecb3bc942ae427fb1aea118551718d3', 'request_id': 'req-02b6f953-5a06-443b-baba-e37df4b76baa'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:30:35.783114 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-02b6f953-5a06-443b-baba-e37df4b76baa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3ecb3bc942ae427fb1aea118551718d3', 'request_id': 'req-02b6f953-5a06-443b-baba-e37df4b76baa'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:30:35.796404 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-02b6f953-5a06-443b-baba-e37df4b76baa admin admin] The token cache is being invalidate because project 3ecb3bc942ae427fb1aea118551718d3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81361) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 02:30:35.796777 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-02b6f953-5a06-443b-baba-e37df4b76baa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:30:35.797396 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-02b6f953-5a06-443b-baba-e37df4b76baa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:30:35.798904 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 842/1687] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Oct 12 02:30:35 2022] DELETE /identity/v3/projects/3ecb3bc942ae427fb1aea118551718d3 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 02:30:35.803560 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613d6a41-fd80-4d25-b021-91dbbc231188 service cinder] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:30:35.817387 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613d6a41-fd80-4d25-b021-91dbbc231188 service cinder] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:30:35.885411 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6fb082-b49f-4047-be43-33d77f52ecd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:30:35.886041 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6fb082-b49f-4047-be43-33d77f52ecd7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:35.886321 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6fb082-b49f-4047-be43-33d77f52ecd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:35.886591 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6fb082-b49f-4047-be43-33d77f52ecd7 admin admin] PATH_INFO: `/v3/users/5b81c107bb3644b9af9e7bcda780c3c3` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:35.887697 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6fb082-b49f-4047-be43-33d77f52ecd7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5b81c107bb3644b9af9e7bcda780c3c3)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:30:35.889814 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6fb082-b49f-4047-be43-33d77f52ecd7 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:30:35.951434 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-2e6fb082-b49f-4047-be43-33d77f52ecd7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5b81c107bb3644b9af9e7bcda780c3c3'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:30:35.959184 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-2e6fb082-b49f-4047-be43-33d77f52ecd7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5b81c107bb3644b9af9e7bcda780c3c3'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:30:35.974015 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-2e6fb082-b49f-4047-be43-33d77f52ecd7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5b81c107bb3644b9af9e7bcda780c3c3'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:30:35.983281 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-2e6fb082-b49f-4047-be43-33d77f52ecd7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5b81c107bb3644b9af9e7bcda780c3c3'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:30:35.984013 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-2e6fb082-b49f-4047-be43-33d77f52ecd7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5b81c107bb3644b9af9e7bcda780c3c3'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:30:35.991951 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 846/1688] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Oct 12 02:30:35 2022] DELETE /identity/v3/users/5b81c107bb3644b9af9e7bcda780c3c3 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 02:30:36.401755 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b6f953-5a06-443b-baba-e37df4b76baa admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:30:36.403342 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-02b6f953-5a06-443b-baba-e37df4b76baa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:30:36.417210 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b6f953-5a06-443b-baba-e37df4b76baa admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:30:36.475475 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcc53ee-f431-49b6-b5f5-a15bfac9dea6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:30:36.476111 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcc53ee-f431-49b6-b5f5-a15bfac9dea6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:36.476413 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcc53ee-f431-49b6-b5f5-a15bfac9dea6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:36.476730 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcc53ee-f431-49b6-b5f5-a15bfac9dea6 admin admin] PATH_INFO: `/v3/projects/de2d1c131e8d4fe096aeb064ff6b28eb` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:36.477855 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fcc53ee-f431-49b6-b5f5-a15bfac9dea6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=de2d1c131e8d4fe096aeb064ff6b28eb)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:30:36.479756 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fcc53ee-f431-49b6-b5f5-a15bfac9dea6 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:30:36.510964 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:30:36.527404 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-9fcc53ee-f431-49b6-b5f5-a15bfac9dea6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'de2d1c131e8d4fe096aeb064ff6b28eb', 'request_id': 'req-9fcc53ee-f431-49b6-b5f5-a15bfac9dea6'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:30:36.533454 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-9fcc53ee-f431-49b6-b5f5-a15bfac9dea6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'de2d1c131e8d4fe096aeb064ff6b28eb', 'request_id': 'req-9fcc53ee-f431-49b6-b5f5-a15bfac9dea6'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:30:36.539993 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-9fcc53ee-f431-49b6-b5f5-a15bfac9dea6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'de2d1c131e8d4fe096aeb064ff6b28eb', 'request_id': 'req-9fcc53ee-f431-49b6-b5f5-a15bfac9dea6'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:30:36.553057 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-9fcc53ee-f431-49b6-b5f5-a15bfac9dea6 admin admin] The token cache is being invalidate because project de2d1c131e8d4fe096aeb064ff6b28eb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81361) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 02:30:36.553339 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-9fcc53ee-f431-49b6-b5f5-a15bfac9dea6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:30:36.553959 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-9fcc53ee-f431-49b6-b5f5-a15bfac9dea6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:30:36.555466 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 843/1689] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Oct 12 02:30:36 2022] DELETE /identity/v3/projects/de2d1c131e8d4fe096aeb064ff6b28eb => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 02:30:36.560995 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490a30d3-cef3-4f05-a5df-87aefc7f43c9 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:36.561395 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490a30d3-cef3-4f05-a5df-87aefc7f43c9 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:36.561873 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490a30d3-cef3-4f05-a5df-87aefc7f43c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:36.588112 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-490a30d3-cef3-4f05-a5df-87aefc7f43c9 None None] MFA Rules not processed for user `a326a5bb7364479382f528a592371656`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:30:36.589348 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-490a30d3-cef3-4f05-a5df-87aefc7f43c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:30:36.623991 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:30:36.662503 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 847/1690] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 02:30:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 02:30:36.670426 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d38f19-a4e0-43e0-b305-a17158af9933 None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:36.670901 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d38f19-a4e0-43e0-b305-a17158af9933 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:36.671003 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d38f19-a4e0-43e0-b305-a17158af9933 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:36.694671 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-b8d38f19-a4e0-43e0-b305-a17158af9933 None None] MFA Rules not processed for user `a326a5bb7364479382f528a592371656`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:30:36.695872 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-b8d38f19-a4e0-43e0-b305-a17158af9933 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:30:36.704874 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 844/1691] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 02:30:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 02:30:36.709422 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490a30d3-cef3-4f05-a5df-87aefc7f43c9 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:30:36.720086 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490a30d3-cef3-4f05-a5df-87aefc7f43c9 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:30:36.725116 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86ec511-f065-487e-be6c-27751149748b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:30:36.725831 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86ec511-f065-487e-be6c-27751149748b admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:36.726230 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86ec511-f065-487e-be6c-27751149748b admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:36.726563 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86ec511-f065-487e-be6c-27751149748b admin admin] PATH_INFO: `/v3/domains` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:36.727280 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86ec511-f065-487e-be6c-27751149748b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 02:30:36.727644 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86ec511-f065-487e-be6c-27751149748b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:30:36.729314 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86ec511-f065-487e-be6c-27751149748b admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:30:36.741545 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 848/1692] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Oct 12 02:30:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 02:30:36.746194 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d38f19-a4e0-43e0-b305-a17158af9933 None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:30:36.756566 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d38f19-a4e0-43e0-b305-a17158af9933 None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:30:36.761256 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f444b6fb-6c14-4a1a-bcfb-81a9bfe3a594 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:30:36.761845 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f444b6fb-6c14-4a1a-bcfb-81a9bfe3a594 admin admin] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:36.762124 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f444b6fb-6c14-4a1a-bcfb-81a9bfe3a594 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:36.762390 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f444b6fb-6c14-4a1a-bcfb-81a9bfe3a594 admin admin] PATH_INFO: `/v3/projects` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:36.763037 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f444b6fb-6c14-4a1a-bcfb-81a9bfe3a594 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:30:36.765212 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f444b6fb-6c14-4a1a-bcfb-81a9bfe3a594 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:30:36.800549 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 845/1693] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Oct 12 02:30:36 2022] POST /identity/v3/projects => generated 383 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 02:30:36.802032 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86ec511-f065-487e-be6c-27751149748b admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:30:36.812836 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86ec511-f065-487e-be6c-27751149748b admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:30:36.870205 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e438c4f-68fd-4a87-86c8-5f9e58be7b63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:30:36.870814 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e438c4f-68fd-4a87-86c8-5f9e58be7b63 admin admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:36.871090 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e438c4f-68fd-4a87-86c8-5f9e58be7b63 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:36.871356 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e438c4f-68fd-4a87-86c8-5f9e58be7b63 admin admin] PATH_INFO: `/v3/users` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:36.871991 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e438c4f-68fd-4a87-86c8-5f9e58be7b63 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:30:36.874687 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e438c4f-68fd-4a87-86c8-5f9e58be7b63 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:30:36.906108 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 849/1694] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Oct 12 02:30:36 2022] POST /identity/v3/users => generated 292 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 02:30:36.910123 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f444b6fb-6c14-4a1a-bcfb-81a9bfe3a594 admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:30:36.920624 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f444b6fb-6c14-4a1a-bcfb-81a9bfe3a594 admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:30:36.925388 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ccbbd6-d3ea-41a7-8334-97e3ab459104 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:30:36.926078 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ccbbd6-d3ea-41a7-8334-97e3ab459104 admin admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:36.926430 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ccbbd6-d3ea-41a7-8334-97e3ab459104 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:36.926766 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ccbbd6-d3ea-41a7-8334-97e3ab459104 admin admin] PATH_INFO: `/v3/roles` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:36.927475 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ccbbd6-d3ea-41a7-8334-97e3ab459104 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:30:36.929183 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ccbbd6-d3ea-41a7-8334-97e3ab459104 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:30:36.939981 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 846/1695] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Oct 12 02:30:36 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 02:30:36.944029 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e438c4f-68fd-4a87-86c8-5f9e58be7b63 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:30:36.954411 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e438c4f-68fd-4a87-86c8-5f9e58be7b63 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:30:36.959052 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee7d8c4-83ea-4929-b620-149591459e9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:30:36.959657 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee7d8c4-83ea-4929-b620-149591459e9b admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:36.959931 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee7d8c4-83ea-4929-b620-149591459e9b admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:36.960197 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee7d8c4-83ea-4929-b620-149591459e9b admin admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:36.961023 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee7d8c4-83ea-4929-b620-149591459e9b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:30:36.962604 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee7d8c4-83ea-4929-b620-149591459e9b admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:30:36.974044 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 850/1696] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Oct 12 02:30:36 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 02:30:36.978344 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ccbbd6-d3ea-41a7-8334-97e3ab459104 admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:30:36.989018 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ccbbd6-d3ea-41a7-8334-97e3ab459104 admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:30:36.993574 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf23b98d-8bf6-4fea-9f89-f8b7aeeb03cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:30:36.994216 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf23b98d-8bf6-4fea-9f89-f8b7aeeb03cc admin admin] REQUEST_METHOD: `PUT` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:36.994488 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf23b98d-8bf6-4fea-9f89-f8b7aeeb03cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:36.994753 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf23b98d-8bf6-4fea-9f89-f8b7aeeb03cc admin admin] PATH_INFO: `/v3/projects/4ef94de53a124f48aebc558ccb721c7d/users/688074a000ed4c71bf67b7c961906f23/roles/3d75c4d7f1a849b9a771504d1583ab28` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:37.011128 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf23b98d-8bf6-4fea-9f89-f8b7aeeb03cc admin admin] RBAC: Authorizing `identity:create_grant(project_id=4ef94de53a124f48aebc558ccb721c7d, user_id=688074a000ed4c71bf67b7c961906f23, role_id=3d75c4d7f1a849b9a771504d1583ab28)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:30:37.014853 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf23b98d-8bf6-4fea-9f89-f8b7aeeb03cc admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:30:37.028409 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 847/1697] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Oct 12 02:30:36 2022] PUT /identity/v3/projects/4ef94de53a124f48aebc558ccb721c7d/users/688074a000ed4c71bf67b7c961906f23/roles/3d75c4d7f1a849b9a771504d1583ab28 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 02:30:37.038974 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979e339d-ffce-40d2-95aa-b64b3661e3f8 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:37.039272 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979e339d-ffce-40d2-95aa-b64b3661e3f8 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:37.039541 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979e339d-ffce-40d2-95aa-b64b3661e3f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:37.072561 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-979e339d-ffce-40d2-95aa-b64b3661e3f8 None None] MFA Rules not processed for user `688074a000ed4c71bf67b7c961906f23`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:30:37.073841 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-979e339d-ffce-40d2-95aa-b64b3661e3f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:30:37.141129 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 851/1698] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 02:30:37 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 02:30:37.145613 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf23b98d-8bf6-4fea-9f89-f8b7aeeb03cc admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:30:37.231161 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf23b98d-8bf6-4fea-9f89-f8b7aeeb03cc admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:30:37.237757 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5df10a2-eb7a-4704-912c-6f591cb68a25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:30:37.238616 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5df10a2-eb7a-4704-912c-6f591cb68a25 admin admin] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:37.239096 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5df10a2-eb7a-4704-912c-6f591cb68a25 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:37.239365 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5df10a2-eb7a-4704-912c-6f591cb68a25 admin admin] PATH_INFO: `/v3/projects` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:37.240010 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5df10a2-eb7a-4704-912c-6f591cb68a25 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:30:37.242082 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5df10a2-eb7a-4704-912c-6f591cb68a25 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:30:37.277055 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 848/1699] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Oct 12 02:30:37 2022] POST /identity/v3/projects => generated 383 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 02:30:37.281237 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979e339d-ffce-40d2-95aa-b64b3661e3f8 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:30:37.304628 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979e339d-ffce-40d2-95aa-b64b3661e3f8 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:30:37.350196 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:30:37.392761 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b75e20a-fc0a-4944-9f4e-f3193d95d689 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:30:37.393692 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b75e20a-fc0a-4944-9f4e-f3193d95d689 admin admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:37.394164 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b75e20a-fc0a-4944-9f4e-f3193d95d689 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:37.394605 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b75e20a-fc0a-4944-9f4e-f3193d95d689 admin admin] PATH_INFO: `/v3/users` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:37.395514 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b75e20a-fc0a-4944-9f4e-f3193d95d689 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:30:37.398964 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b75e20a-fc0a-4944-9f4e-f3193d95d689 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:30:37.467676 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 852/1700] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Oct 12 02:30:37 2022] POST /identity/v3/users => generated 292 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 02:30:37.471271 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5df10a2-eb7a-4704-912c-6f591cb68a25 admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:30:37.490283 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5df10a2-eb7a-4704-912c-6f591cb68a25 admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:30:37.500489 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fcfb24-bfce-49ef-9d1c-57d22996480c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:30:37.501286 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fcfb24-bfce-49ef-9d1c-57d22996480c admin admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:37.502167 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fcfb24-bfce-49ef-9d1c-57d22996480c admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:37.502538 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fcfb24-bfce-49ef-9d1c-57d22996480c admin admin] PATH_INFO: `/v3/roles` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:37.503410 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21fcfb24-bfce-49ef-9d1c-57d22996480c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:30:37.505322 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21fcfb24-bfce-49ef-9d1c-57d22996480c admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:30:37.526134 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 849/1701] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Oct 12 02:30:37 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 02:30:37.531690 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b75e20a-fc0a-4944-9f4e-f3193d95d689 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:30:37.567407 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b75e20a-fc0a-4944-9f4e-f3193d95d689 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:30:37.574826 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e01655-9f7f-420e-a84d-1b83ce4fef79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:30:37.575653 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e01655-9f7f-420e-a84d-1b83ce4fef79 admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:37.575967 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e01655-9f7f-420e-a84d-1b83ce4fef79 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:37.576264 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e01655-9f7f-420e-a84d-1b83ce4fef79 admin admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:37.577139 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e01655-9f7f-420e-a84d-1b83ce4fef79 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:30:37.579086 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e01655-9f7f-420e-a84d-1b83ce4fef79 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:30:37.609067 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 853/1702] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Oct 12 02:30:37 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 02:30:37.611092 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fcfb24-bfce-49ef-9d1c-57d22996480c admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:30:37.623886 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fcfb24-bfce-49ef-9d1c-57d22996480c admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:30:37.629826 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23cf193-5dca-4804-8c94-791964248666 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:30:37.630657 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23cf193-5dca-4804-8c94-791964248666 admin admin] REQUEST_METHOD: `PUT` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:37.631080 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23cf193-5dca-4804-8c94-791964248666 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:37.631519 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23cf193-5dca-4804-8c94-791964248666 admin admin] PATH_INFO: `/v3/projects/594f4f82f872445db47cb8707e4d558f/users/61de5d3d67d54f189becc39811bc2bd5/roles/3d75c4d7f1a849b9a771504d1583ab28` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:37.652151 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23cf193-5dca-4804-8c94-791964248666 admin admin] RBAC: Authorizing `identity:create_grant(project_id=594f4f82f872445db47cb8707e4d558f, user_id=61de5d3d67d54f189becc39811bc2bd5, role_id=3d75c4d7f1a849b9a771504d1583ab28)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:30:37.666160 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23cf193-5dca-4804-8c94-791964248666 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:30:37.689942 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 850/1703] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Oct 12 02:30:37 2022] PUT /identity/v3/projects/594f4f82f872445db47cb8707e4d558f/users/61de5d3d67d54f189becc39811bc2bd5/roles/3d75c4d7f1a849b9a771504d1583ab28 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 02:30:37.702905 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8b904d-4674-41ef-87b8-0ca0dc2d13e1 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:37.703387 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8b904d-4674-41ef-87b8-0ca0dc2d13e1 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:37.704551 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8b904d-4674-41ef-87b8-0ca0dc2d13e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:37.746094 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-2d8b904d-4674-41ef-87b8-0ca0dc2d13e1 None None] MFA Rules not processed for user `61de5d3d67d54f189becc39811bc2bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:30:37.747639 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-2d8b904d-4674-41ef-87b8-0ca0dc2d13e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:30:37.928236 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 854/1704] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 02:30:37 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 02:30:37.932588 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23cf193-5dca-4804-8c94-791964248666 admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:30:37.950222 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=90,keystone:DELETE=5,keystone:INSERT=5 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:30:38.119940 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23cf193-5dca-4804-8c94-791964248666 admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:30:38.127604 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a9fce0-f88a-4bcd-83f0-82f1d5e39c0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:30:38.128749 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a9fce0-f88a-4bcd-83f0-82f1d5e39c0b admin admin] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:38.129237 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a9fce0-f88a-4bcd-83f0-82f1d5e39c0b admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:38.129704 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a9fce0-f88a-4bcd-83f0-82f1d5e39c0b admin admin] PATH_INFO: `/v3/projects` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:38.131112 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a9fce0-f88a-4bcd-83f0-82f1d5e39c0b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:30:38.133824 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a9fce0-f88a-4bcd-83f0-82f1d5e39c0b admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:30:38.186682 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 851/1705] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Oct 12 02:30:37 2022] POST /identity/v3/projects => generated 385 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 02:30:38.190828 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8b904d-4674-41ef-87b8-0ca0dc2d13e1 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:30:38.207013 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8b904d-4674-41ef-87b8-0ca0dc2d13e1 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:30:38.317655 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee66ce5-11d5-41c4-848b-14bc913fc2a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:30:38.318301 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee66ce5-11d5-41c4-848b-14bc913fc2a7 admin admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:38.318565 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee66ce5-11d5-41c4-848b-14bc913fc2a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:38.318829 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee66ce5-11d5-41c4-848b-14bc913fc2a7 admin admin] PATH_INFO: `/v3/users` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:38.319467 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee66ce5-11d5-41c4-848b-14bc913fc2a7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:30:38.321407 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee66ce5-11d5-41c4-848b-14bc913fc2a7 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:30:38.348683 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 855/1706] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Oct 12 02:30:38 2022] POST /identity/v3/users => generated 299 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 02:30:38.352586 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a9fce0-f88a-4bcd-83f0-82f1d5e39c0b admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:30:38.365142 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a9fce0-f88a-4bcd-83f0-82f1d5e39c0b admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:30:38.370987 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04ec718-8f09-4beb-b860-8981f0a7f18d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:30:38.371574 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04ec718-8f09-4beb-b860-8981f0a7f18d admin admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:38.371908 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04ec718-8f09-4beb-b860-8981f0a7f18d admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:38.372187 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04ec718-8f09-4beb-b860-8981f0a7f18d admin admin] PATH_INFO: `/v3/roles` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:38.373409 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04ec718-8f09-4beb-b860-8981f0a7f18d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:30:38.375025 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04ec718-8f09-4beb-b860-8981f0a7f18d admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:30:38.390301 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 852/1707] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Oct 12 02:30:38 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 12 02:30:38.394226 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee66ce5-11d5-41c4-848b-14bc913fc2a7 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:30:38.407033 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee66ce5-11d5-41c4-848b-14bc913fc2a7 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:30:38.416130 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72db45cb-8382-4d4e-8651-24c5ec4fa527 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:30:38.417693 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72db45cb-8382-4d4e-8651-24c5ec4fa527 admin admin] REQUEST_METHOD: `PUT` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:38.418201 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72db45cb-8382-4d4e-8651-24c5ec4fa527 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:38.419098 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72db45cb-8382-4d4e-8651-24c5ec4fa527 admin admin] PATH_INFO: `/v3/projects/9938805bef994c5da73354fc68fa93d6/users/3bb874e2507a4352b1219063f90419a7/roles/39b1e8108dff402383def3c559f48189` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:38.442263 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72db45cb-8382-4d4e-8651-24c5ec4fa527 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9938805bef994c5da73354fc68fa93d6, user_id=3bb874e2507a4352b1219063f90419a7, role_id=39b1e8108dff402383def3c559f48189)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:30:38.445451 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72db45cb-8382-4d4e-8651-24c5ec4fa527 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:30:38.494713 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 856/1708] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Oct 12 02:30:38 2022] PUT /identity/v3/projects/9938805bef994c5da73354fc68fa93d6/users/3bb874e2507a4352b1219063f90419a7/roles/39b1e8108dff402383def3c559f48189 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 02:30:38.499195 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04ec718-8f09-4beb-b860-8981f0a7f18d admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:30:38.515390 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04ec718-8f09-4beb-b860-8981f0a7f18d admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:30:38.557994 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72db45cb-8382-4d4e-8651-24c5ec4fa527 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:30:38.560098 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-72db45cb-8382-4d4e-8651-24c5ec4fa527 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:30:38.567670 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:30:38.656398 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f627dd-0826-4981-b5f8-21ef87344ccf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:30:38.657129 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f627dd-0826-4981-b5f8-21ef87344ccf admin admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:38.657521 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f627dd-0826-4981-b5f8-21ef87344ccf admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:38.657959 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f627dd-0826-4981-b5f8-21ef87344ccf admin admin] PATH_INFO: `/v3/roles` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:38.658719 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f627dd-0826-4981-b5f8-21ef87344ccf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:30:38.660453 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f627dd-0826-4981-b5f8-21ef87344ccf admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:30:38.678992 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 853/1709] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Oct 12 02:30:38 2022] GET /identity/v3/roles => generated 1420 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 02:30:38.678992 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f627dd-0826-4981-b5f8-21ef87344ccf admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:30:38.696208 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72db45cb-8382-4d4e-8651-24c5ec4fa527 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:30:38.698775 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f627dd-0826-4981-b5f8-21ef87344ccf admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:30:38.702407 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f61ff5-c1db-472d-a14b-244fc9811254 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:30:38.703523 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f61ff5-c1db-472d-a14b-244fc9811254 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:38.704618 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f61ff5-c1db-472d-a14b-244fc9811254 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:38.705062 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f61ff5-c1db-472d-a14b-244fc9811254 admin admin] PATH_INFO: `/v3/users/db355001581d4e9e888456d82f127021` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:38.706449 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f61ff5-c1db-472d-a14b-244fc9811254 admin admin] RBAC: Authorizing `identity:delete_user(user_id=db355001581d4e9e888456d82f127021)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:30:38.708660 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f61ff5-c1db-472d-a14b-244fc9811254 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:30:38.713977 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d0a5cf-f36a-4da5-ad5f-4d0d61294431 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:30:38.714801 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d0a5cf-f36a-4da5-ad5f-4d0d61294431 admin admin] REQUEST_METHOD: `PUT` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:38.715288 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d0a5cf-f36a-4da5-ad5f-4d0d61294431 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:38.715670 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d0a5cf-f36a-4da5-ad5f-4d0d61294431 admin admin] PATH_INFO: `/v3/projects/9938805bef994c5da73354fc68fa93d6/users/3bb874e2507a4352b1219063f90419a7/roles/39b1e8108dff402383def3c559f48189` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:38.723366 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d0a5cf-f36a-4da5-ad5f-4d0d61294431 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9938805bef994c5da73354fc68fa93d6, user_id=3bb874e2507a4352b1219063f90419a7, role_id=39b1e8108dff402383def3c559f48189)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:30:38.726062 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d0a5cf-f36a-4da5-ad5f-4d0d61294431 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:30:38.760555 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 854/1710] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Oct 12 02:30:38 2022] PUT /identity/v3/projects/9938805bef994c5da73354fc68fa93d6/users/3bb874e2507a4352b1219063f90419a7/roles/39b1e8108dff402383def3c559f48189 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 02:30:38.762665 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861ce094-0343-4461-902d-194d5ca871e4 None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:38.763247 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861ce094-0343-4461-902d-194d5ca871e4 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:38.763811 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861ce094-0343-4461-902d-194d5ca871e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:38.806797 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-83f61ff5-c1db-472d-a14b-244fc9811254 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'db355001581d4e9e888456d82f127021'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:30:38.822408 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-861ce094-0343-4461-902d-194d5ca871e4 None None] MFA Rules not processed for user `3bb874e2507a4352b1219063f90419a7`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:30:38.824010 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-861ce094-0343-4461-902d-194d5ca871e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:30:38.827296 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-83f61ff5-c1db-472d-a14b-244fc9811254 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'db355001581d4e9e888456d82f127021'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:30:38.858105 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-83f61ff5-c1db-472d-a14b-244fc9811254 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'db355001581d4e9e888456d82f127021'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:30:38.877610 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-83f61ff5-c1db-472d-a14b-244fc9811254 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'db355001581d4e9e888456d82f127021'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:30:38.882601 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-83f61ff5-c1db-472d-a14b-244fc9811254 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'db355001581d4e9e888456d82f127021'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:30:38.893798 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 857/1711] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Oct 12 02:30:38 2022] DELETE /identity/v3/users/db355001581d4e9e888456d82f127021 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 02:30:38.898404 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24127a4b-9a4c-4332-966c-ec99b451bc02 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:38.898695 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24127a4b-9a4c-4332-966c-ec99b451bc02 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:38.898969 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24127a4b-9a4c-4332-966c-ec99b451bc02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:38.942272 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-24127a4b-9a4c-4332-966c-ec99b451bc02 None None] MFA Rules not processed for user `a326a5bb7364479382f528a592371656`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:30:38.946562 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-24127a4b-9a4c-4332-966c-ec99b451bc02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:30:38.947667 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:30:39.008852 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 855/1712] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 02:30:38 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 02:30:39.021250 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861ce094-0343-4461-902d-194d5ca871e4 None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:30:39.024815 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-861ce094-0343-4461-902d-194d5ca871e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:30:39.216751 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 858/1713] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 02:30:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 319 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 02:30:39.232558 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24127a4b-9a4c-4332-966c-ec99b451bc02 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:30:39.236955 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-24127a4b-9a4c-4332-966c-ec99b451bc02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:30:39.330504 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861ce094-0343-4461-902d-194d5ca871e4 None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:30:39.365574 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:30:39.494282 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24127a4b-9a4c-4332-966c-ec99b451bc02 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:30:39.517468 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001059ee-0e46-42db-9c6e-bbe11b3e3610 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5223b5cab3114e9b9a13c582f8ef8386', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'beb6def6fcad45959e56425bb8bff4d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:30:39.518374 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001059ee-0e46-42db-9c6e-bbe11b3e3610 service neutron] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:39.518726 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001059ee-0e46-42db-9c6e-bbe11b3e3610 service neutron] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:39.520607 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001059ee-0e46-42db-9c6e-bbe11b3e3610 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:39.554211 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c985856-c668-4658-ace0-02af36c92ed1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ba688e0c4d44d13898539ee886f95fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'beb6def6fcad45959e56425bb8bff4d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:30:39.555230 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001059ee-0e46-42db-9c6e-bbe11b3e3610 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:30:39.556001 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c985856-c668-4658-ace0-02af36c92ed1 service cinder] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:39.556354 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c985856-c668-4658-ace0-02af36c92ed1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:39.556741 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c985856-c668-4658-ace0-02af36c92ed1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:39.557296 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001059ee-0e46-42db-9c6e-bbe11b3e3610 service neutron] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:30:39.559281 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-8c985856-c668-4658-ace0-02af36c92ed1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:30:39.585330 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 859/1714] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 02:30:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 02:30:39.663701 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c985856-c668-4658-ace0-02af36c92ed1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:30:39.665815 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c985856-c668-4658-ace0-02af36c92ed1 service cinder] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:30:39.700004 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 856/1715] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 02:30:39 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 678 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 12 02:30:40.433709 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001059ee-0e46-42db-9c6e-bbe11b3e3610 service neutron] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:30:40.435777 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-001059ee-0e46-42db-9c6e-bbe11b3e3610 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:30:40.452179 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001059ee-0e46-42db-9c6e-bbe11b3e3610 service neutron] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:30:40.463952 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eeee9c3-a0d5-4d4f-abea-8060aa451dbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:30:40.465961 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eeee9c3-a0d5-4d4f-abea-8060aa451dbd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:40.467039 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eeee9c3-a0d5-4d4f-abea-8060aa451dbd admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:40.468885 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eeee9c3-a0d5-4d4f-abea-8060aa451dbd admin admin] PATH_INFO: `/v3/projects/00e8e46ac67f44e687a3332bd50b5b9d` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:40.470490 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eeee9c3-a0d5-4d4f-abea-8060aa451dbd admin admin] RBAC: Authorizing `identity:delete_project(project_id=00e8e46ac67f44e687a3332bd50b5b9d)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:30:40.472604 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eeee9c3-a0d5-4d4f-abea-8060aa451dbd admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:30:40.535250 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-0eeee9c3-a0d5-4d4f-abea-8060aa451dbd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '00e8e46ac67f44e687a3332bd50b5b9d', 'request_id': 'req-0eeee9c3-a0d5-4d4f-abea-8060aa451dbd'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:30:40.545882 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-0eeee9c3-a0d5-4d4f-abea-8060aa451dbd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '00e8e46ac67f44e687a3332bd50b5b9d', 'request_id': 'req-0eeee9c3-a0d5-4d4f-abea-8060aa451dbd'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:30:40.553472 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-0eeee9c3-a0d5-4d4f-abea-8060aa451dbd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '00e8e46ac67f44e687a3332bd50b5b9d', 'request_id': 'req-0eeee9c3-a0d5-4d4f-abea-8060aa451dbd'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:30:40.570555 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-0eeee9c3-a0d5-4d4f-abea-8060aa451dbd admin admin] The token cache is being invalidate because project 00e8e46ac67f44e687a3332bd50b5b9d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81362) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 02:30:40.570959 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-0eeee9c3-a0d5-4d4f-abea-8060aa451dbd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:30:40.571803 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-0eeee9c3-a0d5-4d4f-abea-8060aa451dbd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:30:40.576522 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 860/1716] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Oct 12 02:30:40 2022] DELETE /identity/v3/projects/00e8e46ac67f44e687a3332bd50b5b9d => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 02:30:40.577838 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c985856-c668-4658-ace0-02af36c92ed1 service cinder] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:30:40.589260 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c985856-c668-4658-ace0-02af36c92ed1 service cinder] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:30:40.646336 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:30:40.656195 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edbe848-a8b3-487b-9f55-9a955b5a141b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:30:40.657007 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edbe848-a8b3-487b-9f55-9a955b5a141b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:40.657357 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edbe848-a8b3-487b-9f55-9a955b5a141b admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:40.657708 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edbe848-a8b3-487b-9f55-9a955b5a141b admin admin] PATH_INFO: `/v3/users/4f68dadf5bdc463eb5e3b506fceb0058` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:40.658899 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1edbe848-a8b3-487b-9f55-9a955b5a141b admin admin] RBAC: Authorizing `identity:delete_user(user_id=4f68dadf5bdc463eb5e3b506fceb0058)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:30:40.661120 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1edbe848-a8b3-487b-9f55-9a955b5a141b admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:30:40.726067 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-1edbe848-a8b3-487b-9f55-9a955b5a141b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4f68dadf5bdc463eb5e3b506fceb0058'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:30:40.736249 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-1edbe848-a8b3-487b-9f55-9a955b5a141b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4f68dadf5bdc463eb5e3b506fceb0058'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:30:40.752098 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-1edbe848-a8b3-487b-9f55-9a955b5a141b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4f68dadf5bdc463eb5e3b506fceb0058'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:30:40.761869 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-1edbe848-a8b3-487b-9f55-9a955b5a141b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4f68dadf5bdc463eb5e3b506fceb0058'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:30:40.762621 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-1edbe848-a8b3-487b-9f55-9a955b5a141b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4f68dadf5bdc463eb5e3b506fceb0058'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:30:40.787094 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 857/1717] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Oct 12 02:30:40 2022] DELETE /identity/v3/users/4f68dadf5bdc463eb5e3b506fceb0058 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 02:30:40.989016 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eeee9c3-a0d5-4d4f-abea-8060aa451dbd admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:30:40.991443 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-0eeee9c3-a0d5-4d4f-abea-8060aa451dbd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:30:41.024075 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eeee9c3-a0d5-4d4f-abea-8060aa451dbd admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:30:41.098969 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26402b3-d78d-4176-b869-a1dca2a09a80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:30:41.100159 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26402b3-d78d-4176-b869-a1dca2a09a80 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:41.100159 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26402b3-d78d-4176-b869-a1dca2a09a80 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:41.100159 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26402b3-d78d-4176-b869-a1dca2a09a80 admin admin] PATH_INFO: `/v3/users/b537eebca10040d99e18841963da2505` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:41.101639 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26402b3-d78d-4176-b869-a1dca2a09a80 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b537eebca10040d99e18841963da2505)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:30:41.103969 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26402b3-d78d-4176-b869-a1dca2a09a80 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:30:41.198294 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edbe848-a8b3-487b-9f55-9a955b5a141b admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:30:41.200126 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-1edbe848-a8b3-487b-9f55-9a955b5a141b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:30:41.204353 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-e26402b3-d78d-4176-b869-a1dca2a09a80 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b537eebca10040d99e18841963da2505'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:30:41.226413 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edbe848-a8b3-487b-9f55-9a955b5a141b admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:30:41.227503 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:30:41.236594 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbcdde1-2ae6-49fe-8b8d-47bf3e1f2bc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:30:41.237316 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbcdde1-2ae6-49fe-8b8d-47bf3e1f2bc0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:41.237702 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbcdde1-2ae6-49fe-8b8d-47bf3e1f2bc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:41.238061 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbcdde1-2ae6-49fe-8b8d-47bf3e1f2bc0 admin admin] PATH_INFO: `/v3/projects/0b60354a2ba74f078678864aae64a6e1` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:41.239279 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbcdde1-2ae6-49fe-8b8d-47bf3e1f2bc0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0b60354a2ba74f078678864aae64a6e1)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:30:41.241698 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbcdde1-2ae6-49fe-8b8d-47bf3e1f2bc0 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:30:41.250429 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-e26402b3-d78d-4176-b869-a1dca2a09a80 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b537eebca10040d99e18841963da2505'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:30:41.301931 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-e26402b3-d78d-4176-b869-a1dca2a09a80 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b537eebca10040d99e18841963da2505'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:30:41.321393 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-0fbcdde1-2ae6-49fe-8b8d-47bf3e1f2bc0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0b60354a2ba74f078678864aae64a6e1', 'request_id': 'req-0fbcdde1-2ae6-49fe-8b8d-47bf3e1f2bc0'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:30:41.333043 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-0fbcdde1-2ae6-49fe-8b8d-47bf3e1f2bc0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0b60354a2ba74f078678864aae64a6e1', 'request_id': 'req-0fbcdde1-2ae6-49fe-8b8d-47bf3e1f2bc0'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:30:41.340384 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-0fbcdde1-2ae6-49fe-8b8d-47bf3e1f2bc0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0b60354a2ba74f078678864aae64a6e1', 'request_id': 'req-0fbcdde1-2ae6-49fe-8b8d-47bf3e1f2bc0'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:30:41.342193 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-e26402b3-d78d-4176-b869-a1dca2a09a80 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b537eebca10040d99e18841963da2505'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:30:41.344684 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-e26402b3-d78d-4176-b869-a1dca2a09a80 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b537eebca10040d99e18841963da2505'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:30:41.352187 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 861/1718] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Oct 12 02:30:40 2022] DELETE /identity/v3/users/b537eebca10040d99e18841963da2505 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 02:30:41.356371 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd53f91-91e2-4f01-9a66-f1a9d04c59ae None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:41.357628 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd53f91-91e2-4f01-9a66-f1a9d04c59ae None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:41.357926 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd53f91-91e2-4f01-9a66-f1a9d04c59ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:41.380062 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-2cd53f91-91e2-4f01-9a66-f1a9d04c59ae None None] MFA Rules not processed for user `a326a5bb7364479382f528a592371656`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:30:41.381578 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-2cd53f91-91e2-4f01-9a66-f1a9d04c59ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:30:41.393241 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-0fbcdde1-2ae6-49fe-8b8d-47bf3e1f2bc0 admin admin] The token cache is being invalidate because project 0b60354a2ba74f078678864aae64a6e1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81361) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 02:30:41.393604 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-0fbcdde1-2ae6-49fe-8b8d-47bf3e1f2bc0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:30:41.400582 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-0fbcdde1-2ae6-49fe-8b8d-47bf3e1f2bc0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:30:41.408182 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 858/1719] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Oct 12 02:30:41 2022] DELETE /identity/v3/projects/0b60354a2ba74f078678864aae64a6e1 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 02:30:41.414823 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971f91f9-209f-44e2-8c18-d7b60db62ab8 None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:41.415107 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971f91f9-209f-44e2-8c18-d7b60db62ab8 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:41.415378 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971f91f9-209f-44e2-8c18-d7b60db62ab8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:41.456684 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 862/1720] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 02:30:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 02:30:41.469753 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-971f91f9-209f-44e2-8c18-d7b60db62ab8 None None] MFA Rules not processed for user `a326a5bb7364479382f528a592371656`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:30:41.478375 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-971f91f9-209f-44e2-8c18-d7b60db62ab8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:30:41.495229 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd53f91-91e2-4f01-9a66-f1a9d04c59ae None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:30:41.497982 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-2cd53f91-91e2-4f01-9a66-f1a9d04c59ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:30:41.511644 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 859/1721] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 02:30:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 02:30:41.522807 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adb4533-bae4-4402-910e-672bb8e3e218 None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:41.523133 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adb4533-bae4-4402-910e-672bb8e3e218 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:41.523352 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adb4533-bae4-4402-910e-672bb8e3e218 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:41.567927 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-2adb4533-bae4-4402-910e-672bb8e3e218 None None] MFA Rules not processed for user `a326a5bb7364479382f528a592371656`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:30:41.569221 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-2adb4533-bae4-4402-910e-672bb8e3e218 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:30:41.580916 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 860/1722] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 02:30:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 02:30:41.584962 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2adb4533-bae4-4402-910e-672bb8e3e218 None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:30:41.628059 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2adb4533-bae4-4402-910e-672bb8e3e218 None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:30:41.652973 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07967cd-a76a-4333-a3bc-fe0272eca2c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:30:41.652973 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07967cd-a76a-4333-a3bc-fe0272eca2c6 admin admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:41.652973 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07967cd-a76a-4333-a3bc-fe0272eca2c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:41.652973 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07967cd-a76a-4333-a3bc-fe0272eca2c6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:41.653509 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07967cd-a76a-4333-a3bc-fe0272eca2c6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 02:30:41.653847 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07967cd-a76a-4333-a3bc-fe0272eca2c6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:30:41.655450 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07967cd-a76a-4333-a3bc-fe0272eca2c6 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:30:41.663156 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd53f91-91e2-4f01-9a66-f1a9d04c59ae None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:30:41.669708 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 861/1723] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Oct 12 02:30:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 02:30:41.672235 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6650e7b5-0ecd-4530-8ce2-5ceb291d4037 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5223b5cab3114e9b9a13c582f8ef8386', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'beb6def6fcad45959e56425bb8bff4d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:30:41.672955 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6650e7b5-0ecd-4530-8ce2-5ceb291d4037 service neutron] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:41.673285 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6650e7b5-0ecd-4530-8ce2-5ceb291d4037 service neutron] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:41.673557 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6650e7b5-0ecd-4530-8ce2-5ceb291d4037 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:41.674932 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07967cd-a76a-4333-a3bc-fe0272eca2c6 admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:30:41.688115 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07967cd-a76a-4333-a3bc-fe0272eca2c6 admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:30:41.690195 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6650e7b5-0ecd-4530-8ce2-5ceb291d4037 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:30:41.691615 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6650e7b5-0ecd-4530-8ce2-5ceb291d4037 service neutron] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:30:41.693031 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0d8d35-6455-47fe-bee8-5ed1112ff49f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:30:41.693633 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0d8d35-6455-47fe-bee8-5ed1112ff49f admin admin] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:41.693908 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0d8d35-6455-47fe-bee8-5ed1112ff49f admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:41.694178 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0d8d35-6455-47fe-bee8-5ed1112ff49f admin admin] PATH_INFO: `/v3/projects` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:41.695102 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0d8d35-6455-47fe-bee8-5ed1112ff49f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:30:41.701368 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0d8d35-6455-47fe-bee8-5ed1112ff49f admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:30:41.715200 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 863/1724] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 02:30:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 02:30:41.718541 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6650e7b5-0ecd-4530-8ce2-5ceb291d4037 service neutron] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:30:41.725652 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-6650e7b5-0ecd-4530-8ce2-5ceb291d4037 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:30:41.734915 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 862/1725] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Oct 12 02:30:41 2022] POST /identity/v3/projects => generated 377 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 02:30:41.739855 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0d8d35-6455-47fe-bee8-5ed1112ff49f admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:30:41.759786 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=80,keystone:DELETE=17,keystone:INSERT=3 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:30:41.812609 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6650e7b5-0ecd-4530-8ce2-5ceb291d4037 service neutron] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:30:41.824073 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0d8d35-6455-47fe-bee8-5ed1112ff49f admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:30:41.831088 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b59f92-bcfe-4a06-9b67-64b12e3f76fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:30:41.831790 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b59f92-bcfe-4a06-9b67-64b12e3f76fe admin admin] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:41.832336 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b59f92-bcfe-4a06-9b67-64b12e3f76fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:41.833059 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b59f92-bcfe-4a06-9b67-64b12e3f76fe admin admin] PATH_INFO: `/v3/users` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:41.833795 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b59f92-bcfe-4a06-9b67-64b12e3f76fe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:30:41.836497 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b59f92-bcfe-4a06-9b67-64b12e3f76fe admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:30:41.842234 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:DELETE=3,keystone:SELECT=97 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:30:41.871362 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 863/1726] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Oct 12 02:30:41 2022] POST /identity/v3/users => generated 289 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 02:30:41.873934 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b59f92-bcfe-4a06-9b67-64b12e3f76fe admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:30:41.896394 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b59f92-bcfe-4a06-9b67-64b12e3f76fe admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:30:41.904536 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010e4ddd-6064-48cc-88b6-9a822d868e05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:30:41.906294 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010e4ddd-6064-48cc-88b6-9a822d868e05 admin admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:41.906693 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32dd3f8b-7f6a-49e8-a92e-5bf59f9ac737 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ba688e0c4d44d13898539ee886f95fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'beb6def6fcad45959e56425bb8bff4d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:30:41.907187 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010e4ddd-6064-48cc-88b6-9a822d868e05 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:41.907302 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32dd3f8b-7f6a-49e8-a92e-5bf59f9ac737 service cinder] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:41.907583 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32dd3f8b-7f6a-49e8-a92e-5bf59f9ac737 service cinder] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:41.907693 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010e4ddd-6064-48cc-88b6-9a822d868e05 admin admin] PATH_INFO: `/v3/roles` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:41.907852 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32dd3f8b-7f6a-49e8-a92e-5bf59f9ac737 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:41.908533 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010e4ddd-6064-48cc-88b6-9a822d868e05 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:30:41.910281 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010e4ddd-6064-48cc-88b6-9a822d868e05 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:30:41.914709 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-32dd3f8b-7f6a-49e8-a92e-5bf59f9ac737 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:30:41.924565 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 864/1727] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Oct 12 02:30:41 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 02:30:41.927419 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010e4ddd-6064-48cc-88b6-9a822d868e05 admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:30:41.939542 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010e4ddd-6064-48cc-88b6-9a822d868e05 admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:30:41.947329 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e90e1e7-5315-4e87-9c22-b4d92ed8d551 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:30:41.947947 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e90e1e7-5315-4e87-9c22-b4d92ed8d551 admin admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:41.948225 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e90e1e7-5315-4e87-9c22-b4d92ed8d551 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:41.948525 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e90e1e7-5315-4e87-9c22-b4d92ed8d551 admin admin] PATH_INFO: `/v3/roles` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:41.949184 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e90e1e7-5315-4e87-9c22-b4d92ed8d551 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:30:41.951074 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e90e1e7-5315-4e87-9c22-b4d92ed8d551 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:30:41.970011 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 865/1728] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Oct 12 02:30:41 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 02:30:41.975675 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85eca79f-121b-4a9b-8dbf-135f126a130d None None] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:41.975675 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85eca79f-121b-4a9b-8dbf-135f126a130d None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:41.975675 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85eca79f-121b-4a9b-8dbf-135f126a130d None None] PATH_INFO: `/` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:41.976817 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 866/1729] 10.222.0.18 () {54 vars in 921 bytes} [Wed Oct 12 02:30:41 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 02:30:41.976923 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85eca79f-121b-4a9b-8dbf-135f126a130d None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:30:41.992167 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85eca79f-121b-4a9b-8dbf-135f126a130d None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:30:41.998765 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b01bbd7-0d4b-4b4b-ae14-f4abad9ca629 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:30:41.999431 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b01bbd7-0d4b-4b4b-ae14-f4abad9ca629 admin admin] REQUEST_METHOD: `PUT` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:42.000870 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b01bbd7-0d4b-4b4b-ae14-f4abad9ca629 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:42.001683 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b01bbd7-0d4b-4b4b-ae14-f4abad9ca629 admin admin] PATH_INFO: `/v3/projects/171ced871cd348b5a4cc7577c765bbdd/users/d2e5887c9242421e817fb1c3a306a3d7/roles/3d75c4d7f1a849b9a771504d1583ab28` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:42.020774 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32dd3f8b-7f6a-49e8-a92e-5bf59f9ac737 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:30:42.022574 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32dd3f8b-7f6a-49e8-a92e-5bf59f9ac737 service cinder] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:30:42.023830 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b01bbd7-0d4b-4b4b-ae14-f4abad9ca629 admin admin] RBAC: Authorizing `identity:create_grant(project_id=171ced871cd348b5a4cc7577c765bbdd, user_id=d2e5887c9242421e817fb1c3a306a3d7, role_id=3d75c4d7f1a849b9a771504d1583ab28)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:30:42.029157 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b01bbd7-0d4b-4b4b-ae14-f4abad9ca629 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:30:42.035391 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 864/1730] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 02:30:41 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 02:30:42.048450 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a01846c-5fa6-48d6-b477-f4eeb4f990b3 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:42.049434 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a01846c-5fa6-48d6-b477-f4eeb4f990b3 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:42.050126 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a01846c-5fa6-48d6-b477-f4eeb4f990b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:42.059581 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 867/1731] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Oct 12 02:30:41 2022] PUT /identity/v3/projects/171ced871cd348b5a4cc7577c765bbdd/users/d2e5887c9242421e817fb1c3a306a3d7/roles/3d75c4d7f1a849b9a771504d1583ab28 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 02:30:42.070575 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6d5ab7-b38c-4879-a613-02b5348c4c17 None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:42.071161 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6d5ab7-b38c-4879-a613-02b5348c4c17 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:42.071436 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6d5ab7-b38c-4879-a613-02b5348c4c17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:42.110723 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-2a01846c-5fa6-48d6-b477-f4eeb4f990b3 None None] MFA Rules not processed for user `a58b9e0467c040638c3d43e3ac9c0495`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:30:42.112854 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-2a01846c-5fa6-48d6-b477-f4eeb4f990b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:30:42.114153 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-1f6d5ab7-b38c-4879-a613-02b5348c4c17 None None] MFA Rules not processed for user `d2e5887c9242421e817fb1c3a306a3d7`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:30:42.116009 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-1f6d5ab7-b38c-4879-a613-02b5348c4c17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:30:42.213465 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 865/1732] 10.222.0.18 () {58 vars in 1018 bytes} [Wed Oct 12 02:30:42 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 02:30:42.214075 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a01846c-5fa6-48d6-b477-f4eeb4f990b3 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:30:42.215573 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-2a01846c-5fa6-48d6-b477-f4eeb4f990b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:30:42.235544 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 868/1733] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 02:30:42 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 02:30:42.236603 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6d5ab7-b38c-4879-a613-02b5348c4c17 None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:30:42.238100 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-1f6d5ab7-b38c-4879-a613-02b5348c4c17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:30:42.289434 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:30:42.302115 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a01846c-5fa6-48d6-b477-f4eeb4f990b3 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:30:42.306963 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30055ac4-495a-4572-9a85-9d374c36814a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:30:42.307562 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30055ac4-495a-4572-9a85-9d374c36814a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:42.307847 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30055ac4-495a-4572-9a85-9d374c36814a admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:42.308142 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30055ac4-495a-4572-9a85-9d374c36814a admin admin] PATH_INFO: `/v3/users/ea459e1bb9a543d5aa41f288ab49c7da` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:42.310060 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30055ac4-495a-4572-9a85-9d374c36814a admin admin] RBAC: Authorizing `identity:delete_user(user_id=ea459e1bb9a543d5aa41f288ab49c7da)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:30:42.311421 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30055ac4-495a-4572-9a85-9d374c36814a admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:30:42.315002 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6d5ab7-b38c-4879-a613-02b5348c4c17 None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:30:42.320094 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406f737a-940f-4d88-bb04-36b9db485fa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:30:42.320862 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406f737a-940f-4d88-bb04-36b9db485fa7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:42.321100 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406f737a-940f-4d88-bb04-36b9db485fa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:42.321369 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406f737a-940f-4d88-bb04-36b9db485fa7 admin admin] PATH_INFO: `/v3/projects/23e234f9ed4244dba13f90f21e5edf50` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:42.322498 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406f737a-940f-4d88-bb04-36b9db485fa7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=23e234f9ed4244dba13f90f21e5edf50)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:30:42.324449 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406f737a-940f-4d88-bb04-36b9db485fa7 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:30:42.338420 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:30:42.373775 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-30055ac4-495a-4572-9a85-9d374c36814a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ea459e1bb9a543d5aa41f288ab49c7da'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:30:42.377640 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-406f737a-940f-4d88-bb04-36b9db485fa7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '23e234f9ed4244dba13f90f21e5edf50', 'request_id': 'req-406f737a-940f-4d88-bb04-36b9db485fa7'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:30:42.385058 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-30055ac4-495a-4572-9a85-9d374c36814a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ea459e1bb9a543d5aa41f288ab49c7da'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:30:42.385255 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-406f737a-940f-4d88-bb04-36b9db485fa7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '23e234f9ed4244dba13f90f21e5edf50', 'request_id': 'req-406f737a-940f-4d88-bb04-36b9db485fa7'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:30:42.394003 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-406f737a-940f-4d88-bb04-36b9db485fa7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '23e234f9ed4244dba13f90f21e5edf50', 'request_id': 'req-406f737a-940f-4d88-bb04-36b9db485fa7'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:30:42.398326 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-30055ac4-495a-4572-9a85-9d374c36814a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ea459e1bb9a543d5aa41f288ab49c7da'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:30:42.410671 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-406f737a-940f-4d88-bb04-36b9db485fa7 admin admin] The token cache is being invalidate because project 23e234f9ed4244dba13f90f21e5edf50 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81361) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 02:30:42.411216 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-406f737a-940f-4d88-bb04-36b9db485fa7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:30:42.411692 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-30055ac4-495a-4572-9a85-9d374c36814a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ea459e1bb9a543d5aa41f288ab49c7da'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:30:42.412083 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-406f737a-940f-4d88-bb04-36b9db485fa7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:30:42.412388 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-30055ac4-495a-4572-9a85-9d374c36814a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ea459e1bb9a543d5aa41f288ab49c7da'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:30:42.414405 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 869/1734] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Oct 12 02:30:42 2022] DELETE /identity/v3/projects/23e234f9ed4244dba13f90f21e5edf50 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 02:30:42.415356 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406f737a-940f-4d88-bb04-36b9db485fa7 admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:30:42.416751 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-406f737a-940f-4d88-bb04-36b9db485fa7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:30:42.423046 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 866/1735] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Oct 12 02:30:42 2022] DELETE /identity/v3/users/ea459e1bb9a543d5aa41f288ab49c7da => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 02:30:42.424140 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30055ac4-495a-4572-9a85-9d374c36814a admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:30:42.425387 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-30055ac4-495a-4572-9a85-9d374c36814a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:30:42.507463 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406f737a-940f-4d88-bb04-36b9db485fa7 admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:30:42.514762 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30055ac4-495a-4572-9a85-9d374c36814a admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:30:42.520782 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361116e0-cfa2-4496-8729-c820bcc082a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:30:42.522075 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361116e0-cfa2-4496-8729-c820bcc082a1 admin admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:42.528509 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361116e0-cfa2-4496-8729-c820bcc082a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:42.528509 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361116e0-cfa2-4496-8729-c820bcc082a1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:42.528509 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361116e0-cfa2-4496-8729-c820bcc082a1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:30:42.528509 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361116e0-cfa2-4496-8729-c820bcc082a1 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:30:42.570985 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 867/1736] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Oct 12 02:30:42 2022] POST /identity/v3/projects => generated 379 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 02:30:42.570985 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361116e0-cfa2-4496-8729-c820bcc082a1 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:30:42.572819 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-361116e0-cfa2-4496-8729-c820bcc082a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:30:42.604306 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957b8ee9-f868-4285-af6f-5c0c44d9c6ad service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a58b9e0467c040638c3d43e3ac9c0495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'beb6def6fcad45959e56425bb8bff4d1', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:30:42.605596 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957b8ee9-f868-4285-af6f-5c0c44d9c6ad service placement] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:42.606174 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957b8ee9-f868-4285-af6f-5c0c44d9c6ad service placement] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:42.606580 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957b8ee9-f868-4285-af6f-5c0c44d9c6ad service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:42.610110 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-957b8ee9-f868-4285-af6f-5c0c44d9c6ad service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:30:42.628112 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957b8ee9-f868-4285-af6f-5c0c44d9c6ad service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:30:42.637226 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957b8ee9-f868-4285-af6f-5c0c44d9c6ad service placement] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:30:42.656236 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 870/1737] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 02:30:42 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 02:30:42.658703 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957b8ee9-f868-4285-af6f-5c0c44d9c6ad service placement] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:30:42.669989 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-957b8ee9-f868-4285-af6f-5c0c44d9c6ad service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:30:42.697547 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361116e0-cfa2-4496-8729-c820bcc082a1 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:30:42.704575 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242dfb3b-a887-4c6b-80f6-4ec33e7d75a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:30:42.705376 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242dfb3b-a887-4c6b-80f6-4ec33e7d75a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:42.705658 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242dfb3b-a887-4c6b-80f6-4ec33e7d75a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:42.705928 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242dfb3b-a887-4c6b-80f6-4ec33e7d75a7 admin admin] PATH_INFO: `/v3/users/f1274e1d91784dd9b0f16de7cd18f61a` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:42.707320 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242dfb3b-a887-4c6b-80f6-4ec33e7d75a7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f1274e1d91784dd9b0f16de7cd18f61a)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:30:42.709484 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242dfb3b-a887-4c6b-80f6-4ec33e7d75a7 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:30:42.737095 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:30:42.740425 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:DELETE=12,keystone:SELECT=86,keystone:INSERT=2 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:30:42.751316 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957b8ee9-f868-4285-af6f-5c0c44d9c6ad service placement] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:30:42.762037 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2690e0a-d06b-47f1-b4a4-13107b59223f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:30:42.762747 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2690e0a-d06b-47f1-b4a4-13107b59223f admin admin] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:42.763243 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2690e0a-d06b-47f1-b4a4-13107b59223f admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:42.764340 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2690e0a-d06b-47f1-b4a4-13107b59223f admin admin] PATH_INFO: `/v3/users` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:42.765272 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2690e0a-d06b-47f1-b4a4-13107b59223f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:30:42.767444 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2690e0a-d06b-47f1-b4a4-13107b59223f admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:30:42.790863 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-242dfb3b-a887-4c6b-80f6-4ec33e7d75a7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f1274e1d91784dd9b0f16de7cd18f61a'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:30:42.800778 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-242dfb3b-a887-4c6b-80f6-4ec33e7d75a7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f1274e1d91784dd9b0f16de7cd18f61a'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:30:42.804225 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 871/1738] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Oct 12 02:30:42 2022] POST /identity/v3/users => generated 296 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 02:30:42.804225 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2690e0a-d06b-47f1-b4a4-13107b59223f admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:30:42.804529 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-b2690e0a-d06b-47f1-b4a4-13107b59223f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:30:42.815819 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-242dfb3b-a887-4c6b-80f6-4ec33e7d75a7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f1274e1d91784dd9b0f16de7cd18f61a'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:30:42.817151 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2690e0a-d06b-47f1-b4a4-13107b59223f admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:30:42.822225 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c246f767-e0f4-4737-b445-0d698a722f94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:30:42.822983 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c246f767-e0f4-4737-b445-0d698a722f94 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:42.823319 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c246f767-e0f4-4737-b445-0d698a722f94 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:42.823653 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c246f767-e0f4-4737-b445-0d698a722f94 admin admin] PATH_INFO: `/v3/projects/67fa408f8459449cad4d87b5209ba810` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:42.824430 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-242dfb3b-a887-4c6b-80f6-4ec33e7d75a7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f1274e1d91784dd9b0f16de7cd18f61a'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:30:42.824809 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-242dfb3b-a887-4c6b-80f6-4ec33e7d75a7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f1274e1d91784dd9b0f16de7cd18f61a'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:30:42.824981 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c246f767-e0f4-4737-b445-0d698a722f94 admin admin] RBAC: Authorizing `identity:delete_project(project_id=67fa408f8459449cad4d87b5209ba810)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:30:42.826985 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c246f767-e0f4-4737-b445-0d698a722f94 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:30:42.834134 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 868/1739] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Oct 12 02:30:42 2022] DELETE /identity/v3/users/f1274e1d91784dd9b0f16de7cd18f61a => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 02:30:42.834300 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242dfb3b-a887-4c6b-80f6-4ec33e7d75a7 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:30:42.842443 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-242dfb3b-a887-4c6b-80f6-4ec33e7d75a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:30:42.892150 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-c246f767-e0f4-4737-b445-0d698a722f94 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '67fa408f8459449cad4d87b5209ba810', 'request_id': 'req-c246f767-e0f4-4737-b445-0d698a722f94'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:30:42.898949 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-c246f767-e0f4-4737-b445-0d698a722f94 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '67fa408f8459449cad4d87b5209ba810', 'request_id': 'req-c246f767-e0f4-4737-b445-0d698a722f94'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:30:42.910243 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-c246f767-e0f4-4737-b445-0d698a722f94 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '67fa408f8459449cad4d87b5209ba810', 'request_id': 'req-c246f767-e0f4-4737-b445-0d698a722f94'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:30:42.922569 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242dfb3b-a887-4c6b-80f6-4ec33e7d75a7 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:30:42.924957 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-c246f767-e0f4-4737-b445-0d698a722f94 admin admin] The token cache is being invalidate because project 67fa408f8459449cad4d87b5209ba810 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81361) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 02:30:42.925395 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-c246f767-e0f4-4737-b445-0d698a722f94 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:30:42.926030 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-c246f767-e0f4-4737-b445-0d698a722f94 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:30:42.931045 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 872/1740] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Oct 12 02:30:42 2022] DELETE /identity/v3/projects/67fa408f8459449cad4d87b5209ba810 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 02:30:42.931045 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c246f767-e0f4-4737-b445-0d698a722f94 admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:30:42.932357 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-c246f767-e0f4-4737-b445-0d698a722f94 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:30:42.981088 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5c18b5-87a3-4f08-8837-ead83ba9416c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ba688e0c4d44d13898539ee886f95fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'beb6def6fcad45959e56425bb8bff4d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:30:42.982462 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5c18b5-87a3-4f08-8837-ead83ba9416c service cinder] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:42.983050 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5c18b5-87a3-4f08-8837-ead83ba9416c service cinder] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:42.983161 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5c18b5-87a3-4f08-8837-ead83ba9416c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:42.985474 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-4a5c18b5-87a3-4f08-8837-ead83ba9416c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:30:43.012033 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c246f767-e0f4-4737-b445-0d698a722f94 admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:30:43.021036 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10bc1f5-f3c1-442b-bdb6-6c8f1a829a34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:30:43.021659 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10bc1f5-f3c1-442b-bdb6-6c8f1a829a34 admin admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:43.022091 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10bc1f5-f3c1-442b-bdb6-6c8f1a829a34 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:43.022350 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10bc1f5-f3c1-442b-bdb6-6c8f1a829a34 admin admin] PATH_INFO: `/v3/roles` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:43.023003 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10bc1f5-f3c1-442b-bdb6-6c8f1a829a34 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:30:43.024639 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10bc1f5-f3c1-442b-bdb6-6c8f1a829a34 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:30:43.035534 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 873/1741] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Oct 12 02:30:42 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 02:30:43.035534 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d1f46f-898b-471c-a4f5-12a43b09835a None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:43.035534 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d1f46f-898b-471c-a4f5-12a43b09835a None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:43.035534 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d1f46f-898b-471c-a4f5-12a43b09835a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:43.060697 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-48d1f46f-898b-471c-a4f5-12a43b09835a None None] MFA Rules not processed for user `a326a5bb7364479382f528a592371656`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:30:43.062011 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-48d1f46f-898b-471c-a4f5-12a43b09835a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:30:43.065642 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5c18b5-87a3-4f08-8837-ead83ba9416c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:30:43.067181 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5c18b5-87a3-4f08-8837-ead83ba9416c service cinder] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:30:43.071038 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 874/1742] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 02:30:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 02:30:43.071632 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d1f46f-898b-471c-a4f5-12a43b09835a None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:30:43.080993 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 869/1743] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 02:30:42 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 247 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 02:30:43.082625 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4c7d19-3e7c-4451-9c16-171eb2fcdc0a None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:43.083053 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4c7d19-3e7c-4451-9c16-171eb2fcdc0a None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:43.083433 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4c7d19-3e7c-4451-9c16-171eb2fcdc0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:43.090175 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d1f46f-898b-471c-a4f5-12a43b09835a None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:30:43.099731 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:30:43.103283 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b53a13-4b76-4c46-af6e-68832133cada admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:30:43.104682 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b53a13-4b76-4c46-af6e-68832133cada admin admin] REQUEST_METHOD: `PUT` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:43.107746 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b53a13-4b76-4c46-af6e-68832133cada admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:43.108385 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b53a13-4b76-4c46-af6e-68832133cada admin admin] PATH_INFO: `/v3/projects/dd625efb94404eeeabace779cc0853f3/users/c8ef4ee6d7a94f488bf5b8373449d15d/roles/39b1e8108dff402383def3c559f48189` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:43.109640 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-ab4c7d19-3e7c-4451-9c16-171eb2fcdc0a None None] MFA Rules not processed for user `a326a5bb7364479382f528a592371656`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:30:43.112167 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-ab4c7d19-3e7c-4451-9c16-171eb2fcdc0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:30:43.126968 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 870/1744] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 02:30:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 02:30:43.132496 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4c7d19-3e7c-4451-9c16-171eb2fcdc0a None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:30:43.136770 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b53a13-4b76-4c46-af6e-68832133cada admin admin] RBAC: Authorizing `identity:create_grant(project_id=dd625efb94404eeeabace779cc0853f3, user_id=c8ef4ee6d7a94f488bf5b8373449d15d, role_id=39b1e8108dff402383def3c559f48189)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:30:43.140288 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b53a13-4b76-4c46-af6e-68832133cada admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:30:43.149334 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4c7d19-3e7c-4451-9c16-171eb2fcdc0a None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:30:43.164937 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 875/1745] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Oct 12 02:30:43 2022] PUT /identity/v3/projects/dd625efb94404eeeabace779cc0853f3/users/c8ef4ee6d7a94f488bf5b8373449d15d/roles/39b1e8108dff402383def3c559f48189 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 02:30:43.170041 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b53a13-4b76-4c46-af6e-68832133cada admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:30:43.227247 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:30:43.239632 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2663748-7593-4325-9ae0-7e54340dced7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:30:43.240253 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2663748-7593-4325-9ae0-7e54340dced7 admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:43.240558 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2663748-7593-4325-9ae0-7e54340dced7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:43.240829 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2663748-7593-4325-9ae0-7e54340dced7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:43.241578 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2663748-7593-4325-9ae0-7e54340dced7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 02:30:43.241885 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2663748-7593-4325-9ae0-7e54340dced7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:30:43.243591 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2663748-7593-4325-9ae0-7e54340dced7 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:30:43.256725 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 871/1746] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Oct 12 02:30:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 02:30:43.257631 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2663748-7593-4325-9ae0-7e54340dced7 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:30:43.259660 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-e2663748-7593-4325-9ae0-7e54340dced7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:30:43.262523 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b53a13-4b76-4c46-af6e-68832133cada admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:30:43.271152 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5730d46a-b874-4463-ab63-875eecdd767a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:30:43.271704 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5730d46a-b874-4463-ab63-875eecdd767a admin admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:43.271977 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5730d46a-b874-4463-ab63-875eecdd767a admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:43.272243 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5730d46a-b874-4463-ab63-875eecdd767a admin admin] PATH_INFO: `/v3/roles` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:43.272924 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5730d46a-b874-4463-ab63-875eecdd767a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:30:43.274427 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2663748-7593-4325-9ae0-7e54340dced7 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:30:43.274622 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5730d46a-b874-4463-ab63-875eecdd767a admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:30:43.280020 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10946ce-3dd6-4a98-b729-c0af15020474 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:30:43.280677 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10946ce-3dd6-4a98-b729-c0af15020474 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:43.280955 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10946ce-3dd6-4a98-b729-c0af15020474 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:43.281227 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10946ce-3dd6-4a98-b729-c0af15020474 admin admin] PATH_INFO: `/v3/projects/3b2d6f22389b457bba0795cfb0d46d7f` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:43.282333 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10946ce-3dd6-4a98-b729-c0af15020474 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3b2d6f22389b457bba0795cfb0d46d7f)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:30:43.284232 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10946ce-3dd6-4a98-b729-c0af15020474 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:30:43.287824 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 876/1747] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Oct 12 02:30:43 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 02:30:43.288799 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5730d46a-b874-4463-ab63-875eecdd767a admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:30:43.299162 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5730d46a-b874-4463-ab63-875eecdd767a admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:30:43.303700 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b94ef4-690c-485d-a4aa-088bb580cd48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:30:43.304296 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b94ef4-690c-485d-a4aa-088bb580cd48 admin admin] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:43.304597 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b94ef4-690c-485d-a4aa-088bb580cd48 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:43.304872 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b94ef4-690c-485d-a4aa-088bb580cd48 admin admin] PATH_INFO: `/v3/projects` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:43.305563 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b94ef4-690c-485d-a4aa-088bb580cd48 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:30:43.307515 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b94ef4-690c-485d-a4aa-088bb580cd48 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:30:43.333612 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-e10946ce-3dd6-4a98-b729-c0af15020474 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3b2d6f22389b457bba0795cfb0d46d7f', 'request_id': 'req-e10946ce-3dd6-4a98-b729-c0af15020474'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:30:43.340222 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 877/1748] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Oct 12 02:30:43 2022] POST /identity/v3/projects => generated 373 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 02:30:43.340222 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b94ef4-690c-485d-a4aa-088bb580cd48 admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:30:43.343783 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-e10946ce-3dd6-4a98-b729-c0af15020474 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3b2d6f22389b457bba0795cfb0d46d7f', 'request_id': 'req-e10946ce-3dd6-4a98-b729-c0af15020474'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:30:43.351723 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-e10946ce-3dd6-4a98-b729-c0af15020474 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3b2d6f22389b457bba0795cfb0d46d7f', 'request_id': 'req-e10946ce-3dd6-4a98-b729-c0af15020474'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:30:43.366342 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-e10946ce-3dd6-4a98-b729-c0af15020474 admin admin] The token cache is being invalidate because project 3b2d6f22389b457bba0795cfb0d46d7f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81362) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 02:30:43.366770 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-e10946ce-3dd6-4a98-b729-c0af15020474 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:30:43.367528 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-e10946ce-3dd6-4a98-b729-c0af15020474 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:30:43.369120 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 872/1749] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Oct 12 02:30:43 2022] DELETE /identity/v3/projects/3b2d6f22389b457bba0795cfb0d46d7f => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 02:30:43.374191 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10946ce-3dd6-4a98-b729-c0af15020474 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:30:43.375612 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-e10946ce-3dd6-4a98-b729-c0af15020474 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:30:43.404334 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b94ef4-690c-485d-a4aa-088bb580cd48 admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:30:43.408991 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c60a09-6391-446e-aedd-74fecbce00c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:30:43.409650 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c60a09-6391-446e-aedd-74fecbce00c5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:43.409926 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c60a09-6391-446e-aedd-74fecbce00c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:43.410317 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c60a09-6391-446e-aedd-74fecbce00c5 admin admin] PATH_INFO: `/v3/projects/dd625efb94404eeeabace779cc0853f3/users/c8ef4ee6d7a94f488bf5b8373449d15d/roles/39b1e8108dff402383def3c559f48189` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:43.412198 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c60a09-6391-446e-aedd-74fecbce00c5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dd625efb94404eeeabace779cc0853f3, user_id=c8ef4ee6d7a94f488bf5b8373449d15d, role_id=39b1e8108dff402383def3c559f48189)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:30:43.414899 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c60a09-6391-446e-aedd-74fecbce00c5 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:30:43.425706 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 878/1750] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Oct 12 02:30:43 2022] PUT /identity/v3/projects/dd625efb94404eeeabace779cc0853f3/users/c8ef4ee6d7a94f488bf5b8373449d15d/roles/39b1e8108dff402383def3c559f48189 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 02:30:43.426890 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f9b153-300b-4b3c-966b-3275fb1b11ae None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:43.427168 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f9b153-300b-4b3c-966b-3275fb1b11ae None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:43.427432 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f9b153-300b-4b3c-966b-3275fb1b11ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:43.446481 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-b0f9b153-300b-4b3c-966b-3275fb1b11ae None None] MFA Rules not processed for user `a326a5bb7364479382f528a592371656`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:30:43.447676 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-b0f9b153-300b-4b3c-966b-3275fb1b11ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:30:43.448229 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10946ce-3dd6-4a98-b729-c0af15020474 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:30:43.469500 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:30:43.510584 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 879/1751] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 02:30:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 02:30:43.510817 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461fde70-4c69-4126-9dd4-d7f2495ce01c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:30:43.511393 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461fde70-4c69-4126-9dd4-d7f2495ce01c admin admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:43.511675 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461fde70-4c69-4126-9dd4-d7f2495ce01c admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:43.511954 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461fde70-4c69-4126-9dd4-d7f2495ce01c admin admin] PATH_INFO: `/v3/users` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:43.512619 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461fde70-4c69-4126-9dd4-d7f2495ce01c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:30:43.514675 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461fde70-4c69-4126-9dd4-d7f2495ce01c admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:30:43.518091 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d9be39-59d2-491b-b946-f4639d59aaab None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:43.518373 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d9be39-59d2-491b-b946-f4639d59aaab None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:43.518645 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d9be39-59d2-491b-b946-f4639d59aaab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:43.538623 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 873/1752] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Oct 12 02:30:43 2022] POST /identity/v3/users => generated 287 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 02:30:43.539784 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9efe2ce-f894-43b4-bcf9-bac51c6de8e0 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:43.540070 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9efe2ce-f894-43b4-bcf9-bac51c6de8e0 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:43.540348 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9efe2ce-f894-43b4-bcf9-bac51c6de8e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:43.552292 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-d1d9be39-59d2-491b-b946-f4639d59aaab None None] MFA Rules not processed for user `c8ef4ee6d7a94f488bf5b8373449d15d`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:30:43.553561 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-d1d9be39-59d2-491b-b946-f4639d59aaab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:30:43.561217 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-e9efe2ce-f894-43b4-bcf9-bac51c6de8e0 None None] MFA Rules not processed for user `a326a5bb7364479382f528a592371656`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:30:43.562492 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-e9efe2ce-f894-43b4-bcf9-bac51c6de8e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:30:43.570478 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 874/1753] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 02:30:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 02:30:43.573577 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9efe2ce-f894-43b4-bcf9-bac51c6de8e0 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:30:43.584200 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9efe2ce-f894-43b4-bcf9-bac51c6de8e0 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:30:43.589027 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:30:43.589517 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbeb0f9b-4516-4ee5-83cd-b36b2358312e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:30:43.590125 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbeb0f9b-4516-4ee5-83cd-b36b2358312e admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:43.590453 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbeb0f9b-4516-4ee5-83cd-b36b2358312e admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:43.590986 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbeb0f9b-4516-4ee5-83cd-b36b2358312e admin admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:43.591993 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbeb0f9b-4516-4ee5-83cd-b36b2358312e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:30:43.593672 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbeb0f9b-4516-4ee5-83cd-b36b2358312e admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:30:43.604028 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 875/1754] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Oct 12 02:30:43 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 02:30:43.608410 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbeb0f9b-4516-4ee5-83cd-b36b2358312e admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:30:43.618437 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbeb0f9b-4516-4ee5-83cd-b36b2358312e admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:30:43.624008 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c970cf-94af-4ce3-83bb-a8cfca1d151c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:30:43.624646 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c970cf-94af-4ce3-83bb-a8cfca1d151c admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:43.624950 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c970cf-94af-4ce3-83bb-a8cfca1d151c admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:43.625220 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c970cf-94af-4ce3-83bb-a8cfca1d151c admin admin] PATH_INFO: `/v3/domains` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:43.625864 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c970cf-94af-4ce3-83bb-a8cfca1d151c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 02:30:43.626167 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c970cf-94af-4ce3-83bb-a8cfca1d151c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:30:43.627735 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c970cf-94af-4ce3-83bb-a8cfca1d151c admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:30:43.629715 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 880/1755] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 02:30:43 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 02:30:43.630346 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d9be39-59d2-491b-b946-f4639d59aaab None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:30:43.641148 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d9be39-59d2-491b-b946-f4639d59aaab None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:30:43.641282 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 876/1756] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Oct 12 02:30:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 02:30:43.645340 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c970cf-94af-4ce3-83bb-a8cfca1d151c admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:30:43.646072 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40a40a8-dfad-4fd7-a184-63c96cc81195 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:30:43.646670 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40a40a8-dfad-4fd7-a184-63c96cc81195 admin admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:43.646944 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40a40a8-dfad-4fd7-a184-63c96cc81195 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:43.647161 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-91c970cf-94af-4ce3-83bb-a8cfca1d151c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:30:43.647266 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40a40a8-dfad-4fd7-a184-63c96cc81195 admin admin] PATH_INFO: `/v3/roles` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:43.647837 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40a40a8-dfad-4fd7-a184-63c96cc81195 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:30:43.649511 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40a40a8-dfad-4fd7-a184-63c96cc81195 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:30:43.663213 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 881/1757] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Oct 12 02:30:43 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 02:30:43.663213 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40a40a8-dfad-4fd7-a184-63c96cc81195 admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:30:43.672365 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40a40a8-dfad-4fd7-a184-63c96cc81195 admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:30:43.677433 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff7ddf9-1dd3-4d92-9a47-ddb702e7c6b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:30:43.678002 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff7ddf9-1dd3-4d92-9a47-ddb702e7c6b7 admin admin] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:43.678279 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff7ddf9-1dd3-4d92-9a47-ddb702e7c6b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:43.678721 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff7ddf9-1dd3-4d92-9a47-ddb702e7c6b7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:43.679342 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff7ddf9-1dd3-4d92-9a47-ddb702e7c6b7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:30:43.681301 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff7ddf9-1dd3-4d92-9a47-ddb702e7c6b7 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:30:43.708971 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c970cf-94af-4ce3-83bb-a8cfca1d151c admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:30:43.713699 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 882/1758] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Oct 12 02:30:43 2022] POST /identity/v3/projects => generated 377 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 02:30:43.713699 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff7ddf9-1dd3-4d92-9a47-ddb702e7c6b7 admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:30:43.759801 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdb05e3-0a2f-42b2-bb6b-5fb6fd743491 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ba688e0c4d44d13898539ee886f95fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'beb6def6fcad45959e56425bb8bff4d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:30:43.760416 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdb05e3-0a2f-42b2-bb6b-5fb6fd743491 service cinder] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:43.760725 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdb05e3-0a2f-42b2-bb6b-5fb6fd743491 service cinder] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:43.760997 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdb05e3-0a2f-42b2-bb6b-5fb6fd743491 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:43.773642 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff7ddf9-1dd3-4d92-9a47-ddb702e7c6b7 admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:30:43.778318 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f33ad95-81de-4c15-9ed0-e5f20915befd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:30:43.779021 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f33ad95-81de-4c15-9ed0-e5f20915befd admin admin] REQUEST_METHOD: `PUT` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:43.779637 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f33ad95-81de-4c15-9ed0-e5f20915befd admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:43.779637 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f33ad95-81de-4c15-9ed0-e5f20915befd admin admin] PATH_INFO: `/v3/projects/007b81255bf8464188fa2b0ee515285d/users/2a04ad106d944f749d2d5478015fed42/roles/3d75c4d7f1a849b9a771504d1583ab28` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:43.795743 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f33ad95-81de-4c15-9ed0-e5f20915befd admin admin] RBAC: Authorizing `identity:create_grant(project_id=007b81255bf8464188fa2b0ee515285d, user_id=2a04ad106d944f749d2d5478015fed42, role_id=3d75c4d7f1a849b9a771504d1583ab28)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:30:43.799410 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f33ad95-81de-4c15-9ed0-e5f20915befd admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:30:43.812191 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 883/1759] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Oct 12 02:30:43 2022] PUT /identity/v3/projects/007b81255bf8464188fa2b0ee515285d/users/2a04ad106d944f749d2d5478015fed42/roles/3d75c4d7f1a849b9a771504d1583ab28 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 02:30:43.813770 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f33ad95-81de-4c15-9ed0-e5f20915befd admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:30:43.816059 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:30:43.828886 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cdb05e3-0a2f-42b2-bb6b-5fb6fd743491 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:30:43.830328 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cdb05e3-0a2f-42b2-bb6b-5fb6fd743491 service cinder] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:30:43.840051 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 877/1760] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 02:30:43 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 02:30:43.841289 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df17972e-49ab-4b4a-bd57-07135a49f024 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:43.841670 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df17972e-49ab-4b4a-bd57-07135a49f024 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:43.841983 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df17972e-49ab-4b4a-bd57-07135a49f024 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:43.888549 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-df17972e-49ab-4b4a-bd57-07135a49f024 None None] MFA Rules not processed for user `2a04ad106d944f749d2d5478015fed42`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:30:43.889853 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f33ad95-81de-4c15-9ed0-e5f20915befd admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:30:43.889999 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-df17972e-49ab-4b4a-bd57-07135a49f024 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:30:43.895935 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fa202f-74e5-4af1-8ff8-3300f1ef43d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:30:43.896660 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fa202f-74e5-4af1-8ff8-3300f1ef43d3 admin admin] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:43.897619 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fa202f-74e5-4af1-8ff8-3300f1ef43d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:43.897962 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fa202f-74e5-4af1-8ff8-3300f1ef43d3 admin admin] PATH_INFO: `/v3/users` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:43.899637 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69fa202f-74e5-4af1-8ff8-3300f1ef43d3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:30:43.901517 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69fa202f-74e5-4af1-8ff8-3300f1ef43d3 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:30:43.931071 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 884/1761] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Oct 12 02:30:43 2022] POST /identity/v3/users => generated 289 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 02:30:43.937576 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fa202f-74e5-4af1-8ff8-3300f1ef43d3 admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:30:43.948729 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fa202f-74e5-4af1-8ff8-3300f1ef43d3 admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:30:43.954005 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db3d421-bbdb-4ff2-9a9a-09bef122be1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:30:43.954663 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db3d421-bbdb-4ff2-9a9a-09bef122be1e admin admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:43.954939 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db3d421-bbdb-4ff2-9a9a-09bef122be1e admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:43.955209 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db3d421-bbdb-4ff2-9a9a-09bef122be1e admin admin] PATH_INFO: `/v3/roles` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:43.955981 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db3d421-bbdb-4ff2-9a9a-09bef122be1e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:30:43.957867 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db3d421-bbdb-4ff2-9a9a-09bef122be1e admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:30:43.960797 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:30:43.976771 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 885/1762] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Oct 12 02:30:43 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 02:30:43.987047 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db3d421-bbdb-4ff2-9a9a-09bef122be1e admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:30:43.996592 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 878/1763] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 02:30:43 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 02:30:44.002787 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db3d421-bbdb-4ff2-9a9a-09bef122be1e admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:30:44.004738 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df17972e-49ab-4b4a-bd57-07135a49f024 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:30:44.007682 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91762a2-edff-44f1-b630-48c4a5d788f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:30:44.008394 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91762a2-edff-44f1-b630-48c4a5d788f9 admin admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:44.008598 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91762a2-edff-44f1-b630-48c4a5d788f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:44.008872 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91762a2-edff-44f1-b630-48c4a5d788f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:44.009516 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91762a2-edff-44f1-b630-48c4a5d788f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:30:44.012040 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91762a2-edff-44f1-b630-48c4a5d788f9 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:30:44.028581 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df17972e-49ab-4b4a-bd57-07135a49f024 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:30:44.030530 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 886/1764] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Oct 12 02:30:43 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 02:30:44.034847 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91762a2-edff-44f1-b630-48c4a5d788f9 admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:30:44.039371 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24216d12-b7a4-4496-a5f8-03189a881c0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:30:44.040983 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24216d12-b7a4-4496-a5f8-03189a881c0f admin admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:44.041974 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24216d12-b7a4-4496-a5f8-03189a881c0f admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:44.042544 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24216d12-b7a4-4496-a5f8-03189a881c0f admin admin] PATH_INFO: `/v3/projects` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:44.043692 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24216d12-b7a4-4496-a5f8-03189a881c0f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:30:44.045473 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91762a2-edff-44f1-b630-48c4a5d788f9 admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:30:44.049057 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24216d12-b7a4-4496-a5f8-03189a881c0f admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:30:44.052512 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0eeb665-0555-496d-94ab-da3a956b72ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:30:44.053175 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0eeb665-0555-496d-94ab-da3a956b72ef admin admin] REQUEST_METHOD: `PUT` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:44.054032 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0eeb665-0555-496d-94ab-da3a956b72ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:44.054032 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0eeb665-0555-496d-94ab-da3a956b72ef admin admin] PATH_INFO: `/v3/projects/1b103f7839a2419b82edeac9652b0373/users/1803517e51e64bfdb54fd139ed680a3d/roles/3d75c4d7f1a849b9a771504d1583ab28` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:44.072674 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0eeb665-0555-496d-94ab-da3a956b72ef admin admin] RBAC: Authorizing `identity:create_grant(project_id=1b103f7839a2419b82edeac9652b0373, user_id=1803517e51e64bfdb54fd139ed680a3d, role_id=3d75c4d7f1a849b9a771504d1583ab28)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:30:44.075947 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0eeb665-0555-496d-94ab-da3a956b72ef admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:30:44.093155 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 887/1765] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Oct 12 02:30:44 2022] PUT /identity/v3/projects/1b103f7839a2419b82edeac9652b0373/users/1803517e51e64bfdb54fd139ed680a3d/roles/3d75c4d7f1a849b9a771504d1583ab28 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 02:30:44.107708 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ec955e-859f-4b4c-9cff-8ea03cfce4e5 None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:44.107708 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ec955e-859f-4b4c-9cff-8ea03cfce4e5 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:44.107708 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ec955e-859f-4b4c-9cff-8ea03cfce4e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:44.108545 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 879/1766] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Oct 12 02:30:44 2022] POST /identity/v3/projects => generated 373 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 02:30:44.109991 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24216d12-b7a4-4496-a5f8-03189a881c0f admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:30:44.142623 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-61ec955e-859f-4b4c-9cff-8ea03cfce4e5 None None] MFA Rules not processed for user `1803517e51e64bfdb54fd139ed680a3d`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:30:44.143832 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-61ec955e-859f-4b4c-9cff-8ea03cfce4e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:30:44.191098 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24216d12-b7a4-4496-a5f8-03189a881c0f admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:30:44.201000 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c164bbf7-86d9-45f4-b15d-7134407021bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:30:44.201892 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c164bbf7-86d9-45f4-b15d-7134407021bc admin admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:44.202320 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c164bbf7-86d9-45f4-b15d-7134407021bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:44.202904 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c164bbf7-86d9-45f4-b15d-7134407021bc admin admin] PATH_INFO: `/v3/users` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:44.203599 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c164bbf7-86d9-45f4-b15d-7134407021bc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:30:44.206023 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c164bbf7-86d9-45f4-b15d-7134407021bc admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:30:44.242862 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 880/1767] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Oct 12 02:30:44 2022] POST /identity/v3/users => generated 293 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 02:30:44.243146 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 888/1768] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 02:30:44 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 02:30:44.243232 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c164bbf7-86d9-45f4-b15d-7134407021bc admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:30:44.243309 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ec955e-859f-4b4c-9cff-8ea03cfce4e5 None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:30:44.249027 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c164bbf7-86d9-45f4-b15d-7134407021bc admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:30:44.254748 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fd8757-c14a-4bde-9044-e5129d0b789c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:30:44.255364 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fd8757-c14a-4bde-9044-e5129d0b789c admin admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:44.255731 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fd8757-c14a-4bde-9044-e5129d0b789c admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:44.256028 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fd8757-c14a-4bde-9044-e5129d0b789c admin admin] PATH_INFO: `/v3/projects` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:44.256986 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53fd8757-c14a-4bde-9044-e5129d0b789c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:30:44.257717 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ec955e-859f-4b4c-9cff-8ea03cfce4e5 None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:30:44.259673 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53fd8757-c14a-4bde-9044-e5129d0b789c admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:30:44.262636 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ce299e-6440-4e5f-b904-7413b04a3b5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:30:44.263634 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ce299e-6440-4e5f-b904-7413b04a3b5b admin admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:44.263750 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ce299e-6440-4e5f-b904-7413b04a3b5b admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:44.264087 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ce299e-6440-4e5f-b904-7413b04a3b5b admin admin] PATH_INFO: `/v3/roles` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:44.264775 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ce299e-6440-4e5f-b904-7413b04a3b5b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:30:44.266380 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ce299e-6440-4e5f-b904-7413b04a3b5b admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:30:44.281992 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 889/1769] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Oct 12 02:30:44 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 12 02:30:44.283679 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ce299e-6440-4e5f-b904-7413b04a3b5b admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:30:44.303259 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 881/1770] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Oct 12 02:30:44 2022] POST /identity/v3/projects => generated 377 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 02:30:44.304246 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fd8757-c14a-4bde-9044-e5129d0b789c admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:30:44.308234 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ce299e-6440-4e5f-b904-7413b04a3b5b admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:30:44.353174 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:30:44.380769 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f12f39-0af3-4a06-974c-e658ad74585c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:30:44.381463 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f12f39-0af3-4a06-974c-e658ad74585c admin admin] REQUEST_METHOD: `PUT` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:44.381743 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f12f39-0af3-4a06-974c-e658ad74585c admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:44.382013 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f12f39-0af3-4a06-974c-e658ad74585c admin admin] PATH_INFO: `/v3/projects/ae3bbb33c9e44fffbb522a6891c3b838/users/cb5b467a477f4519a9a9b2130ea62842/roles/39b1e8108dff402383def3c559f48189` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:44.395659 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fd8757-c14a-4bde-9044-e5129d0b789c admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:30:44.398134 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f12f39-0af3-4a06-974c-e658ad74585c admin admin] RBAC: Authorizing `identity:create_grant(project_id=ae3bbb33c9e44fffbb522a6891c3b838, user_id=cb5b467a477f4519a9a9b2130ea62842, role_id=39b1e8108dff402383def3c559f48189)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:30:44.400846 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f12f39-0af3-4a06-974c-e658ad74585c admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:30:44.401414 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e31a42-7347-4cd4-8935-162257e61a86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:30:44.402221 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e31a42-7347-4cd4-8935-162257e61a86 admin admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:44.402538 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e31a42-7347-4cd4-8935-162257e61a86 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:44.402815 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e31a42-7347-4cd4-8935-162257e61a86 admin admin] PATH_INFO: `/v3/users` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:44.404098 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e31a42-7347-4cd4-8935-162257e61a86 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:30:44.406206 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e31a42-7347-4cd4-8935-162257e61a86 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:30:44.417212 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 890/1771] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Oct 12 02:30:44 2022] PUT /identity/v3/projects/ae3bbb33c9e44fffbb522a6891c3b838/users/cb5b467a477f4519a9a9b2130ea62842/roles/39b1e8108dff402383def3c559f48189 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 02:30:44.418303 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f12f39-0af3-4a06-974c-e658ad74585c admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:30:44.422551 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-a0f12f39-0af3-4a06-974c-e658ad74585c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:30:44.435890 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 882/1772] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Oct 12 02:30:44 2022] POST /identity/v3/users => generated 289 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 02:30:44.436835 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e31a42-7347-4cd4-8935-162257e61a86 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:30:44.449692 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e31a42-7347-4cd4-8935-162257e61a86 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:30:44.461976 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:30:44.506777 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f12f39-0af3-4a06-974c-e658ad74585c admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:30:44.515790 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d1e3ce-ed23-48be-bd3a-6b260a3400c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:30:44.516992 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d1e3ce-ed23-48be-bd3a-6b260a3400c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:44.517486 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d1e3ce-ed23-48be-bd3a-6b260a3400c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:44.517791 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d1e3ce-ed23-48be-bd3a-6b260a3400c3 admin admin] PATH_INFO: `/v3/users/d2e5887c9242421e817fb1c3a306a3d7` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:44.519791 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d1e3ce-ed23-48be-bd3a-6b260a3400c3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d2e5887c9242421e817fb1c3a306a3d7)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:30:44.528126 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d1e3ce-ed23-48be-bd3a-6b260a3400c3 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:30:44.538783 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d444ed9a-a74f-4459-9d21-9b4b100e431e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:30:44.538783 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d444ed9a-a74f-4459-9d21-9b4b100e431e admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:44.538783 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d444ed9a-a74f-4459-9d21-9b4b100e431e admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:44.538783 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d444ed9a-a74f-4459-9d21-9b4b100e431e admin admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:44.539681 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d444ed9a-a74f-4459-9d21-9b4b100e431e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:30:44.544284 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d444ed9a-a74f-4459-9d21-9b4b100e431e admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:30:44.564758 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 883/1773] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Oct 12 02:30:44 2022] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 02:30:44.565683 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d444ed9a-a74f-4459-9d21-9b4b100e431e admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:30:44.579721 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d444ed9a-a74f-4459-9d21-9b4b100e431e admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:30:44.584666 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba1cd55-942d-4761-adff-53e5c137a93f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:30:44.585387 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba1cd55-942d-4761-adff-53e5c137a93f admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:44.585671 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba1cd55-942d-4761-adff-53e5c137a93f admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:44.586070 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba1cd55-942d-4761-adff-53e5c137a93f admin admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:44.586853 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba1cd55-942d-4761-adff-53e5c137a93f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:30:44.588990 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba1cd55-942d-4761-adff-53e5c137a93f admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:30:44.601257 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 884/1774] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Oct 12 02:30:44 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 02:30:44.602079 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba1cd55-942d-4761-adff-53e5c137a93f admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:30:44.613971 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-b3d1e3ce-ed23-48be-bd3a-6b260a3400c3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd2e5887c9242421e817fb1c3a306a3d7'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:30:44.614518 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba1cd55-942d-4761-adff-53e5c137a93f admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:30:44.620967 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-b3d1e3ce-ed23-48be-bd3a-6b260a3400c3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd2e5887c9242421e817fb1c3a306a3d7'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:30:44.621405 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a4c2d2-ee4e-4048-a750-d9d05a55c5eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:30:44.622268 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a4c2d2-ee4e-4048-a750-d9d05a55c5eb admin admin] REQUEST_METHOD: `PUT` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:44.623417 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a4c2d2-ee4e-4048-a750-d9d05a55c5eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:44.623877 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a4c2d2-ee4e-4048-a750-d9d05a55c5eb admin admin] PATH_INFO: `/v3/projects/ae3bbb33c9e44fffbb522a6891c3b838/users/cb5b467a477f4519a9a9b2130ea62842/roles/39b1e8108dff402383def3c559f48189` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:44.626162 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a4c2d2-ee4e-4048-a750-d9d05a55c5eb admin admin] RBAC: Authorizing `identity:create_grant(project_id=ae3bbb33c9e44fffbb522a6891c3b838, user_id=cb5b467a477f4519a9a9b2130ea62842, role_id=39b1e8108dff402383def3c559f48189)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:30:44.629078 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a4c2d2-ee4e-4048-a750-d9d05a55c5eb admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:30:44.633906 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-b3d1e3ce-ed23-48be-bd3a-6b260a3400c3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd2e5887c9242421e817fb1c3a306a3d7'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:30:44.640710 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 885/1775] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Oct 12 02:30:44 2022] PUT /identity/v3/projects/ae3bbb33c9e44fffbb522a6891c3b838/users/cb5b467a477f4519a9a9b2130ea62842/roles/39b1e8108dff402383def3c559f48189 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 02:30:44.641638 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a4c2d2-ee4e-4048-a750-d9d05a55c5eb admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:30:44.642348 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-b3d1e3ce-ed23-48be-bd3a-6b260a3400c3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd2e5887c9242421e817fb1c3a306a3d7'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:30:44.643059 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-b3d1e3ce-ed23-48be-bd3a-6b260a3400c3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd2e5887c9242421e817fb1c3a306a3d7'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:30:44.649685 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 891/1776] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Oct 12 02:30:44 2022] DELETE /identity/v3/users/d2e5887c9242421e817fb1c3a306a3d7 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 02:30:44.655049 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f5fad7-62de-4e6c-b0f4-c05615873c21 None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:44.655450 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f5fad7-62de-4e6c-b0f4-c05615873c21 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:44.655808 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f5fad7-62de-4e6c-b0f4-c05615873c21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:44.686206 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-e2f5fad7-62de-4e6c-b0f4-c05615873c21 None None] MFA Rules not processed for user `cb5b467a477f4519a9a9b2130ea62842`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:30:44.687426 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-e2f5fad7-62de-4e6c-b0f4-c05615873c21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:30:44.715625 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a4c2d2-ee4e-4048-a750-d9d05a55c5eb admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:30:44.748757 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:30:44.758376 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 892/1777] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 02:30:44 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 02:30:44.759713 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a53908-c640-4316-8c91-bc3018bab65e None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:44.760078 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a53908-c640-4316-8c91-bc3018bab65e None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:44.760547 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a53908-c640-4316-8c91-bc3018bab65e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:44.781155 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-10a53908-c640-4316-8c91-bc3018bab65e None None] MFA Rules not processed for user `a326a5bb7364479382f528a592371656`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:30:44.782789 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a198fee0-53b0-442b-bb47-37dd40300a7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:30:44.782943 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-10a53908-c640-4316-8c91-bc3018bab65e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:30:44.783435 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a198fee0-53b0-442b-bb47-37dd40300a7a admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:44.783719 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a198fee0-53b0-442b-bb47-37dd40300a7a admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:44.783990 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a198fee0-53b0-442b-bb47-37dd40300a7a admin admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:44.784691 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a198fee0-53b0-442b-bb47-37dd40300a7a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:30:44.786282 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a198fee0-53b0-442b-bb47-37dd40300a7a admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:30:44.790579 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 893/1778] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 02:30:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 02:30:44.791440 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a53908-c640-4316-8c91-bc3018bab65e None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:30:44.795577 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-10a53908-c640-4316-8c91-bc3018bab65e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:30:44.799882 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 886/1779] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Oct 12 02:30:44 2022] GET /identity/v3/roles => generated 1420 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 02:30:44.801686 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a198fee0-53b0-442b-bb47-37dd40300a7a admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:30:44.803298 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-a198fee0-53b0-442b-bb47-37dd40300a7a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:30:44.824229 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:30:44.857769 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a53908-c640-4316-8c91-bc3018bab65e None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:30:44.861889 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4736ab7e-39b2-4744-9fb2-8e8720230b11 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ba688e0c4d44d13898539ee886f95fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'beb6def6fcad45959e56425bb8bff4d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:30:44.862547 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4736ab7e-39b2-4744-9fb2-8e8720230b11 service cinder] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:44.862879 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4736ab7e-39b2-4744-9fb2-8e8720230b11 service cinder] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:44.863153 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4736ab7e-39b2-4744-9fb2-8e8720230b11 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:44.863640 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a198fee0-53b0-442b-bb47-37dd40300a7a admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:30:44.868653 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1a4385-a91c-49d5-8a07-d84d74479e9e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5223b5cab3114e9b9a13c582f8ef8386', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'beb6def6fcad45959e56425bb8bff4d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:30:44.868653 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1a4385-a91c-49d5-8a07-d84d74479e9e service neutron] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:44.868653 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1a4385-a91c-49d5-8a07-d84d74479e9e service neutron] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:44.868653 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1a4385-a91c-49d5-8a07-d84d74479e9e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:44.873105 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4736ab7e-39b2-4744-9fb2-8e8720230b11 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:30:44.874673 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4736ab7e-39b2-4744-9fb2-8e8720230b11 service cinder] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:30:44.879740 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1a4385-a91c-49d5-8a07-d84d74479e9e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:30:44.881709 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1a4385-a91c-49d5-8a07-d84d74479e9e service neutron] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:30:44.884641 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 894/1780] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 02:30:44 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 02:30:44.885398 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4736ab7e-39b2-4744-9fb2-8e8720230b11 service cinder] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:30:44.886631 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-4736ab7e-39b2-4744-9fb2-8e8720230b11 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:30:44.892519 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 887/1781] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 02:30:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 12 02:30:44.900264 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4736ab7e-39b2-4744-9fb2-8e8720230b11 service cinder] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:30:44.907814 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1795f0ff-0498-4321-b4c2-d5ae108c1002 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:30:44.908570 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1795f0ff-0498-4321-b4c2-d5ae108c1002 admin admin] REQUEST_METHOD: `PUT` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:44.908858 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1795f0ff-0498-4321-b4c2-d5ae108c1002 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:44.909321 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1795f0ff-0498-4321-b4c2-d5ae108c1002 admin admin] PATH_INFO: `/v3/projects/03ac2c430e154f1cbcb794e1ec2e8b34/users/1c6cc524d8ff4746897c638870d93090/roles/3d75c4d7f1a849b9a771504d1583ab28` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:44.931552 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1795f0ff-0498-4321-b4c2-d5ae108c1002 admin admin] RBAC: Authorizing `identity:create_grant(project_id=03ac2c430e154f1cbcb794e1ec2e8b34, user_id=1c6cc524d8ff4746897c638870d93090, role_id=3d75c4d7f1a849b9a771504d1583ab28)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:30:44.935261 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1795f0ff-0498-4321-b4c2-d5ae108c1002 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:30:44.955128 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 895/1782] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Oct 12 02:30:44 2022] PUT /identity/v3/projects/03ac2c430e154f1cbcb794e1ec2e8b34/users/1c6cc524d8ff4746897c638870d93090/roles/3d75c4d7f1a849b9a771504d1583ab28 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 02:30:44.966814 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c7ea6f-e487-4723-ac97-b9ff974f8351 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:44.967315 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c7ea6f-e487-4723-ac97-b9ff974f8351 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:44.967600 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c7ea6f-e487-4723-ac97-b9ff974f8351 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:45.005816 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-e7c7ea6f-e487-4723-ac97-b9ff974f8351 None None] MFA Rules not processed for user `1c6cc524d8ff4746897c638870d93090`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:30:45.007204 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-e7c7ea6f-e487-4723-ac97-b9ff974f8351 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:30:45.117194 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 888/1783] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 02:30:44 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 02:30:45.118422 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1795f0ff-0498-4321-b4c2-d5ae108c1002 admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:30:45.206360 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1795f0ff-0498-4321-b4c2-d5ae108c1002 admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:30:45.216935 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175a0cc0-88c9-4d6a-b119-e41aaf26c22d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:30:45.217641 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175a0cc0-88c9-4d6a-b119-e41aaf26c22d admin admin] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:45.217912 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175a0cc0-88c9-4d6a-b119-e41aaf26c22d admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:45.218633 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175a0cc0-88c9-4d6a-b119-e41aaf26c22d admin admin] PATH_INFO: `/v3/projects` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:45.219459 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175a0cc0-88c9-4d6a-b119-e41aaf26c22d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:30:45.221149 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175a0cc0-88c9-4d6a-b119-e41aaf26c22d admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:30:45.272136 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c7ea6f-e487-4723-ac97-b9ff974f8351 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:30:45.273652 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-e7c7ea6f-e487-4723-ac97-b9ff974f8351 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:30:45.281602 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 896/1784] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Oct 12 02:30:45 2022] POST /identity/v3/projects => generated 375 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 02:30:45.286090 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175a0cc0-88c9-4d6a-b119-e41aaf26c22d admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:30:45.297798 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c7ea6f-e487-4723-ac97-b9ff974f8351 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:30:45.395129 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6a2216-18c5-43e0-9b6b-9a4923dddd56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:30:45.396291 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6a2216-18c5-43e0-9b6b-9a4923dddd56 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:45.396627 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6a2216-18c5-43e0-9b6b-9a4923dddd56 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:45.397137 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6a2216-18c5-43e0-9b6b-9a4923dddd56 admin admin] PATH_INFO: `/v3/projects/171ced871cd348b5a4cc7577c765bbdd` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:45.398523 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6a2216-18c5-43e0-9b6b-9a4923dddd56 admin admin] RBAC: Authorizing `identity:delete_project(project_id=171ced871cd348b5a4cc7577c765bbdd)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:30:45.399618 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175a0cc0-88c9-4d6a-b119-e41aaf26c22d admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:30:45.400752 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6a2216-18c5-43e0-9b6b-9a4923dddd56 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:30:45.408285 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8907d66-dd5d-4244-93e1-8178f6959a41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:30:45.408285 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8907d66-dd5d-4244-93e1-8178f6959a41 admin admin] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:45.408285 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8907d66-dd5d-4244-93e1-8178f6959a41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:45.408580 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8907d66-dd5d-4244-93e1-8178f6959a41 admin admin] PATH_INFO: `/v3/users` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:45.409287 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:30:45.409421 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8907d66-dd5d-4244-93e1-8178f6959a41 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:30:45.412293 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8907d66-dd5d-4244-93e1-8178f6959a41 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:30:45.442684 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 897/1785] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Oct 12 02:30:45 2022] POST /identity/v3/users => generated 294 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 02:30:45.442684 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8907d66-dd5d-4244-93e1-8178f6959a41 admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:30:45.442684 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-d8907d66-dd5d-4244-93e1-8178f6959a41 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:30:45.455808 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8907d66-dd5d-4244-93e1-8178f6959a41 admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:30:45.460167 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-6e6a2216-18c5-43e0-9b6b-9a4923dddd56 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '171ced871cd348b5a4cc7577c765bbdd', 'request_id': 'req-6e6a2216-18c5-43e0-9b6b-9a4923dddd56'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:30:45.467101 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-6e6a2216-18c5-43e0-9b6b-9a4923dddd56 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '171ced871cd348b5a4cc7577c765bbdd', 'request_id': 'req-6e6a2216-18c5-43e0-9b6b-9a4923dddd56'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:30:45.469711 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:30:45.474044 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-6e6a2216-18c5-43e0-9b6b-9a4923dddd56 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '171ced871cd348b5a4cc7577c765bbdd', 'request_id': 'req-6e6a2216-18c5-43e0-9b6b-9a4923dddd56'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:30:45.488963 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-6e6a2216-18c5-43e0-9b6b-9a4923dddd56 admin admin] The token cache is being invalidate because project 171ced871cd348b5a4cc7577c765bbdd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81362) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 02:30:45.489254 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-6e6a2216-18c5-43e0-9b6b-9a4923dddd56 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:30:45.489895 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-6e6a2216-18c5-43e0-9b6b-9a4923dddd56 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:30:45.491431 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 889/1786] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Oct 12 02:30:45 2022] DELETE /identity/v3/projects/171ced871cd348b5a4cc7577c765bbdd => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 02:30:45.492558 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6a2216-18c5-43e0-9b6b-9a4923dddd56 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:30:45.493494 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-6e6a2216-18c5-43e0-9b6b-9a4923dddd56 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:30:45.522463 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182f7710-9a93-4447-8962-e87978d6b32b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:30:45.523197 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182f7710-9a93-4447-8962-e87978d6b32b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:45.523534 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182f7710-9a93-4447-8962-e87978d6b32b admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:45.523874 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182f7710-9a93-4447-8962-e87978d6b32b admin admin] PATH_INFO: `/v3/users/2a04ad106d944f749d2d5478015fed42` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:45.525105 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182f7710-9a93-4447-8962-e87978d6b32b admin admin] RBAC: Authorizing `identity:delete_user(user_id=2a04ad106d944f749d2d5478015fed42)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:30:45.527103 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182f7710-9a93-4447-8962-e87978d6b32b admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:30:45.568845 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6a2216-18c5-43e0-9b6b-9a4923dddd56 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:30:45.573814 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72ecc38-6623-4c3f-8067-5ed1d63d2aec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:30:45.574502 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72ecc38-6623-4c3f-8067-5ed1d63d2aec admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:45.574702 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72ecc38-6623-4c3f-8067-5ed1d63d2aec admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:45.574976 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72ecc38-6623-4c3f-8067-5ed1d63d2aec admin admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:45.576379 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-182f7710-9a93-4447-8962-e87978d6b32b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2a04ad106d944f749d2d5478015fed42'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:30:45.576724 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72ecc38-6623-4c3f-8067-5ed1d63d2aec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:30:45.578334 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72ecc38-6623-4c3f-8067-5ed1d63d2aec admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:30:45.583970 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-182f7710-9a93-4447-8962-e87978d6b32b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2a04ad106d944f749d2d5478015fed42'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:30:45.589245 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 890/1787] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Oct 12 02:30:45 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 02:30:45.590051 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72ecc38-6623-4c3f-8067-5ed1d63d2aec admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:30:45.592572 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-b72ecc38-6623-4c3f-8067-5ed1d63d2aec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:30:45.603373 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-182f7710-9a93-4447-8962-e87978d6b32b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2a04ad106d944f749d2d5478015fed42'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:30:45.607588 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72ecc38-6623-4c3f-8067-5ed1d63d2aec admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:30:45.611431 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-182f7710-9a93-4447-8962-e87978d6b32b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2a04ad106d944f749d2d5478015fed42'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:30:45.612458 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-182f7710-9a93-4447-8962-e87978d6b32b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2a04ad106d944f749d2d5478015fed42'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:30:45.612887 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96cc680-9acf-40f3-ad5f-e490536b57b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:30:45.613517 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96cc680-9acf-40f3-ad5f-e490536b57b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:45.613798 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96cc680-9acf-40f3-ad5f-e490536b57b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:45.614073 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96cc680-9acf-40f3-ad5f-e490536b57b8 admin admin] PATH_INFO: `/v3/users/c8ef4ee6d7a94f488bf5b8373449d15d` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:45.615216 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96cc680-9acf-40f3-ad5f-e490536b57b8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c8ef4ee6d7a94f488bf5b8373449d15d)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:30:45.617175 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96cc680-9acf-40f3-ad5f-e490536b57b8 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:30:45.624773 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 898/1788] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Oct 12 02:30:45 2022] DELETE /identity/v3/users/2a04ad106d944f749d2d5478015fed42 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 02:30:45.624773 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182f7710-9a93-4447-8962-e87978d6b32b admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:30:45.624773 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-182f7710-9a93-4447-8962-e87978d6b32b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:30:45.678864 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-d96cc680-9acf-40f3-ad5f-e490536b57b8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c8ef4ee6d7a94f488bf5b8373449d15d'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:30:45.690433 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-d96cc680-9acf-40f3-ad5f-e490536b57b8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c8ef4ee6d7a94f488bf5b8373449d15d'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:30:45.699739 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182f7710-9a93-4447-8962-e87978d6b32b admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:30:45.709182 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d8dea9-ba4d-438c-978c-a8981309fb17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:30:45.709984 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d8dea9-ba4d-438c-978c-a8981309fb17 admin admin] REQUEST_METHOD: `PUT` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:45.710363 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d8dea9-ba4d-438c-978c-a8981309fb17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:45.710738 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d8dea9-ba4d-438c-978c-a8981309fb17 admin admin] PATH_INFO: `/v3/projects/c82b9722184a4250bc1c48c5b23a0f4b/users/50571fbd58104511bcb0f26818184f77/roles/39b1e8108dff402383def3c559f48189` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:45.727286 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-d96cc680-9acf-40f3-ad5f-e490536b57b8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c8ef4ee6d7a94f488bf5b8373449d15d'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:30:45.730041 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d8dea9-ba4d-438c-978c-a8981309fb17 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c82b9722184a4250bc1c48c5b23a0f4b, user_id=50571fbd58104511bcb0f26818184f77, role_id=39b1e8108dff402383def3c559f48189)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:30:45.735962 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d8dea9-ba4d-438c-978c-a8981309fb17 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:30:45.740782 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-d96cc680-9acf-40f3-ad5f-e490536b57b8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c8ef4ee6d7a94f488bf5b8373449d15d'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:30:45.741633 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-d96cc680-9acf-40f3-ad5f-e490536b57b8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c8ef4ee6d7a94f488bf5b8373449d15d'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:30:45.746091 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:30:45.757328 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 899/1790] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Oct 12 02:30:45 2022] PUT /identity/v3/projects/c82b9722184a4250bc1c48c5b23a0f4b/users/50571fbd58104511bcb0f26818184f77/roles/39b1e8108dff402383def3c559f48189 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 02:30:45.760524 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e36a2d-86d0-4a29-bfc8-b19f8f28a12d None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:45.760689 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 891/1790] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Oct 12 02:30:45 2022] DELETE /identity/v3/users/c8ef4ee6d7a94f488bf5b8373449d15d => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 02:30:45.761419 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e36a2d-86d0-4a29-bfc8-b19f8f28a12d None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:45.762074 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e36a2d-86d0-4a29-bfc8-b19f8f28a12d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:45.766001 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96cc680-9acf-40f3-ad5f-e490536b57b8 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:30:45.768205 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-d96cc680-9acf-40f3-ad5f-e490536b57b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:30:45.791045 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-c3e36a2d-86d0-4a29-bfc8-b19f8f28a12d None None] MFA Rules not processed for user `a326a5bb7364479382f528a592371656`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:30:45.792259 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-c3e36a2d-86d0-4a29-bfc8-b19f8f28a12d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:30:45.806385 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:30:45.897816 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 900/1791] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 02:30:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 02:30:45.905362 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96cc680-9acf-40f3-ad5f-e490536b57b8 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:30:45.911744 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530591e8-fa49-4ced-a37d-c0a2ab53a544 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:30:45.912662 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530591e8-fa49-4ced-a37d-c0a2ab53a544 admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:45.912662 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530591e8-fa49-4ced-a37d-c0a2ab53a544 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:45.912939 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530591e8-fa49-4ced-a37d-c0a2ab53a544 admin admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:45.913570 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530591e8-fa49-4ced-a37d-c0a2ab53a544 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:30:45.916338 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e36a2d-86d0-4a29-bfc8-b19f8f28a12d None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:30:45.917899 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-c3e36a2d-86d0-4a29-bfc8-b19f8f28a12d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:30:45.921854 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530591e8-fa49-4ced-a37d-c0a2ab53a544 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:30:45.954209 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 892/1792] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Oct 12 02:30:45 2022] GET /identity/v3/roles => generated 1420 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 02:30:45.961033 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530591e8-fa49-4ced-a37d-c0a2ab53a544 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:30:45.976051 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530591e8-fa49-4ced-a37d-c0a2ab53a544 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:30:45.986601 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79910aa8-43ee-4cd8-8320-21e2dbd0faaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:30:45.987995 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79910aa8-43ee-4cd8-8320-21e2dbd0faaf admin admin] REQUEST_METHOD: `PUT` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:45.988739 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79910aa8-43ee-4cd8-8320-21e2dbd0faaf admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:45.989310 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79910aa8-43ee-4cd8-8320-21e2dbd0faaf admin admin] PATH_INFO: `/v3/projects/c82b9722184a4250bc1c48c5b23a0f4b/users/50571fbd58104511bcb0f26818184f77/roles/39b1e8108dff402383def3c559f48189` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:45.993319 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79910aa8-43ee-4cd8-8320-21e2dbd0faaf admin admin] RBAC: Authorizing `identity:create_grant(project_id=c82b9722184a4250bc1c48c5b23a0f4b, user_id=50571fbd58104511bcb0f26818184f77, role_id=39b1e8108dff402383def3c559f48189)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:30:45.999673 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79910aa8-43ee-4cd8-8320-21e2dbd0faaf admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:30:46.009824 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e36a2d-86d0-4a29-bfc8-b19f8f28a12d None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:30:46.021715 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 893/1793] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Oct 12 02:30:45 2022] PUT /identity/v3/projects/c82b9722184a4250bc1c48c5b23a0f4b/users/50571fbd58104511bcb0f26818184f77/roles/39b1e8108dff402383def3c559f48189 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 02:30:46.032174 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d0e812-a147-4ede-a49f-74dc916d7088 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:46.032574 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d0e812-a147-4ede-a49f-74dc916d7088 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:46.032869 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d0e812-a147-4ede-a49f-74dc916d7088 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:46.072883 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-b1d0e812-a147-4ede-a49f-74dc916d7088 None None] MFA Rules not processed for user `50571fbd58104511bcb0f26818184f77`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:30:46.075163 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-b1d0e812-a147-4ede-a49f-74dc916d7088 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:30:46.087924 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f15712-d00d-462d-95bd-71c7b1271b04 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5223b5cab3114e9b9a13c582f8ef8386', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'beb6def6fcad45959e56425bb8bff4d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:30:46.088569 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f15712-d00d-462d-95bd-71c7b1271b04 service neutron] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:46.088974 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f15712-d00d-462d-95bd-71c7b1271b04 service neutron] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:46.089247 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f15712-d00d-462d-95bd-71c7b1271b04 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:46.168129 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 894/1794] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 02:30:46 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 02:30:46.180817 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f15712-d00d-462d-95bd-71c7b1271b04 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:30:46.182401 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f15712-d00d-462d-95bd-71c7b1271b04 service neutron] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:30:46.183554 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d0e812-a147-4ede-a49f-74dc916d7088 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:30:46.185173 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-b1d0e812-a147-4ede-a49f-74dc916d7088 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:30:46.198067 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 901/1795] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 02:30:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 282 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 12 02:30:46.255028 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d0e812-a147-4ede-a49f-74dc916d7088 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:30:46.259372 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a9b91e-d284-451d-be8b-961e6de387bc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ba688e0c4d44d13898539ee886f95fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'beb6def6fcad45959e56425bb8bff4d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:30:46.259937 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a9b91e-d284-451d-be8b-961e6de387bc service cinder] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:46.260214 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a9b91e-d284-451d-be8b-961e6de387bc service cinder] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:46.260502 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a9b91e-d284-451d-be8b-961e6de387bc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:46.267204 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f15712-d00d-462d-95bd-71c7b1271b04 service neutron] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:30:46.268966 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-97f15712-d00d-462d-95bd-71c7b1271b04 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:30:46.272755 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a9b91e-d284-451d-be8b-961e6de387bc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:30:46.274464 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a9b91e-d284-451d-be8b-961e6de387bc service cinder] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:30:46.300347 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f15712-d00d-462d-95bd-71c7b1271b04 service neutron] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:30:46.308489 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 895/1796] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 02:30:46 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 12 02:30:46.309445 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e3fbf1-aa8c-4256-a585-128a31c20d0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:30:46.310388 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e3fbf1-aa8c-4256-a585-128a31c20d0c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:46.310681 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e3fbf1-aa8c-4256-a585-128a31c20d0c admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:46.311119 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e3fbf1-aa8c-4256-a585-128a31c20d0c admin admin] PATH_INFO: `/v3/projects/dd625efb94404eeeabace779cc0853f3` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:46.312798 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e3fbf1-aa8c-4256-a585-128a31c20d0c admin admin] RBAC: Authorizing `identity:delete_project(project_id=dd625efb94404eeeabace779cc0853f3)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:30:46.315043 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e3fbf1-aa8c-4256-a585-128a31c20d0c admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:30:46.348039 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a9b91e-d284-451d-be8b-961e6de387bc service cinder] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:30:46.348604 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:30:46.350277 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-43a9b91e-d284-451d-be8b-961e6de387bc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:30:46.366265 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a9b91e-d284-451d-be8b-961e6de387bc service cinder] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:30:46.372803 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da575d7-0974-465d-8591-ff7abea75d50 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ba688e0c4d44d13898539ee886f95fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'beb6def6fcad45959e56425bb8bff4d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:30:46.373577 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da575d7-0974-465d-8591-ff7abea75d50 service cinder] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:46.373790 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da575d7-0974-465d-8591-ff7abea75d50 service cinder] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:46.374051 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da575d7-0974-465d-8591-ff7abea75d50 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:46.376742 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-6da575d7-0974-465d-8591-ff7abea75d50 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:30:46.388689 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-11e3fbf1-aa8c-4256-a585-128a31c20d0c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dd625efb94404eeeabace779cc0853f3', 'request_id': 'req-11e3fbf1-aa8c-4256-a585-128a31c20d0c'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:30:46.393115 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:30:46.397937 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-11e3fbf1-aa8c-4256-a585-128a31c20d0c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dd625efb94404eeeabace779cc0853f3', 'request_id': 'req-11e3fbf1-aa8c-4256-a585-128a31c20d0c'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:30:46.409971 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-11e3fbf1-aa8c-4256-a585-128a31c20d0c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dd625efb94404eeeabace779cc0853f3', 'request_id': 'req-11e3fbf1-aa8c-4256-a585-128a31c20d0c'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:30:46.438773 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-11e3fbf1-aa8c-4256-a585-128a31c20d0c admin admin] The token cache is being invalidate because project dd625efb94404eeeabace779cc0853f3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81361) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 02:30:46.439101 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-11e3fbf1-aa8c-4256-a585-128a31c20d0c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:30:46.439855 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-11e3fbf1-aa8c-4256-a585-128a31c20d0c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:30:46.445542 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 902/1797] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Oct 12 02:30:46 2022] DELETE /identity/v3/projects/dd625efb94404eeeabace779cc0853f3 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 02:30:46.448396 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797d93dc-8895-410e-a9bf-8698085a6ae9 None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:46.448717 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797d93dc-8895-410e-a9bf-8698085a6ae9 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:46.449010 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797d93dc-8895-410e-a9bf-8698085a6ae9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:46.476058 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-797d93dc-8895-410e-a9bf-8698085a6ae9 None None] MFA Rules not processed for user `a326a5bb7364479382f528a592371656`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:30:46.478059 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-797d93dc-8895-410e-a9bf-8698085a6ae9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:30:46.483966 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da575d7-0974-465d-8591-ff7abea75d50 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:30:46.485769 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da575d7-0974-465d-8591-ff7abea75d50 service cinder] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:30:46.498625 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 896/1798] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 02:30:46 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 02:30:46.557627 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 903/1799] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 02:30:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 02:30:46.568015 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e21239b-ba41-43f0-af1d-826f38a8bf9e None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:46.568302 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e21239b-ba41-43f0-af1d-826f38a8bf9e None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:46.568612 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e21239b-ba41-43f0-af1d-826f38a8bf9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:46.592121 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-1e21239b-ba41-43f0-af1d-826f38a8bf9e None None] MFA Rules not processed for user `a326a5bb7364479382f528a592371656`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:30:46.592760 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-1e21239b-ba41-43f0-af1d-826f38a8bf9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:30:46.604256 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 897/1800] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 02:30:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 02:30:46.609789 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797d93dc-8895-410e-a9bf-8698085a6ae9 None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:30:46.622993 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797d93dc-8895-410e-a9bf-8698085a6ae9 None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:30:46.638577 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ca2eab-d302-4e19-85b9-693aa7c24fbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:30:46.639316 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ca2eab-d302-4e19-85b9-693aa7c24fbb admin admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:46.639633 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ca2eab-d302-4e19-85b9-693aa7c24fbb admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:46.639920 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ca2eab-d302-4e19-85b9-693aa7c24fbb admin admin] PATH_INFO: `/v3/domains` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:46.640650 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ca2eab-d302-4e19-85b9-693aa7c24fbb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 02:30:46.640911 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ca2eab-d302-4e19-85b9-693aa7c24fbb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:30:46.642513 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ca2eab-d302-4e19-85b9-693aa7c24fbb admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:30:46.652322 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e21239b-ba41-43f0-af1d-826f38a8bf9e None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:30:46.654774 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-1e21239b-ba41-43f0-af1d-826f38a8bf9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:30:46.670604 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e21239b-ba41-43f0-af1d-826f38a8bf9e None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:30:46.675755 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0d82ef-592c-46e3-b703-807f5bb5e907 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:30:46.676727 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 904/1801] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Oct 12 02:30:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 02:30:46.679799 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0d82ef-592c-46e3-b703-807f5bb5e907 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:46.680139 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0d82ef-592c-46e3-b703-807f5bb5e907 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:46.680425 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0d82ef-592c-46e3-b703-807f5bb5e907 admin admin] PATH_INFO: `/v3/projects/007b81255bf8464188fa2b0ee515285d` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:46.681390 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ca2eab-d302-4e19-85b9-693aa7c24fbb admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:30:46.682486 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0d82ef-592c-46e3-b703-807f5bb5e907 admin admin] RBAC: Authorizing `identity:delete_project(project_id=007b81255bf8464188fa2b0ee515285d)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:30:46.684446 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0d82ef-592c-46e3-b703-807f5bb5e907 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:30:46.702532 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ca2eab-d302-4e19-85b9-693aa7c24fbb admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:30:46.707629 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b344b5-55ab-471f-858a-08d07128f192 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:30:46.708276 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b344b5-55ab-471f-858a-08d07128f192 admin admin] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:46.708858 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b344b5-55ab-471f-858a-08d07128f192 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:46.709257 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b344b5-55ab-471f-858a-08d07128f192 admin admin] PATH_INFO: `/v3/projects` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:46.709890 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b344b5-55ab-471f-858a-08d07128f192 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:30:46.712324 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b344b5-55ab-471f-858a-08d07128f192 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:30:46.739762 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-be0d82ef-592c-46e3-b703-807f5bb5e907 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '007b81255bf8464188fa2b0ee515285d', 'request_id': 'req-be0d82ef-592c-46e3-b703-807f5bb5e907'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:30:46.747589 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 905/1802] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Oct 12 02:30:46 2022] POST /identity/v3/projects => generated 375 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 02:30:46.748989 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-be0d82ef-592c-46e3-b703-807f5bb5e907 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '007b81255bf8464188fa2b0ee515285d', 'request_id': 'req-be0d82ef-592c-46e3-b703-807f5bb5e907'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:30:46.752635 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b344b5-55ab-471f-858a-08d07128f192 admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:30:46.759230 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-be0d82ef-592c-46e3-b703-807f5bb5e907 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '007b81255bf8464188fa2b0ee515285d', 'request_id': 'req-be0d82ef-592c-46e3-b703-807f5bb5e907'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:30:46.790095 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-be0d82ef-592c-46e3-b703-807f5bb5e907 admin admin] The token cache is being invalidate because project 007b81255bf8464188fa2b0ee515285d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81362) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 02:30:46.790480 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-be0d82ef-592c-46e3-b703-807f5bb5e907 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:30:46.792145 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-be0d82ef-592c-46e3-b703-807f5bb5e907 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:30:46.795935 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 898/1803] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Oct 12 02:30:46 2022] DELETE /identity/v3/projects/007b81255bf8464188fa2b0ee515285d => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 02:30:46.799924 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0d82ef-592c-46e3-b703-807f5bb5e907 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:30:46.801583 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-be0d82ef-592c-46e3-b703-807f5bb5e907 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:30:46.836062 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b344b5-55ab-471f-858a-08d07128f192 admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:30:46.841777 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bf3314-769c-419f-a5b4-e20e45bbead9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:30:46.842452 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bf3314-769c-419f-a5b4-e20e45bbead9 admin admin] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:46.842739 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bf3314-769c-419f-a5b4-e20e45bbead9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:46.843173 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bf3314-769c-419f-a5b4-e20e45bbead9 admin admin] PATH_INFO: `/v3/users` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:46.843853 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1bf3314-769c-419f-a5b4-e20e45bbead9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:30:46.846127 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1bf3314-769c-419f-a5b4-e20e45bbead9 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:30:46.880844 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 906/1804] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Oct 12 02:30:46 2022] POST /identity/v3/users => generated 288 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 02:30:46.883628 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0d82ef-592c-46e3-b703-807f5bb5e907 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:30:46.883925 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bf3314-769c-419f-a5b4-e20e45bbead9 admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:30:46.886570 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-c1bf3314-769c-419f-a5b4-e20e45bbead9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:30:46.889485 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd911925-1fab-41d6-bbaa-7cebe8ffb966 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:30:46.890215 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd911925-1fab-41d6-bbaa-7cebe8ffb966 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:46.890565 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd911925-1fab-41d6-bbaa-7cebe8ffb966 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:46.890928 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd911925-1fab-41d6-bbaa-7cebe8ffb966 admin admin] PATH_INFO: `/v3/users/cb5b467a477f4519a9a9b2130ea62842` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:46.892174 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd911925-1fab-41d6-bbaa-7cebe8ffb966 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cb5b467a477f4519a9a9b2130ea62842)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:30:46.894315 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd911925-1fab-41d6-bbaa-7cebe8ffb966 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:30:46.899784 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:30:46.906966 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bf3314-769c-419f-a5b4-e20e45bbead9 admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:30:46.916692 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0fb61f-212c-44aa-bf56-9840e3224076 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:30:46.916692 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0fb61f-212c-44aa-bf56-9840e3224076 admin admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:46.916692 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0fb61f-212c-44aa-bf56-9840e3224076 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:46.916692 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0fb61f-212c-44aa-bf56-9840e3224076 admin admin] PATH_INFO: `/v3/roles` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:46.917154 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0fb61f-212c-44aa-bf56-9840e3224076 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:30:46.919528 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0fb61f-212c-44aa-bf56-9840e3224076 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:30:46.934085 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 907/1805] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Oct 12 02:30:46 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 02:30:46.939121 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0fb61f-212c-44aa-bf56-9840e3224076 admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:30:46.946403 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:30:46.968665 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0fb61f-212c-44aa-bf56-9840e3224076 admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:30:46.973318 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-dd911925-1fab-41d6-bbaa-7cebe8ffb966 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cb5b467a477f4519a9a9b2130ea62842'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:30:46.974246 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c3ccff-3e45-4f27-bd14-90af86fad18f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:30:46.974867 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c3ccff-3e45-4f27-bd14-90af86fad18f admin admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:46.975196 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c3ccff-3e45-4f27-bd14-90af86fad18f admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:46.975412 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c3ccff-3e45-4f27-bd14-90af86fad18f admin admin] PATH_INFO: `/v3/roles` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:46.976053 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c3ccff-3e45-4f27-bd14-90af86fad18f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:30:46.977783 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c3ccff-3e45-4f27-bd14-90af86fad18f admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:30:46.981402 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-dd911925-1fab-41d6-bbaa-7cebe8ffb966 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cb5b467a477f4519a9a9b2130ea62842'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:30:46.992245 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 908/1806] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Oct 12 02:30:46 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 02:30:46.994640 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-dd911925-1fab-41d6-bbaa-7cebe8ffb966 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cb5b467a477f4519a9a9b2130ea62842'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:30:46.996243 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c3ccff-3e45-4f27-bd14-90af86fad18f admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:30:47.001928 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-dd911925-1fab-41d6-bbaa-7cebe8ffb966 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cb5b467a477f4519a9a9b2130ea62842'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:30:47.002631 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-dd911925-1fab-41d6-bbaa-7cebe8ffb966 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cb5b467a477f4519a9a9b2130ea62842'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:30:47.006268 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c3ccff-3e45-4f27-bd14-90af86fad18f admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:30:47.008559 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 899/1807] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Oct 12 02:30:46 2022] DELETE /identity/v3/users/cb5b467a477f4519a9a9b2130ea62842 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 02:30:47.014825 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28ddcd9-6b03-4ff1-b2e4-1c5a548ee171 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:30:47.015525 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28ddcd9-6b03-4ff1-b2e4-1c5a548ee171 admin admin] REQUEST_METHOD: `PUT` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:47.015842 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28ddcd9-6b03-4ff1-b2e4-1c5a548ee171 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:47.016131 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28ddcd9-6b03-4ff1-b2e4-1c5a548ee171 admin admin] PATH_INFO: `/v3/projects/b59fd20d041341208dfcd08f6e01e0f2/users/d837a995ef98465e895f5a0bf7b7d349/roles/3d75c4d7f1a849b9a771504d1583ab28` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:47.032775 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28ddcd9-6b03-4ff1-b2e4-1c5a548ee171 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b59fd20d041341208dfcd08f6e01e0f2, user_id=d837a995ef98465e895f5a0bf7b7d349, role_id=3d75c4d7f1a849b9a771504d1583ab28)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:30:47.035797 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28ddcd9-6b03-4ff1-b2e4-1c5a548ee171 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:30:47.051174 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 909/1808] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Oct 12 02:30:46 2022] PUT /identity/v3/projects/b59fd20d041341208dfcd08f6e01e0f2/users/d837a995ef98465e895f5a0bf7b7d349/roles/3d75c4d7f1a849b9a771504d1583ab28 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 02:30:47.061967 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4b0081-51d1-48db-b18a-ad99c03baf83 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:47.062322 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4b0081-51d1-48db-b18a-ad99c03baf83 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:47.062634 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4b0081-51d1-48db-b18a-ad99c03baf83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:47.093837 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-db4b0081-51d1-48db-b18a-ad99c03baf83 None None] MFA Rules not processed for user `d837a995ef98465e895f5a0bf7b7d349`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:30:47.094972 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-db4b0081-51d1-48db-b18a-ad99c03baf83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:30:47.171633 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 900/1809] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 02:30:47 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 02:30:47.182560 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28ddcd9-6b03-4ff1-b2e4-1c5a548ee171 admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:30:47.184285 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-a28ddcd9-6b03-4ff1-b2e4-1c5a548ee171 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:30:47.255508 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28ddcd9-6b03-4ff1-b2e4-1c5a548ee171 admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:30:47.259536 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1020855-3d8d-40ed-b441-67657d387605 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ba688e0c4d44d13898539ee886f95fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'beb6def6fcad45959e56425bb8bff4d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:30:47.260045 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1020855-3d8d-40ed-b441-67657d387605 service cinder] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:47.260429 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1020855-3d8d-40ed-b441-67657d387605 service cinder] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:47.260700 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1020855-3d8d-40ed-b441-67657d387605 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:47.269938 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1020855-3d8d-40ed-b441-67657d387605 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:30:47.272202 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1020855-3d8d-40ed-b441-67657d387605 service cinder] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:30:47.286585 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 910/1810] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 02:30:47 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 02:30:47.289395 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4b0081-51d1-48db-b18a-ad99c03baf83 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:30:47.293712 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-db4b0081-51d1-48db-b18a-ad99c03baf83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:30:47.304320 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1020855-3d8d-40ed-b441-67657d387605 service cinder] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:30:47.306948 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-e1020855-3d8d-40ed-b441-67657d387605 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:30:47.386404 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4b0081-51d1-48db-b18a-ad99c03baf83 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:30:47.392525 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733b295e-2af0-49af-a968-e5bf55731b95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:30:47.393383 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733b295e-2af0-49af-a968-e5bf55731b95 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:47.393854 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733b295e-2af0-49af-a968-e5bf55731b95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:47.394314 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733b295e-2af0-49af-a968-e5bf55731b95 admin admin] PATH_INFO: `/v3/users/688074a000ed4c71bf67b7c961906f23` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:47.395687 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733b295e-2af0-49af-a968-e5bf55731b95 admin admin] RBAC: Authorizing `identity:delete_user(user_id=688074a000ed4c71bf67b7c961906f23)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:30:47.397461 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1020855-3d8d-40ed-b441-67657d387605 service cinder] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:30:47.398137 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733b295e-2af0-49af-a968-e5bf55731b95 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:30:47.403170 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deda046e-c8a4-4a77-810c-c289add72d9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:30:47.403867 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deda046e-c8a4-4a77-810c-c289add72d9d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:47.404139 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deda046e-c8a4-4a77-810c-c289add72d9d admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:47.404420 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deda046e-c8a4-4a77-810c-c289add72d9d admin admin] PATH_INFO: `/v3/projects/ae3bbb33c9e44fffbb522a6891c3b838` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:47.405717 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deda046e-c8a4-4a77-810c-c289add72d9d admin admin] RBAC: Authorizing `identity:delete_project(project_id=ae3bbb33c9e44fffbb522a6891c3b838)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:30:47.407785 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deda046e-c8a4-4a77-810c-c289add72d9d admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:30:47.445188 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:30:47.466061 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-deda046e-c8a4-4a77-810c-c289add72d9d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ae3bbb33c9e44fffbb522a6891c3b838', 'request_id': 'req-deda046e-c8a4-4a77-810c-c289add72d9d'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:30:47.466973 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-733b295e-2af0-49af-a968-e5bf55731b95 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '688074a000ed4c71bf67b7c961906f23'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:30:47.472660 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-deda046e-c8a4-4a77-810c-c289add72d9d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ae3bbb33c9e44fffbb522a6891c3b838', 'request_id': 'req-deda046e-c8a4-4a77-810c-c289add72d9d'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:30:47.474973 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=93,keystone:INSERT=1,keystone:DELETE=6 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:30:47.477610 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-733b295e-2af0-49af-a968-e5bf55731b95 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '688074a000ed4c71bf67b7c961906f23'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:30:47.481043 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-deda046e-c8a4-4a77-810c-c289add72d9d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ae3bbb33c9e44fffbb522a6891c3b838', 'request_id': 'req-deda046e-c8a4-4a77-810c-c289add72d9d'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:30:47.496249 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-733b295e-2af0-49af-a968-e5bf55731b95 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '688074a000ed4c71bf67b7c961906f23'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:30:47.496361 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-deda046e-c8a4-4a77-810c-c289add72d9d admin admin] The token cache is being invalidate because project ae3bbb33c9e44fffbb522a6891c3b838 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81361) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 02:30:47.496747 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-deda046e-c8a4-4a77-810c-c289add72d9d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:30:47.497517 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-deda046e-c8a4-4a77-810c-c289add72d9d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:30:47.499304 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 911/1811] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Oct 12 02:30:47 2022] DELETE /identity/v3/projects/ae3bbb33c9e44fffbb522a6891c3b838 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 02:30:47.504177 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ecdb97-8c3b-4452-b915-d611c802843d None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:47.504315 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-733b295e-2af0-49af-a968-e5bf55731b95 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '688074a000ed4c71bf67b7c961906f23'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:30:47.504486 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ecdb97-8c3b-4452-b915-d611c802843d None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:47.504778 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ecdb97-8c3b-4452-b915-d611c802843d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:47.505005 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-733b295e-2af0-49af-a968-e5bf55731b95 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '688074a000ed4c71bf67b7c961906f23'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:30:47.511661 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 901/1812] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Oct 12 02:30:47 2022] DELETE /identity/v3/users/688074a000ed4c71bf67b7c961906f23 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 02:30:47.516683 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f687fe17-392f-4d7f-8483-0698075f8389 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:47.516974 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f687fe17-392f-4d7f-8483-0698075f8389 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:47.517256 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f687fe17-392f-4d7f-8483-0698075f8389 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:47.531607 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-88ecdb97-8c3b-4452-b915-d611c802843d None None] MFA Rules not processed for user `a326a5bb7364479382f528a592371656`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:30:47.533426 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-88ecdb97-8c3b-4452-b915-d611c802843d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:30:47.546497 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-f687fe17-392f-4d7f-8483-0698075f8389 None None] MFA Rules not processed for user `a326a5bb7364479382f528a592371656`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:30:47.547984 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-f687fe17-392f-4d7f-8483-0698075f8389 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:30:47.624511 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 912/1813] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 02:30:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 02:30:47.630471 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcaf018-6e6f-4f91-9ef9-f0ee002e22ff None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:47.630864 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcaf018-6e6f-4f91-9ef9-f0ee002e22ff None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:47.631007 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcaf018-6e6f-4f91-9ef9-f0ee002e22ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:47.641574 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 902/1814] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 02:30:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 02:30:47.650327 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f687fe17-392f-4d7f-8483-0698075f8389 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:30:47.652382 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-f687fe17-392f-4d7f-8483-0698075f8389 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:30:47.661666 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-9bcaf018-6e6f-4f91-9ef9-f0ee002e22ff None None] MFA Rules not processed for user `a326a5bb7364479382f528a592371656`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:30:47.662873 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-9bcaf018-6e6f-4f91-9ef9-f0ee002e22ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:30:47.676958 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 913/1815] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 02:30:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 02:30:47.681714 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcaf018-6e6f-4f91-9ef9-f0ee002e22ff None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:30:47.695967 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcaf018-6e6f-4f91-9ef9-f0ee002e22ff None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:30:47.701707 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e9b51e-7fe0-4598-abbe-0fa100d26414 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:30:47.702347 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e9b51e-7fe0-4598-abbe-0fa100d26414 admin admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:47.702624 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e9b51e-7fe0-4598-abbe-0fa100d26414 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:47.702913 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e9b51e-7fe0-4598-abbe-0fa100d26414 admin admin] PATH_INFO: `/v3/domains` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:47.703565 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e9b51e-7fe0-4598-abbe-0fa100d26414 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 02:30:47.704032 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e9b51e-7fe0-4598-abbe-0fa100d26414 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:30:47.706150 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e9b51e-7fe0-4598-abbe-0fa100d26414 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:30:47.725026 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 914/1816] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Oct 12 02:30:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 02:30:47.728858 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e9b51e-7fe0-4598-abbe-0fa100d26414 admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:30:47.741896 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e9b51e-7fe0-4598-abbe-0fa100d26414 admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:30:47.742730 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f687fe17-392f-4d7f-8483-0698075f8389 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:30:47.746535 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ae2ffd-a1d7-4bca-b93d-b6f71620b3fc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5223b5cab3114e9b9a13c582f8ef8386', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'beb6def6fcad45959e56425bb8bff4d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:30:47.747163 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a603331-8e5d-4cf0-b21b-5ce2aa4645c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:30:47.747318 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ae2ffd-a1d7-4bca-b93d-b6f71620b3fc service neutron] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:47.747455 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ae2ffd-a1d7-4bca-b93d-b6f71620b3fc service neutron] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:47.747730 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ae2ffd-a1d7-4bca-b93d-b6f71620b3fc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:47.748004 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a603331-8e5d-4cf0-b21b-5ce2aa4645c8 admin admin] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:47.748340 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a603331-8e5d-4cf0-b21b-5ce2aa4645c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:47.748707 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a603331-8e5d-4cf0-b21b-5ce2aa4645c8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:47.749412 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a603331-8e5d-4cf0-b21b-5ce2aa4645c8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:30:47.751457 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a603331-8e5d-4cf0-b21b-5ce2aa4645c8 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:30:47.759727 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ae2ffd-a1d7-4bca-b93d-b6f71620b3fc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:30:47.761707 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ae2ffd-a1d7-4bca-b93d-b6f71620b3fc service neutron] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:30:47.773577 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 903/1817] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 02:30:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 02:30:47.784526 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 915/1818] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Oct 12 02:30:47 2022] POST /identity/v3/projects => generated 363 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 02:30:47.786734 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ae2ffd-a1d7-4bca-b93d-b6f71620b3fc service neutron] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:30:47.796711 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ae2ffd-a1d7-4bca-b93d-b6f71620b3fc service neutron] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:30:47.853335 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:30:47.862952 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2184d31-cdbc-4ac9-9bf1-c4c576d74edc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:30:47.864328 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2184d31-cdbc-4ac9-9bf1-c4c576d74edc admin admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:47.864767 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2184d31-cdbc-4ac9-9bf1-c4c576d74edc admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:47.865211 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2184d31-cdbc-4ac9-9bf1-c4c576d74edc admin admin] PATH_INFO: `/v3/users` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:47.866327 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2184d31-cdbc-4ac9-9bf1-c4c576d74edc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:30:47.868810 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2184d31-cdbc-4ac9-9bf1-c4c576d74edc admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:30:47.895470 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 904/1819] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Oct 12 02:30:47 2022] POST /identity/v3/users => generated 282 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 02:30:47.898488 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a603331-8e5d-4cf0-b21b-5ce2aa4645c8 admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:30:47.909468 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a603331-8e5d-4cf0-b21b-5ce2aa4645c8 admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:30:47.914192 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a590ab30-8eb2-47ba-a5d8-972388e22f7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:30:47.914804 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a590ab30-8eb2-47ba-a5d8-972388e22f7a admin admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:47.915082 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a590ab30-8eb2-47ba-a5d8-972388e22f7a admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:47.915353 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a590ab30-8eb2-47ba-a5d8-972388e22f7a admin admin] PATH_INFO: `/v3/roles` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:47.915993 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a590ab30-8eb2-47ba-a5d8-972388e22f7a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:30:47.917639 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a590ab30-8eb2-47ba-a5d8-972388e22f7a admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:30:47.928278 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 916/1820] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Oct 12 02:30:47 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 12 02:30:47.932668 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2184d31-cdbc-4ac9-9bf1-c4c576d74edc admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:30:47.943276 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2184d31-cdbc-4ac9-9bf1-c4c576d74edc admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:30:47.948593 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f8edc6-0714-43d7-b1ff-587c2943d6d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:30:47.949206 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f8edc6-0714-43d7-b1ff-587c2943d6d5 admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:47.949484 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f8edc6-0714-43d7-b1ff-587c2943d6d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:47.949765 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f8edc6-0714-43d7-b1ff-587c2943d6d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:47.951440 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f8edc6-0714-43d7-b1ff-587c2943d6d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:30:47.953073 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f8edc6-0714-43d7-b1ff-587c2943d6d5 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:30:47.971875 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 905/1821] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Oct 12 02:30:47 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 02:30:47.972759 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a590ab30-8eb2-47ba-a5d8-972388e22f7a admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:30:47.992328 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a590ab30-8eb2-47ba-a5d8-972388e22f7a admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:30:47.999102 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2c0c23-99c8-4dc2-9451-c33d8f660c4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:30:47.999102 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2c0c23-99c8-4dc2-9451-c33d8f660c4b admin admin] REQUEST_METHOD: `PUT` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:47.999368 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2c0c23-99c8-4dc2-9451-c33d8f660c4b admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:47.999954 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2c0c23-99c8-4dc2-9451-c33d8f660c4b admin admin] PATH_INFO: `/v3/projects/cfeb7d8affd14db994aa158801ce31dc/users/c60e565d2d51413c8098e0489967adfa/roles/3d75c4d7f1a849b9a771504d1583ab28` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:48.017013 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2c0c23-99c8-4dc2-9451-c33d8f660c4b admin admin] RBAC: Authorizing `identity:create_grant(project_id=cfeb7d8affd14db994aa158801ce31dc, user_id=c60e565d2d51413c8098e0489967adfa, role_id=3d75c4d7f1a849b9a771504d1583ab28)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:30:48.019636 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2c0c23-99c8-4dc2-9451-c33d8f660c4b admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:30:48.035777 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 917/1822] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Oct 12 02:30:47 2022] PUT /identity/v3/projects/cfeb7d8affd14db994aa158801ce31dc/users/c60e565d2d51413c8098e0489967adfa/roles/3d75c4d7f1a849b9a771504d1583ab28 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 02:30:48.047241 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba612720-babf-424e-afa4-7d6e4587f839 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:48.047525 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba612720-babf-424e-afa4-7d6e4587f839 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:48.047800 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba612720-babf-424e-afa4-7d6e4587f839 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:48.086651 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-ba612720-babf-424e-afa4-7d6e4587f839 None None] MFA Rules not processed for user `c60e565d2d51413c8098e0489967adfa`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:30:48.087471 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-ba612720-babf-424e-afa4-7d6e4587f839 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:30:48.117445 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2c0c23-99c8-4dc2-9451-c33d8f660c4b admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:30:48.119544 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-3a2c0c23-99c8-4dc2-9451-c33d8f660c4b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:30:48.182583 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 906/1823] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 02:30:48 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 02:30:48.187936 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba612720-babf-424e-afa4-7d6e4587f839 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:30:48.221903 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2c0c23-99c8-4dc2-9451-c33d8f660c4b admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:30:48.227393 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4f86e8-a2a9-44ee-9760-83c8be00615f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:30:48.228225 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4f86e8-a2a9-44ee-9760-83c8be00615f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:48.228674 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4f86e8-a2a9-44ee-9760-83c8be00615f admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:48.229024 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4f86e8-a2a9-44ee-9760-83c8be00615f admin admin] PATH_INFO: `/v3/projects/4ef94de53a124f48aebc558ccb721c7d` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:48.230431 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4f86e8-a2a9-44ee-9760-83c8be00615f admin admin] RBAC: Authorizing `identity:delete_project(project_id=4ef94de53a124f48aebc558ccb721c7d)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:30:48.233111 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4f86e8-a2a9-44ee-9760-83c8be00615f admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:30:48.257458 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:30:48.274749 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba612720-babf-424e-afa4-7d6e4587f839 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:30:48.281469 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a89e42c-1d7a-4128-ba6f-6f9902d107a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:30:48.282184 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a89e42c-1d7a-4128-ba6f-6f9902d107a4 admin admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:48.282436 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a89e42c-1d7a-4128-ba6f-6f9902d107a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:48.282712 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a89e42c-1d7a-4128-ba6f-6f9902d107a4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:48.283546 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a89e42c-1d7a-4128-ba6f-6f9902d107a4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:30:48.285699 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a89e42c-1d7a-4128-ba6f-6f9902d107a4 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:30:48.300600 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-8b4f86e8-a2a9-44ee-9760-83c8be00615f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4ef94de53a124f48aebc558ccb721c7d', 'request_id': 'req-8b4f86e8-a2a9-44ee-9760-83c8be00615f'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:30:48.306943 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-8b4f86e8-a2a9-44ee-9760-83c8be00615f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4ef94de53a124f48aebc558ccb721c7d', 'request_id': 'req-8b4f86e8-a2a9-44ee-9760-83c8be00615f'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:30:48.314559 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-8b4f86e8-a2a9-44ee-9760-83c8be00615f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4ef94de53a124f48aebc558ccb721c7d', 'request_id': 'req-8b4f86e8-a2a9-44ee-9760-83c8be00615f'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:30:48.319955 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 907/1824] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Oct 12 02:30:48 2022] POST /identity/v3/projects => generated 365 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 02:30:48.324288 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a89e42c-1d7a-4128-ba6f-6f9902d107a4 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:30:48.332224 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-8b4f86e8-a2a9-44ee-9760-83c8be00615f admin admin] The token cache is being invalidate because project 4ef94de53a124f48aebc558ccb721c7d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81361) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 02:30:48.332571 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-8b4f86e8-a2a9-44ee-9760-83c8be00615f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:30:48.333277 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-8b4f86e8-a2a9-44ee-9760-83c8be00615f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:30:48.335330 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 918/1825] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Oct 12 02:30:48 2022] DELETE /identity/v3/projects/4ef94de53a124f48aebc558ccb721c7d => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 02:30:48.339082 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4f86e8-a2a9-44ee-9760-83c8be00615f admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:30:48.340569 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-8b4f86e8-a2a9-44ee-9760-83c8be00615f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:30:48.393556 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:30:48.408130 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a89e42c-1d7a-4128-ba6f-6f9902d107a4 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:30:48.413004 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fcf0f6-cda2-484f-aef2-3753731e4bb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:30:48.413627 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fcf0f6-cda2-484f-aef2-3753731e4bb0 admin admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:48.413903 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fcf0f6-cda2-484f-aef2-3753731e4bb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:48.414173 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fcf0f6-cda2-484f-aef2-3753731e4bb0 admin admin] PATH_INFO: `/v3/users` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:48.414808 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9fcf0f6-cda2-484f-aef2-3753731e4bb0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:30:48.416733 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9fcf0f6-cda2-484f-aef2-3753731e4bb0 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:30:48.418104 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4f86e8-a2a9-44ee-9760-83c8be00615f admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:30:48.424178 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3154269-de4d-42d0-9344-c980026843e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:30:48.424913 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3154269-de4d-42d0-9344-c980026843e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:48.425196 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3154269-de4d-42d0-9344-c980026843e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:48.425478 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3154269-de4d-42d0-9344-c980026843e6 admin admin] PATH_INFO: `/v3/users/61de5d3d67d54f189becc39811bc2bd5` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:48.427168 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3154269-de4d-42d0-9344-c980026843e6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=61de5d3d67d54f189becc39811bc2bd5)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:30:48.429095 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3154269-de4d-42d0-9344-c980026843e6 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:30:48.441695 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 908/1826] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Oct 12 02:30:48 2022] POST /identity/v3/users => generated 289 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 02:30:48.445459 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fcf0f6-cda2-484f-aef2-3753731e4bb0 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:30:48.447195 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-a9fcf0f6-cda2-484f-aef2-3753731e4bb0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:30:48.460113 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fcf0f6-cda2-484f-aef2-3753731e4bb0 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:30:48.465812 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b30431-0449-4b9c-babc-5b497945c51d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:30:48.466574 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b30431-0449-4b9c-babc-5b497945c51d admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:48.467043 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b30431-0449-4b9c-babc-5b497945c51d admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:48.467460 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b30431-0449-4b9c-babc-5b497945c51d admin admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:48.468244 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b30431-0449-4b9c-babc-5b497945c51d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:30:48.470156 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b30431-0449-4b9c-babc-5b497945c51d admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:30:48.483427 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 909/1827] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Oct 12 02:30:48 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 02:30:48.487631 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b30431-0449-4b9c-babc-5b497945c51d admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:30:48.489969 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-f3154269-de4d-42d0-9344-c980026843e6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '61de5d3d67d54f189becc39811bc2bd5'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:30:48.499907 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-f3154269-de4d-42d0-9344-c980026843e6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '61de5d3d67d54f189becc39811bc2bd5'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:30:48.509985 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b30431-0449-4b9c-babc-5b497945c51d admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:30:48.512835 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-f3154269-de4d-42d0-9344-c980026843e6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '61de5d3d67d54f189becc39811bc2bd5'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:30:48.515101 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501fd981-a6af-4837-90b3-3c4f79109e51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:30:48.515786 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501fd981-a6af-4837-90b3-3c4f79109e51 admin admin] REQUEST_METHOD: `PUT` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:48.516071 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501fd981-a6af-4837-90b3-3c4f79109e51 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:48.516347 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501fd981-a6af-4837-90b3-3c4f79109e51 admin admin] PATH_INFO: `/v3/projects/654682e30cb84b2a95ced260ec4716fe/users/f7194e58f6b14b54aadc27d13e2c02df/roles/39b1e8108dff402383def3c559f48189` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:48.519912 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-f3154269-de4d-42d0-9344-c980026843e6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '61de5d3d67d54f189becc39811bc2bd5'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:30:48.520646 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-f3154269-de4d-42d0-9344-c980026843e6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '61de5d3d67d54f189becc39811bc2bd5'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:30:48.526877 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 919/1828] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Oct 12 02:30:48 2022] DELETE /identity/v3/users/61de5d3d67d54f189becc39811bc2bd5 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 02:30:48.534457 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501fd981-a6af-4837-90b3-3c4f79109e51 admin admin] RBAC: Authorizing `identity:create_grant(project_id=654682e30cb84b2a95ced260ec4716fe, user_id=f7194e58f6b14b54aadc27d13e2c02df, role_id=39b1e8108dff402383def3c559f48189)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:30:48.537646 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501fd981-a6af-4837-90b3-3c4f79109e51 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:30:48.552356 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 910/1829] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Oct 12 02:30:48 2022] PUT /identity/v3/projects/654682e30cb84b2a95ced260ec4716fe/users/f7194e58f6b14b54aadc27d13e2c02df/roles/39b1e8108dff402383def3c559f48189 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 02:30:48.556452 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3154269-de4d-42d0-9344-c980026843e6 admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:30:48.558004 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-f3154269-de4d-42d0-9344-c980026843e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:30:48.588398 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:30:48.633785 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3154269-de4d-42d0-9344-c980026843e6 admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:30:48.734940 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d46a34-e64f-4311-aaec-d34058c9336d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:30:48.735637 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d46a34-e64f-4311-aaec-d34058c9336d admin admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:48.736461 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d46a34-e64f-4311-aaec-d34058c9336d admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:48.736832 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d46a34-e64f-4311-aaec-d34058c9336d admin admin] PATH_INFO: `/v3/roles` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:48.737622 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d46a34-e64f-4311-aaec-d34058c9336d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:30:48.739824 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d46a34-e64f-4311-aaec-d34058c9336d admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:30:48.754648 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 920/1830] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Oct 12 02:30:48 2022] GET /identity/v3/roles => generated 1420 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 02:30:48.755905 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501fd981-a6af-4837-90b3-3c4f79109e51 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:30:48.770791 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501fd981-a6af-4837-90b3-3c4f79109e51 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:30:48.777167 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eeb2f4e-6775-40ff-9115-2b1fd5c63634 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:30:48.777430 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eeb2f4e-6775-40ff-9115-2b1fd5c63634 admin admin] REQUEST_METHOD: `PUT` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:48.777715 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eeb2f4e-6775-40ff-9115-2b1fd5c63634 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:48.778043 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eeb2f4e-6775-40ff-9115-2b1fd5c63634 admin admin] PATH_INFO: `/v3/projects/654682e30cb84b2a95ced260ec4716fe/users/f7194e58f6b14b54aadc27d13e2c02df/roles/39b1e8108dff402383def3c559f48189` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:48.781352 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eeb2f4e-6775-40ff-9115-2b1fd5c63634 admin admin] RBAC: Authorizing `identity:create_grant(project_id=654682e30cb84b2a95ced260ec4716fe, user_id=f7194e58f6b14b54aadc27d13e2c02df, role_id=39b1e8108dff402383def3c559f48189)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:30:48.784690 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eeb2f4e-6775-40ff-9115-2b1fd5c63634 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:30:48.803018 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 911/1831] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Oct 12 02:30:48 2022] PUT /identity/v3/projects/654682e30cb84b2a95ced260ec4716fe/users/f7194e58f6b14b54aadc27d13e2c02df/roles/39b1e8108dff402383def3c559f48189 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 02:30:48.815478 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf60479-f415-43df-9066-f73fccb02500 None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:48.816049 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf60479-f415-43df-9066-f73fccb02500 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:48.816550 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf60479-f415-43df-9066-f73fccb02500 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:48.827226 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eeb2f4e-6775-40ff-9115-2b1fd5c63634 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:30:48.828982 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-9eeb2f4e-6775-40ff-9115-2b1fd5c63634 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:30:48.849857 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-7cf60479-f415-43df-9066-f73fccb02500 None None] MFA Rules not processed for user `f7194e58f6b14b54aadc27d13e2c02df`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:30:48.851081 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-7cf60479-f415-43df-9066-f73fccb02500 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:30:48.937231 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eeb2f4e-6775-40ff-9115-2b1fd5c63634 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:30:48.942022 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171b793b-6c90-443a-8ade-39a951dff106 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:30:48.942666 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171b793b-6c90-443a-8ade-39a951dff106 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:48.942947 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171b793b-6c90-443a-8ade-39a951dff106 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:48.943216 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171b793b-6c90-443a-8ade-39a951dff106 admin admin] PATH_INFO: `/v3/projects/594f4f82f872445db47cb8707e4d558f` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:48.944534 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171b793b-6c90-443a-8ade-39a951dff106 admin admin] RBAC: Authorizing `identity:delete_project(project_id=594f4f82f872445db47cb8707e4d558f)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:30:48.946760 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171b793b-6c90-443a-8ade-39a951dff106 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:30:48.952132 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 921/1832] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 02:30:48 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 02:30:48.963356 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf60479-f415-43df-9066-f73fccb02500 None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:30:48.967352 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-7cf60479-f415-43df-9066-f73fccb02500 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:30:49.036080 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-171b793b-6c90-443a-8ade-39a951dff106 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '594f4f82f872445db47cb8707e4d558f', 'request_id': 'req-171b793b-6c90-443a-8ade-39a951dff106'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:30:49.049846 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-171b793b-6c90-443a-8ade-39a951dff106 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '594f4f82f872445db47cb8707e4d558f', 'request_id': 'req-171b793b-6c90-443a-8ade-39a951dff106'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:30:49.057838 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-171b793b-6c90-443a-8ade-39a951dff106 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '594f4f82f872445db47cb8707e4d558f', 'request_id': 'req-171b793b-6c90-443a-8ade-39a951dff106'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:30:49.083280 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-171b793b-6c90-443a-8ade-39a951dff106 admin admin] The token cache is being invalidate because project 594f4f82f872445db47cb8707e4d558f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81362) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 02:30:49.084318 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf60479-f415-43df-9066-f73fccb02500 None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:30:49.084794 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-171b793b-6c90-443a-8ade-39a951dff106 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:30:49.089056 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:30:49.091709 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-171b793b-6c90-443a-8ade-39a951dff106 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:30:49.093777 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 912/1833] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Oct 12 02:30:48 2022] DELETE /identity/v3/projects/594f4f82f872445db47cb8707e4d558f => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 02:30:49.097525 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171b793b-6c90-443a-8ade-39a951dff106 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:30:49.098948 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-171b793b-6c90-443a-8ade-39a951dff106 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:30:49.134964 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=87,keystone:INSERT=6,keystone:DELETE=7 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:30:49.164999 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da995fe-7111-44e6-b81c-10e698795139 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ba688e0c4d44d13898539ee886f95fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'beb6def6fcad45959e56425bb8bff4d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:30:49.165645 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da995fe-7111-44e6-b81c-10e698795139 service cinder] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:49.165950 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da995fe-7111-44e6-b81c-10e698795139 service cinder] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:49.166251 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da995fe-7111-44e6-b81c-10e698795139 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:49.169267 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-4da995fe-7111-44e6-b81c-10e698795139 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:30:49.190696 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171b793b-6c90-443a-8ade-39a951dff106 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:30:49.197213 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee48496d-5b8f-404c-9240-2da0a5be6863 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:30:49.198336 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee48496d-5b8f-404c-9240-2da0a5be6863 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:49.198712 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee48496d-5b8f-404c-9240-2da0a5be6863 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:49.199085 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee48496d-5b8f-404c-9240-2da0a5be6863 admin admin] PATH_INFO: `/v3/users/3bb874e2507a4352b1219063f90419a7` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:49.201461 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee48496d-5b8f-404c-9240-2da0a5be6863 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3bb874e2507a4352b1219063f90419a7)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:30:49.203779 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee48496d-5b8f-404c-9240-2da0a5be6863 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:30:49.247938 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da995fe-7111-44e6-b81c-10e698795139 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:30:49.249481 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da995fe-7111-44e6-b81c-10e698795139 service cinder] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:30:49.260620 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-ee48496d-5b8f-404c-9240-2da0a5be6863 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3bb874e2507a4352b1219063f90419a7'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:30:49.260812 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 922/1834] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 02:30:48 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 12 02:30:49.272614 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-ee48496d-5b8f-404c-9240-2da0a5be6863 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3bb874e2507a4352b1219063f90419a7'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:30:49.287771 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-ee48496d-5b8f-404c-9240-2da0a5be6863 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3bb874e2507a4352b1219063f90419a7'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:30:49.297463 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-ee48496d-5b8f-404c-9240-2da0a5be6863 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3bb874e2507a4352b1219063f90419a7'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:30:49.298232 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-ee48496d-5b8f-404c-9240-2da0a5be6863 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3bb874e2507a4352b1219063f90419a7'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:30:49.305993 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 913/1835] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Oct 12 02:30:49 2022] DELETE /identity/v3/users/3bb874e2507a4352b1219063f90419a7 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 02:30:49.639722 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da995fe-7111-44e6-b81c-10e698795139 service cinder] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:30:49.639883 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee48496d-5b8f-404c-9240-2da0a5be6863 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:30:49.641552 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-ee48496d-5b8f-404c-9240-2da0a5be6863 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:30:49.659083 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da995fe-7111-44e6-b81c-10e698795139 service cinder] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:30:49.738611 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d38286-56e8-421f-9606-4cc2349ed979 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:30:49.739357 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d38286-56e8-421f-9606-4cc2349ed979 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:49.739519 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d38286-56e8-421f-9606-4cc2349ed979 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:49.739794 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d38286-56e8-421f-9606-4cc2349ed979 admin admin] PATH_INFO: `/v3/projects/9938805bef994c5da73354fc68fa93d6` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:49.740950 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d38286-56e8-421f-9606-4cc2349ed979 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9938805bef994c5da73354fc68fa93d6)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:30:49.742858 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d38286-56e8-421f-9606-4cc2349ed979 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:30:49.744099 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee48496d-5b8f-404c-9240-2da0a5be6863 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:30:49.751531 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accdd84d-8861-4034-a8c0-a66abc23aa21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:30:49.752539 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accdd84d-8861-4034-a8c0-a66abc23aa21 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:49.753952 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accdd84d-8861-4034-a8c0-a66abc23aa21 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:49.753952 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accdd84d-8861-4034-a8c0-a66abc23aa21 admin admin] PATH_INFO: `/v3/users/1803517e51e64bfdb54fd139ed680a3d` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:49.755622 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-accdd84d-8861-4034-a8c0-a66abc23aa21 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1803517e51e64bfdb54fd139ed680a3d)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:30:49.757929 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-accdd84d-8861-4034-a8c0-a66abc23aa21 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:30:49.806702 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-46d38286-56e8-421f-9606-4cc2349ed979 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9938805bef994c5da73354fc68fa93d6', 'request_id': 'req-46d38286-56e8-421f-9606-4cc2349ed979'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:30:49.810759 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:30:49.813191 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-46d38286-56e8-421f-9606-4cc2349ed979 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9938805bef994c5da73354fc68fa93d6', 'request_id': 'req-46d38286-56e8-421f-9606-4cc2349ed979'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:30:49.813962 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-accdd84d-8861-4034-a8c0-a66abc23aa21 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1803517e51e64bfdb54fd139ed680a3d'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:30:49.814380 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:30:49.822020 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-46d38286-56e8-421f-9606-4cc2349ed979 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9938805bef994c5da73354fc68fa93d6', 'request_id': 'req-46d38286-56e8-421f-9606-4cc2349ed979'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:30:49.823678 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-accdd84d-8861-4034-a8c0-a66abc23aa21 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1803517e51e64bfdb54fd139ed680a3d'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:30:49.835331 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-46d38286-56e8-421f-9606-4cc2349ed979 admin admin] The token cache is being invalidate because project 9938805bef994c5da73354fc68fa93d6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81361) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 02:30:49.835620 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-46d38286-56e8-421f-9606-4cc2349ed979 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:30:49.836247 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-46d38286-56e8-421f-9606-4cc2349ed979 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:30:49.837743 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-accdd84d-8861-4034-a8c0-a66abc23aa21 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1803517e51e64bfdb54fd139ed680a3d'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:30:49.837856 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 923/1836] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Oct 12 02:30:49 2022] DELETE /identity/v3/projects/9938805bef994c5da73354fc68fa93d6 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 02:30:49.842146 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d38286-56e8-421f-9606-4cc2349ed979 admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:30:49.843428 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-46d38286-56e8-421f-9606-4cc2349ed979 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:30:49.847118 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-accdd84d-8861-4034-a8c0-a66abc23aa21 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1803517e51e64bfdb54fd139ed680a3d'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:30:49.847793 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-accdd84d-8861-4034-a8c0-a66abc23aa21 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1803517e51e64bfdb54fd139ed680a3d'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:30:49.854271 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 914/1837] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Oct 12 02:30:49 2022] DELETE /identity/v3/users/1803517e51e64bfdb54fd139ed680a3d => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 02:30:49.858614 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909cb54a-502e-4c12-8853-b5f796286f71 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:49.858974 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909cb54a-502e-4c12-8853-b5f796286f71 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:49.859568 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909cb54a-502e-4c12-8853-b5f796286f71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:49.882467 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-909cb54a-502e-4c12-8853-b5f796286f71 None None] MFA Rules not processed for user `a326a5bb7364479382f528a592371656`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:30:49.882993 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-909cb54a-502e-4c12-8853-b5f796286f71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:30:49.911687 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d38286-56e8-421f-9606-4cc2349ed979 admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:30:49.947335 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 915/1838] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 02:30:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 02:30:49.954268 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a3828c-6565-4434-87d5-7cba0df40ef1 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:49.954561 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a3828c-6565-4434-87d5-7cba0df40ef1 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:49.954840 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a3828c-6565-4434-87d5-7cba0df40ef1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:49.968395 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e37b87-84ec-481f-8e65-8933efcdbcb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:30:49.969062 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e37b87-84ec-481f-8e65-8933efcdbcb4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:49.969344 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e37b87-84ec-481f-8e65-8933efcdbcb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:49.969613 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e37b87-84ec-481f-8e65-8933efcdbcb4 admin admin] PATH_INFO: `/v3/users/c60e565d2d51413c8098e0489967adfa` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:49.970750 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e37b87-84ec-481f-8e65-8933efcdbcb4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c60e565d2d51413c8098e0489967adfa)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:30:49.972879 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e37b87-84ec-481f-8e65-8933efcdbcb4 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:30:49.975164 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-31a3828c-6565-4434-87d5-7cba0df40ef1 None None] MFA Rules not processed for user `a326a5bb7364479382f528a592371656`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:30:49.976378 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-31a3828c-6565-4434-87d5-7cba0df40ef1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:30:49.986279 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 916/1839] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 02:30:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 02:30:49.989573 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c603cf7f-b3dd-4a3c-8544-ae90136b8cf8 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:49.989573 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c603cf7f-b3dd-4a3c-8544-ae90136b8cf8 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:49.989573 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c603cf7f-b3dd-4a3c-8544-ae90136b8cf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:50.011742 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-c603cf7f-b3dd-4a3c-8544-ae90136b8cf8 None None] MFA Rules not processed for user `a326a5bb7364479382f528a592371656`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:30:50.013784 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-c603cf7f-b3dd-4a3c-8544-ae90136b8cf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:30:50.021834 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 917/1840] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 02:30:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 02:30:50.022614 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c603cf7f-b3dd-4a3c-8544-ae90136b8cf8 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:30:50.023820 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-c603cf7f-b3dd-4a3c-8544-ae90136b8cf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:30:50.026320 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-e9e37b87-84ec-481f-8e65-8933efcdbcb4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c60e565d2d51413c8098e0489967adfa'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:30:50.035077 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-e9e37b87-84ec-481f-8e65-8933efcdbcb4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c60e565d2d51413c8098e0489967adfa'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:30:50.049924 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-e9e37b87-84ec-481f-8e65-8933efcdbcb4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c60e565d2d51413c8098e0489967adfa'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:30:50.057123 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-e9e37b87-84ec-481f-8e65-8933efcdbcb4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c60e565d2d51413c8098e0489967adfa'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:30:50.057866 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-e9e37b87-84ec-481f-8e65-8933efcdbcb4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c60e565d2d51413c8098e0489967adfa'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:30:50.065076 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 924/1841] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Oct 12 02:30:49 2022] DELETE /identity/v3/users/c60e565d2d51413c8098e0489967adfa => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 02:30:50.066329 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e37b87-84ec-481f-8e65-8933efcdbcb4 admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:30:50.067651 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-e9e37b87-84ec-481f-8e65-8933efcdbcb4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:30:50.082445 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:30:50.087583 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c603cf7f-b3dd-4a3c-8544-ae90136b8cf8 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:30:50.140297 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e37b87-84ec-481f-8e65-8933efcdbcb4 admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:30:50.141488 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae77983-0c61-4e63-8cc2-d51053c9e4bb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5223b5cab3114e9b9a13c582f8ef8386', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'beb6def6fcad45959e56425bb8bff4d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:30:50.142239 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae77983-0c61-4e63-8cc2-d51053c9e4bb service neutron] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:50.142582 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae77983-0c61-4e63-8cc2-d51053c9e4bb service neutron] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:50.142862 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae77983-0c61-4e63-8cc2-d51053c9e4bb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:50.145258 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-0ae77983-0c61-4e63-8cc2-d51053c9e4bb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:30:50.145599 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c355ec59-5779-4119-995b-11261e92b39a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:30:50.146203 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c355ec59-5779-4119-995b-11261e92b39a admin admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:50.146510 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c355ec59-5779-4119-995b-11261e92b39a admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:50.147030 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c355ec59-5779-4119-995b-11261e92b39a admin admin] PATH_INFO: `/v3/domains` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:50.147966 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c355ec59-5779-4119-995b-11261e92b39a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 02:30:50.147966 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c355ec59-5779-4119-995b-11261e92b39a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:30:50.149594 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c355ec59-5779-4119-995b-11261e92b39a admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:30:50.162420 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae77983-0c61-4e63-8cc2-d51053c9e4bb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:30:50.163702 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 925/1842] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Oct 12 02:30:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 02:30:50.163867 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae77983-0c61-4e63-8cc2-d51053c9e4bb service neutron] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:30:50.165043 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9a3e9b-836c-4b6c-ac70-8709008247e1 None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:50.165325 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9a3e9b-836c-4b6c-ac70-8709008247e1 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:50.165599 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9a3e9b-836c-4b6c-ac70-8709008247e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:50.175773 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 918/1843] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 02:30:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 02:30:50.176622 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae77983-0c61-4e63-8cc2-d51053c9e4bb service neutron] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:30:50.186581 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae77983-0c61-4e63-8cc2-d51053c9e4bb service neutron] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:30:50.187503 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-1d9a3e9b-836c-4b6c-ac70-8709008247e1 None None] MFA Rules not processed for user `a326a5bb7364479382f528a592371656`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:30:50.188750 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-1d9a3e9b-836c-4b6c-ac70-8709008247e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:30:50.191516 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5012ff-2a0a-4712-8e17-7434c235dec6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:30:50.192392 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5012ff-2a0a-4712-8e17-7434c235dec6 admin admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:50.192610 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5012ff-2a0a-4712-8e17-7434c235dec6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:50.193041 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5012ff-2a0a-4712-8e17-7434c235dec6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:50.193783 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5012ff-2a0a-4712-8e17-7434c235dec6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:30:50.195899 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5012ff-2a0a-4712-8e17-7434c235dec6 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:30:50.197226 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 926/1844] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 02:30:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 02:30:50.204362 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:DELETE=4,keystone:SELECT=95,keystone:INSERT=1 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:30:50.222683 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9a3e9b-836c-4b6c-ac70-8709008247e1 None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:30:50.225158 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-1d9a3e9b-836c-4b6c-ac70-8709008247e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:30:50.237469 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 919/1845] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Oct 12 02:30:50 2022] POST /identity/v3/projects => generated 385 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 02:30:50.245572 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5012ff-2a0a-4712-8e17-7434c235dec6 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:30:50.249454 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9a3e9b-836c-4b6c-ac70-8709008247e1 None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:30:50.318850 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1b2a06-43d3-4ad7-b7ae-6076d5c58215 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5223b5cab3114e9b9a13c582f8ef8386', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'beb6def6fcad45959e56425bb8bff4d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:30:50.319473 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1b2a06-43d3-4ad7-b7ae-6076d5c58215 service neutron] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:50.319748 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1b2a06-43d3-4ad7-b7ae-6076d5c58215 service neutron] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:50.320523 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1b2a06-43d3-4ad7-b7ae-6076d5c58215 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:50.334781 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5012ff-2a0a-4712-8e17-7434c235dec6 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:30:50.340324 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a2b71d-4dec-41c3-b031-933a2a795969 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:30:50.341580 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a2b71d-4dec-41c3-b031-933a2a795969 admin admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:50.341897 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a2b71d-4dec-41c3-b031-933a2a795969 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:50.342123 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a2b71d-4dec-41c3-b031-933a2a795969 admin admin] PATH_INFO: `/v3/users` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:50.342830 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a2b71d-4dec-41c3-b031-933a2a795969 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:30:50.343261 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1b2a06-43d3-4ad7-b7ae-6076d5c58215 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:30:50.344721 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a2b71d-4dec-41c3-b031-933a2a795969 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:30:50.344907 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1b2a06-43d3-4ad7-b7ae-6076d5c58215 service neutron] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:30:50.357151 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 927/1846] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 02:30:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 12 02:30:50.371378 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 920/1847] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Oct 12 02:30:50 2022] POST /identity/v3/users => generated 293 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 02:30:50.375354 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1b2a06-43d3-4ad7-b7ae-6076d5c58215 service neutron] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:30:50.384890 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1b2a06-43d3-4ad7-b7ae-6076d5c58215 service neutron] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:30:50.389453 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79af00b3-181b-4b4c-b7fc-9274f5589174 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:30:50.390053 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79af00b3-181b-4b4c-b7fc-9274f5589174 admin admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:50.390320 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79af00b3-181b-4b4c-b7fc-9274f5589174 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:50.390587 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79af00b3-181b-4b4c-b7fc-9274f5589174 admin admin] PATH_INFO: `/v3/roles` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:50.391222 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79af00b3-181b-4b4c-b7fc-9274f5589174 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:30:50.392844 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79af00b3-181b-4b4c-b7fc-9274f5589174 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:30:50.406328 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 928/1848] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Oct 12 02:30:50 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 02:30:50.407595 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a2b71d-4dec-41c3-b031-933a2a795969 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:30:50.424292 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a2b71d-4dec-41c3-b031-933a2a795969 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:30:50.430251 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127e5581-c2cb-4a1c-bd21-5851aaafd42f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:30:50.430855 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127e5581-c2cb-4a1c-bd21-5851aaafd42f admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:50.431131 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127e5581-c2cb-4a1c-bd21-5851aaafd42f admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:50.431533 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127e5581-c2cb-4a1c-bd21-5851aaafd42f admin admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:50.432186 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127e5581-c2cb-4a1c-bd21-5851aaafd42f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:30:50.433867 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127e5581-c2cb-4a1c-bd21-5851aaafd42f admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:30:50.445653 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 921/1849] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Oct 12 02:30:50 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 02:30:50.451167 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79af00b3-181b-4b4c-b7fc-9274f5589174 admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:30:50.463050 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79af00b3-181b-4b4c-b7fc-9274f5589174 admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:30:50.473245 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e412a3e-febf-4003-bba2-eb3bad7e59b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:30:50.473938 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e412a3e-febf-4003-bba2-eb3bad7e59b2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:50.474221 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e412a3e-febf-4003-bba2-eb3bad7e59b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:50.474494 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e412a3e-febf-4003-bba2-eb3bad7e59b2 admin admin] PATH_INFO: `/v3/projects/cdb53abae8714f59829f6d90874d25ea/users/7a9ab860b4294375bf1bc1758e345644/roles/3d75c4d7f1a849b9a771504d1583ab28` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:50.493163 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e412a3e-febf-4003-bba2-eb3bad7e59b2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cdb53abae8714f59829f6d90874d25ea, user_id=7a9ab860b4294375bf1bc1758e345644, role_id=3d75c4d7f1a849b9a771504d1583ab28)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:30:50.496071 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e412a3e-febf-4003-bba2-eb3bad7e59b2 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:30:50.514613 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 929/1850] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Oct 12 02:30:50 2022] PUT /identity/v3/projects/cdb53abae8714f59829f6d90874d25ea/users/7a9ab860b4294375bf1bc1758e345644/roles/3d75c4d7f1a849b9a771504d1583ab28 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 02:30:50.519782 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e72ecd2-e755-4b54-b259-17c00c8a1321 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:50.520072 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e72ecd2-e755-4b54-b259-17c00c8a1321 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:50.520600 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e72ecd2-e755-4b54-b259-17c00c8a1321 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:50.552011 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-4e72ecd2-e755-4b54-b259-17c00c8a1321 None None] MFA Rules not processed for user `a326a5bb7364479382f528a592371656`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:30:50.553990 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-4e72ecd2-e755-4b54-b259-17c00c8a1321 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:30:50.580171 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e412a3e-febf-4003-bba2-eb3bad7e59b2 admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:30:50.582455 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-7e412a3e-febf-4003-bba2-eb3bad7e59b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:30:50.654963 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 922/1851] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 02:30:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 02:30:50.656028 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e72ecd2-e755-4b54-b259-17c00c8a1321 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:30:50.657644 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-4e72ecd2-e755-4b54-b259-17c00c8a1321 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:30:50.664101 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e412a3e-febf-4003-bba2-eb3bad7e59b2 admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:30:50.670120 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1e71b2-8f0f-4cc7-8c1c-7315349fb0bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:30:50.670850 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1e71b2-8f0f-4cc7-8c1c-7315349fb0bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:50.670990 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e72ecd2-e755-4b54-b259-17c00c8a1321 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:30:50.671075 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1e71b2-8f0f-4cc7-8c1c-7315349fb0bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:50.671288 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1e71b2-8f0f-4cc7-8c1c-7315349fb0bc admin admin] PATH_INFO: `/v3/projects/1b103f7839a2419b82edeac9652b0373` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:50.672404 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1e71b2-8f0f-4cc7-8c1c-7315349fb0bc admin admin] RBAC: Authorizing `identity:delete_project(project_id=1b103f7839a2419b82edeac9652b0373)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:30:50.674329 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1e71b2-8f0f-4cc7-8c1c-7315349fb0bc admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:30:50.675560 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f00c53a-2150-45e1-b619-8e79237d515e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:30:50.676518 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f00c53a-2150-45e1-b619-8e79237d515e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:50.676630 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f00c53a-2150-45e1-b619-8e79237d515e admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:50.677072 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f00c53a-2150-45e1-b619-8e79237d515e admin admin] PATH_INFO: `/v3/users/d837a995ef98465e895f5a0bf7b7d349` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:50.677976 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f00c53a-2150-45e1-b619-8e79237d515e admin admin] RBAC: Authorizing `identity:delete_user(user_id=d837a995ef98465e895f5a0bf7b7d349)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:30:50.679881 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f00c53a-2150-45e1-b619-8e79237d515e admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:30:50.696559 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:30:50.746294 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-1f00c53a-2150-45e1-b619-8e79237d515e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd837a995ef98465e895f5a0bf7b7d349'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:30:50.754727 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-1f00c53a-2150-45e1-b619-8e79237d515e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd837a995ef98465e895f5a0bf7b7d349'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:30:50.759306 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=87,keystone:INSERT=5,keystone:DELETE=8 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:30:50.766924 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-9a1e71b2-8f0f-4cc7-8c1c-7315349fb0bc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1b103f7839a2419b82edeac9652b0373', 'request_id': 'req-9a1e71b2-8f0f-4cc7-8c1c-7315349fb0bc'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:30:50.770074 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-1f00c53a-2150-45e1-b619-8e79237d515e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd837a995ef98465e895f5a0bf7b7d349'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:30:50.772684 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-9a1e71b2-8f0f-4cc7-8c1c-7315349fb0bc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1b103f7839a2419b82edeac9652b0373', 'request_id': 'req-9a1e71b2-8f0f-4cc7-8c1c-7315349fb0bc'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:30:50.777888 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-1f00c53a-2150-45e1-b619-8e79237d515e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd837a995ef98465e895f5a0bf7b7d349'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:30:50.778732 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-1f00c53a-2150-45e1-b619-8e79237d515e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd837a995ef98465e895f5a0bf7b7d349'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:30:50.779546 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-9a1e71b2-8f0f-4cc7-8c1c-7315349fb0bc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1b103f7839a2419b82edeac9652b0373', 'request_id': 'req-9a1e71b2-8f0f-4cc7-8c1c-7315349fb0bc'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:30:50.785123 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 923/1852] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Oct 12 02:30:50 2022] DELETE /identity/v3/users/d837a995ef98465e895f5a0bf7b7d349 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 02:30:50.788239 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f00c53a-2150-45e1-b619-8e79237d515e admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:30:50.788239 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-1f00c53a-2150-45e1-b619-8e79237d515e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:30:50.794886 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-9a1e71b2-8f0f-4cc7-8c1c-7315349fb0bc admin admin] The token cache is being invalidate because project 1b103f7839a2419b82edeac9652b0373 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81361) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 02:30:50.794886 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-9a1e71b2-8f0f-4cc7-8c1c-7315349fb0bc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:30:50.795680 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-9a1e71b2-8f0f-4cc7-8c1c-7315349fb0bc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:30:50.797323 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 930/1853] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Oct 12 02:30:50 2022] DELETE /identity/v3/projects/1b103f7839a2419b82edeac9652b0373 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 02:30:50.801037 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1e71b2-8f0f-4cc7-8c1c-7315349fb0bc admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:30:50.803015 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-9a1e71b2-8f0f-4cc7-8c1c-7315349fb0bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:30:50.850409 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f00c53a-2150-45e1-b619-8e79237d515e admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:30:50.854134 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eee388c-2d8d-41bf-8a90-4b3ec0a236fe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5223b5cab3114e9b9a13c582f8ef8386', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'beb6def6fcad45959e56425bb8bff4d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:30:50.854740 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eee388c-2d8d-41bf-8a90-4b3ec0a236fe service neutron] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:50.855014 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eee388c-2d8d-41bf-8a90-4b3ec0a236fe service neutron] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:50.855280 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eee388c-2d8d-41bf-8a90-4b3ec0a236fe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:50.857681 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-7eee388c-2d8d-41bf-8a90-4b3ec0a236fe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:30:50.881716 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1e71b2-8f0f-4cc7-8c1c-7315349fb0bc admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:30:50.922711 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eee388c-2d8d-41bf-8a90-4b3ec0a236fe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:30:50.924186 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eee388c-2d8d-41bf-8a90-4b3ec0a236fe service neutron] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:30:50.933770 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 924/1854] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 02:30:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 02:30:50.935081 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf288e3-66eb-41dd-b89b-137c10835918 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:50.935432 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf288e3-66eb-41dd-b89b-137c10835918 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:50.935713 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf288e3-66eb-41dd-b89b-137c10835918 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:50.940454 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db96118-7fcd-4a8d-8390-68080056c494 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:30:50.941118 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db96118-7fcd-4a8d-8390-68080056c494 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:50.941395 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db96118-7fcd-4a8d-8390-68080056c494 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:50.941667 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db96118-7fcd-4a8d-8390-68080056c494 admin admin] PATH_INFO: `/v3/projects/cfeb7d8affd14db994aa158801ce31dc` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:50.942866 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db96118-7fcd-4a8d-8390-68080056c494 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cfeb7d8affd14db994aa158801ce31dc)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:30:50.944757 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db96118-7fcd-4a8d-8390-68080056c494 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:30:50.955163 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-abf288e3-66eb-41dd-b89b-137c10835918 None None] MFA Rules not processed for user `a326a5bb7364479382f528a592371656`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:30:50.956575 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-abf288e3-66eb-41dd-b89b-137c10835918 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:30:50.968866 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 925/1855] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 02:30:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 02:30:50.968866 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf288e3-66eb-41dd-b89b-137c10835918 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:30:50.968866 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-abf288e3-66eb-41dd-b89b-137c10835918 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:30:50.982575 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf288e3-66eb-41dd-b89b-137c10835918 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:30:50.997094 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:30:50.999211 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-1db96118-7fcd-4a8d-8390-68080056c494 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cfeb7d8affd14db994aa158801ce31dc', 'request_id': 'req-1db96118-7fcd-4a8d-8390-68080056c494'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:30:51.007388 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-1db96118-7fcd-4a8d-8390-68080056c494 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cfeb7d8affd14db994aa158801ce31dc', 'request_id': 'req-1db96118-7fcd-4a8d-8390-68080056c494'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:30:51.019636 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-1db96118-7fcd-4a8d-8390-68080056c494 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cfeb7d8affd14db994aa158801ce31dc', 'request_id': 'req-1db96118-7fcd-4a8d-8390-68080056c494'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:30:51.037099 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-1db96118-7fcd-4a8d-8390-68080056c494 admin admin] The token cache is being invalidate because project cfeb7d8affd14db994aa158801ce31dc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81361) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 02:30:51.037454 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-1db96118-7fcd-4a8d-8390-68080056c494 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:30:51.038126 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-1db96118-7fcd-4a8d-8390-68080056c494 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:30:51.039750 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 931/1856] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Oct 12 02:30:50 2022] DELETE /identity/v3/projects/cfeb7d8affd14db994aa158801ce31dc => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 02:30:51.040611 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db96118-7fcd-4a8d-8390-68080056c494 admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:30:51.042359 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-1db96118-7fcd-4a8d-8390-68080056c494 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:30:51.062419 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481b533c-014f-425b-be52-dc4880dcb540 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:30:51.063463 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481b533c-014f-425b-be52-dc4880dcb540 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:51.063873 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481b533c-014f-425b-be52-dc4880dcb540 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:51.064368 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481b533c-014f-425b-be52-dc4880dcb540 admin admin] PATH_INFO: `/v3/users/1c6cc524d8ff4746897c638870d93090` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:51.066079 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481b533c-014f-425b-be52-dc4880dcb540 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1c6cc524d8ff4746897c638870d93090)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:30:51.069081 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481b533c-014f-425b-be52-dc4880dcb540 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:30:51.096719 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:DELETE=5,keystone:SELECT=95 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:30:51.119329 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db96118-7fcd-4a8d-8390-68080056c494 admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:30:51.123846 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfff7779-8e26-4302-bc8f-b8831025252b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5223b5cab3114e9b9a13c582f8ef8386', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'beb6def6fcad45959e56425bb8bff4d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:30:51.124303 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfff7779-8e26-4302-bc8f-b8831025252b service neutron] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:51.124659 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfff7779-8e26-4302-bc8f-b8831025252b service neutron] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:51.124954 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfff7779-8e26-4302-bc8f-b8831025252b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:51.126776 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-bfff7779-8e26-4302-bc8f-b8831025252b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:30:51.132349 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-481b533c-014f-425b-be52-dc4880dcb540 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1c6cc524d8ff4746897c638870d93090'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:30:51.140955 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfff7779-8e26-4302-bc8f-b8831025252b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:30:51.142387 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfff7779-8e26-4302-bc8f-b8831025252b service neutron] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:30:51.144134 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-481b533c-014f-425b-be52-dc4880dcb540 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1c6cc524d8ff4746897c638870d93090'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:30:51.154448 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 932/1857] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 02:30:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 02:30:51.155538 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfff7779-8e26-4302-bc8f-b8831025252b service neutron] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:30:51.157335 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-bfff7779-8e26-4302-bc8f-b8831025252b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:30:51.171164 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfff7779-8e26-4302-bc8f-b8831025252b service neutron] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:30:51.176645 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16dee6df-e793-445e-9c35-2729d5f87e9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:30:51.177349 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16dee6df-e793-445e-9c35-2729d5f87e9f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:51.177836 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16dee6df-e793-445e-9c35-2729d5f87e9f admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:51.178160 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16dee6df-e793-445e-9c35-2729d5f87e9f admin admin] PATH_INFO: `/v3/users/f7194e58f6b14b54aadc27d13e2c02df` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:51.179381 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16dee6df-e793-445e-9c35-2729d5f87e9f admin admin] RBAC: Authorizing `identity:delete_user(user_id=f7194e58f6b14b54aadc27d13e2c02df)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:30:51.181965 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16dee6df-e793-445e-9c35-2729d5f87e9f admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:30:51.186067 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-481b533c-014f-425b-be52-dc4880dcb540 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1c6cc524d8ff4746897c638870d93090'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:30:51.196799 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-481b533c-014f-425b-be52-dc4880dcb540 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1c6cc524d8ff4746897c638870d93090'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:30:51.198367 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-481b533c-014f-425b-be52-dc4880dcb540 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1c6cc524d8ff4746897c638870d93090'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:30:51.207967 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 926/1858] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Oct 12 02:30:50 2022] DELETE /identity/v3/users/1c6cc524d8ff4746897c638870d93090 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 02:30:51.244227 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-16dee6df-e793-445e-9c35-2729d5f87e9f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f7194e58f6b14b54aadc27d13e2c02df'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:30:51.256582 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-16dee6df-e793-445e-9c35-2729d5f87e9f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f7194e58f6b14b54aadc27d13e2c02df'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:30:51.272949 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-16dee6df-e793-445e-9c35-2729d5f87e9f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f7194e58f6b14b54aadc27d13e2c02df'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:30:51.280886 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-16dee6df-e793-445e-9c35-2729d5f87e9f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f7194e58f6b14b54aadc27d13e2c02df'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:30:51.281742 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-16dee6df-e793-445e-9c35-2729d5f87e9f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f7194e58f6b14b54aadc27d13e2c02df'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:30:51.289472 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 933/1859] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Oct 12 02:30:51 2022] DELETE /identity/v3/users/f7194e58f6b14b54aadc27d13e2c02df => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 02:30:51.717907 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481b533c-014f-425b-be52-dc4880dcb540 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:30:51.719354 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-481b533c-014f-425b-be52-dc4880dcb540 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:30:51.781908 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16dee6df-e793-445e-9c35-2729d5f87e9f admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:30:51.783973 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-16dee6df-e793-445e-9c35-2729d5f87e9f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:30:51.837070 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481b533c-014f-425b-be52-dc4880dcb540 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:30:51.865204 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:30:51.890799 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16dee6df-e793-445e-9c35-2729d5f87e9f admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:30:51.898307 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f4941e-4428-498f-8b68-b038dc53fab0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:30:51.901934 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f4941e-4428-498f-8b68-b038dc53fab0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:51.902252 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f4941e-4428-498f-8b68-b038dc53fab0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:51.902546 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f4941e-4428-498f-8b68-b038dc53fab0 admin admin] PATH_INFO: `/v3/projects/03ac2c430e154f1cbcb794e1ec2e8b34` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:51.904374 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f4941e-4428-498f-8b68-b038dc53fab0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=03ac2c430e154f1cbcb794e1ec2e8b34)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:30:51.906772 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f4941e-4428-498f-8b68-b038dc53fab0 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:30:51.932700 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c05ae9-353e-4f56-afb9-c013032724c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:30:51.933350 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c05ae9-353e-4f56-afb9-c013032724c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:51.934899 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c05ae9-353e-4f56-afb9-c013032724c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:51.935486 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c05ae9-353e-4f56-afb9-c013032724c7 admin admin] PATH_INFO: `/v3/projects/b59fd20d041341208dfcd08f6e01e0f2` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:51.936895 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c05ae9-353e-4f56-afb9-c013032724c7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b59fd20d041341208dfcd08f6e01e0f2)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:30:51.938957 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c05ae9-353e-4f56-afb9-c013032724c7 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:30:51.981026 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-00f4941e-4428-498f-8b68-b038dc53fab0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '03ac2c430e154f1cbcb794e1ec2e8b34', 'request_id': 'req-00f4941e-4428-498f-8b68-b038dc53fab0'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:30:51.997861 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-00f4941e-4428-498f-8b68-b038dc53fab0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '03ac2c430e154f1cbcb794e1ec2e8b34', 'request_id': 'req-00f4941e-4428-498f-8b68-b038dc53fab0'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:30:52.008282 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-00f4941e-4428-498f-8b68-b038dc53fab0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '03ac2c430e154f1cbcb794e1ec2e8b34', 'request_id': 'req-00f4941e-4428-498f-8b68-b038dc53fab0'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:30:52.024441 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:30:52.026254 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-00f4941e-4428-498f-8b68-b038dc53fab0 admin admin] The token cache is being invalidate because project 03ac2c430e154f1cbcb794e1ec2e8b34 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81361) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 02:30:52.026547 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-00f4941e-4428-498f-8b68-b038dc53fab0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:30:52.026787 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-71c05ae9-353e-4f56-afb9-c013032724c7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b59fd20d041341208dfcd08f6e01e0f2', 'request_id': 'req-71c05ae9-353e-4f56-afb9-c013032724c7'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:30:52.027398 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-00f4941e-4428-498f-8b68-b038dc53fab0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:30:52.030113 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 934/1860] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Oct 12 02:30:51 2022] DELETE /identity/v3/projects/03ac2c430e154f1cbcb794e1ec2e8b34 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 02:30:52.030996 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f4941e-4428-498f-8b68-b038dc53fab0 admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:30:52.032364 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-00f4941e-4428-498f-8b68-b038dc53fab0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:30:52.042325 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-71c05ae9-353e-4f56-afb9-c013032724c7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b59fd20d041341208dfcd08f6e01e0f2', 'request_id': 'req-71c05ae9-353e-4f56-afb9-c013032724c7'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:30:52.053527 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-71c05ae9-353e-4f56-afb9-c013032724c7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b59fd20d041341208dfcd08f6e01e0f2', 'request_id': 'req-71c05ae9-353e-4f56-afb9-c013032724c7'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:30:52.070417 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-71c05ae9-353e-4f56-afb9-c013032724c7 admin admin] The token cache is being invalidate because project b59fd20d041341208dfcd08f6e01e0f2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81362) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 02:30:52.071318 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-71c05ae9-353e-4f56-afb9-c013032724c7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:30:52.073144 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-71c05ae9-353e-4f56-afb9-c013032724c7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:30:52.091717 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 927/1861] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Oct 12 02:30:51 2022] DELETE /identity/v3/projects/b59fd20d041341208dfcd08f6e01e0f2 => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 02:30:52.094641 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c05ae9-353e-4f56-afb9-c013032724c7 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:30:52.096722 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-71c05ae9-353e-4f56-afb9-c013032724c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:30:52.129981 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f4941e-4428-498f-8b68-b038dc53fab0 admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:30:52.193570 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c05ae9-353e-4f56-afb9-c013032724c7 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:30:52.204682 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f4e6c8-de6f-49cc-bfc3-4555bed65404 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:30:52.206459 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f4e6c8-de6f-49cc-bfc3-4555bed65404 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:52.207032 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f4e6c8-de6f-49cc-bfc3-4555bed65404 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:52.207448 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f4e6c8-de6f-49cc-bfc3-4555bed65404 admin admin] PATH_INFO: `/v3/users/50571fbd58104511bcb0f26818184f77` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:52.209343 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f4e6c8-de6f-49cc-bfc3-4555bed65404 admin admin] RBAC: Authorizing `identity:delete_user(user_id=50571fbd58104511bcb0f26818184f77)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:30:52.212859 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd09e00-d6e5-4dd7-94e2-b855f022bf54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:30:52.213096 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f4e6c8-de6f-49cc-bfc3-4555bed65404 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:30:52.213756 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd09e00-d6e5-4dd7-94e2-b855f022bf54 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:52.214099 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd09e00-d6e5-4dd7-94e2-b855f022bf54 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:52.214460 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd09e00-d6e5-4dd7-94e2-b855f022bf54 admin admin] PATH_INFO: `/v3/projects/654682e30cb84b2a95ced260ec4716fe` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:52.216998 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd09e00-d6e5-4dd7-94e2-b855f022bf54 admin admin] RBAC: Authorizing `identity:delete_project(project_id=654682e30cb84b2a95ced260ec4716fe)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:30:52.219873 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd09e00-d6e5-4dd7-94e2-b855f022bf54 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:30:52.270034 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:30:52.290556 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-5cd09e00-d6e5-4dd7-94e2-b855f022bf54 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '654682e30cb84b2a95ced260ec4716fe', 'request_id': 'req-5cd09e00-d6e5-4dd7-94e2-b855f022bf54'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:30:52.298991 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-5cd09e00-d6e5-4dd7-94e2-b855f022bf54 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '654682e30cb84b2a95ced260ec4716fe', 'request_id': 'req-5cd09e00-d6e5-4dd7-94e2-b855f022bf54'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:30:52.299526 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-97f4e6c8-de6f-49cc-bfc3-4555bed65404 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '50571fbd58104511bcb0f26818184f77'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:30:52.311036 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-5cd09e00-d6e5-4dd7-94e2-b855f022bf54 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '654682e30cb84b2a95ced260ec4716fe', 'request_id': 'req-5cd09e00-d6e5-4dd7-94e2-b855f022bf54'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:30:52.312683 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-97f4e6c8-de6f-49cc-bfc3-4555bed65404 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '50571fbd58104511bcb0f26818184f77'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:30:52.329122 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-97f4e6c8-de6f-49cc-bfc3-4555bed65404 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '50571fbd58104511bcb0f26818184f77'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:30:52.329859 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-5cd09e00-d6e5-4dd7-94e2-b855f022bf54 admin admin] The token cache is being invalidate because project 654682e30cb84b2a95ced260ec4716fe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81361) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 02:30:52.330242 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-5cd09e00-d6e5-4dd7-94e2-b855f022bf54 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:30:52.331340 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-5cd09e00-d6e5-4dd7-94e2-b855f022bf54 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:30:52.333125 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 935/1862] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Oct 12 02:30:52 2022] DELETE /identity/v3/projects/654682e30cb84b2a95ced260ec4716fe => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 02:30:52.336714 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-97f4e6c8-de6f-49cc-bfc3-4555bed65404 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '50571fbd58104511bcb0f26818184f77'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:30:52.337736 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-97f4e6c8-de6f-49cc-bfc3-4555bed65404 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '50571fbd58104511bcb0f26818184f77'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:30:52.338368 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e61a2e-eb05-40f7-92b0-562ac21a219b None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:52.338651 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e61a2e-eb05-40f7-92b0-562ac21a219b None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:52.338923 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e61a2e-eb05-40f7-92b0-562ac21a219b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:52.347659 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 928/1863] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Oct 12 02:30:52 2022] DELETE /identity/v3/users/50571fbd58104511bcb0f26818184f77 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 02:30:52.347659 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4e594f-4ee9-4ef5-aa0f-e4096cc5573c None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:52.347659 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4e594f-4ee9-4ef5-aa0f-e4096cc5573c None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:52.347659 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4e594f-4ee9-4ef5-aa0f-e4096cc5573c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:52.374103 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-0c4e594f-4ee9-4ef5-aa0f-e4096cc5573c None None] MFA Rules not processed for user `a326a5bb7364479382f528a592371656`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:30:52.376109 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-0c4e594f-4ee9-4ef5-aa0f-e4096cc5573c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:30:52.388719 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-e6e61a2e-eb05-40f7-92b0-562ac21a219b None None] MFA Rules not processed for user `a326a5bb7364479382f528a592371656`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:30:52.390631 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-e6e61a2e-eb05-40f7-92b0-562ac21a219b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:30:52.444866 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:30:52.467321 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 929/1864] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 02:30:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 02:30:52.470074 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23166aa0-26cd-41f7-b943-b2fec98e015a None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:52.470616 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23166aa0-26cd-41f7-b943-b2fec98e015a None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:52.470806 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23166aa0-26cd-41f7-b943-b2fec98e015a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:52.487438 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 936/1865] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 02:30:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 02:30:52.496444 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1bbc9d-ea0f-42fb-a74a-6f4dc8c72ee8 None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:52.497340 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1bbc9d-ea0f-42fb-a74a-6f4dc8c72ee8 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:52.497788 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1bbc9d-ea0f-42fb-a74a-6f4dc8c72ee8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:52.503289 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-23166aa0-26cd-41f7-b943-b2fec98e015a None None] MFA Rules not processed for user `a326a5bb7364479382f528a592371656`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:30:52.504958 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-23166aa0-26cd-41f7-b943-b2fec98e015a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:30:52.516646 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 930/1866] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 02:30:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 02:30:52.529946 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23166aa0-26cd-41f7-b943-b2fec98e015a None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:30:52.535788 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-8f1bbc9d-ea0f-42fb-a74a-6f4dc8c72ee8 None None] MFA Rules not processed for user `a326a5bb7364479382f528a592371656`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:30:52.537603 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-8f1bbc9d-ea0f-42fb-a74a-6f4dc8c72ee8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:30:52.553769 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23166aa0-26cd-41f7-b943-b2fec98e015a None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:30:52.561663 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 937/1867] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 02:30:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 02:30:52.563189 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1bbc9d-ea0f-42fb-a74a-6f4dc8c72ee8 None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:30:52.569120 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885a4405-fa3a-4862-9e46-ccfb9bf93ed8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:30:52.569757 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885a4405-fa3a-4862-9e46-ccfb9bf93ed8 admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:52.570038 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885a4405-fa3a-4862-9e46-ccfb9bf93ed8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:52.570314 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885a4405-fa3a-4862-9e46-ccfb9bf93ed8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:52.570968 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885a4405-fa3a-4862-9e46-ccfb9bf93ed8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 02:30:52.571276 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885a4405-fa3a-4862-9e46-ccfb9bf93ed8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:30:52.572920 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885a4405-fa3a-4862-9e46-ccfb9bf93ed8 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:30:52.582006 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1bbc9d-ea0f-42fb-a74a-6f4dc8c72ee8 None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:30:52.587871 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97b9329-fadf-4de3-926e-365d02367a00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:30:52.588530 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97b9329-fadf-4de3-926e-365d02367a00 admin admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:52.589086 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97b9329-fadf-4de3-926e-365d02367a00 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:52.589361 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97b9329-fadf-4de3-926e-365d02367a00 admin admin] PATH_INFO: `/v3/domains` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:52.590182 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97b9329-fadf-4de3-926e-365d02367a00 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 02:30:52.591014 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97b9329-fadf-4de3-926e-365d02367a00 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:30:52.592993 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97b9329-fadf-4de3-926e-365d02367a00 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:30:52.600835 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 931/1868] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Oct 12 02:30:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 02:30:52.601932 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885a4405-fa3a-4862-9e46-ccfb9bf93ed8 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:30:52.610698 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 938/1869] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Oct 12 02:30:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 02:30:52.612955 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97b9329-fadf-4de3-926e-365d02367a00 admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:30:52.623951 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885a4405-fa3a-4862-9e46-ccfb9bf93ed8 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:30:52.633238 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97b9329-fadf-4de3-926e-365d02367a00 admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:30:52.638563 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78791eec-8541-439b-9d1d-72194a4dcd73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:30:52.639195 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78791eec-8541-439b-9d1d-72194a4dcd73 admin admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:52.639475 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78791eec-8541-439b-9d1d-72194a4dcd73 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:52.640493 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78791eec-8541-439b-9d1d-72194a4dcd73 admin admin] PATH_INFO: `/v3/projects` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:52.641146 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78791eec-8541-439b-9d1d-72194a4dcd73 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:30:52.643067 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78791eec-8541-439b-9d1d-72194a4dcd73 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:30:52.647822 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b5a002-6205-40bf-b233-afc950a4ea22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:30:52.648530 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b5a002-6205-40bf-b233-afc950a4ea22 admin admin] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:52.648809 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b5a002-6205-40bf-b233-afc950a4ea22 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:52.649077 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b5a002-6205-40bf-b233-afc950a4ea22 admin admin] PATH_INFO: `/v3/projects` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:52.649716 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b5a002-6205-40bf-b233-afc950a4ea22 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:30:52.651788 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b5a002-6205-40bf-b233-afc950a4ea22 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:30:52.688253 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 939/1870] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Oct 12 02:30:52 2022] POST /identity/v3/projects => generated 377 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 02:30:52.692265 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b5a002-6205-40bf-b233-afc950a4ea22 admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:30:52.734379 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 932/1871] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Oct 12 02:30:52 2022] POST /identity/v3/projects => generated 355 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 02:30:52.736611 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78791eec-8541-439b-9d1d-72194a4dcd73 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:30:52.834773 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b5a002-6205-40bf-b233-afc950a4ea22 admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:30:52.847931 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78791eec-8541-439b-9d1d-72194a4dcd73 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:30:52.851081 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c3720a-3777-4a17-8211-274fb32c02c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:30:52.851771 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c3720a-3777-4a17-8211-274fb32c02c8 admin admin] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:52.852057 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c3720a-3777-4a17-8211-274fb32c02c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:52.852332 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c3720a-3777-4a17-8211-274fb32c02c8 admin admin] PATH_INFO: `/v3/users` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:52.853991 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c3720a-3777-4a17-8211-274fb32c02c8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:30:52.857533 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c3720a-3777-4a17-8211-274fb32c02c8 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:30:52.862773 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a46bea-140b-421e-a025-92dadd200d50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:30:52.863376 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a46bea-140b-421e-a025-92dadd200d50 admin admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:52.863641 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a46bea-140b-421e-a025-92dadd200d50 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:52.864299 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a46bea-140b-421e-a025-92dadd200d50 admin admin] PATH_INFO: `/v3/users` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:52.865009 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a46bea-140b-421e-a025-92dadd200d50 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:30:52.866874 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a46bea-140b-421e-a025-92dadd200d50 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:30:52.906770 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 940/1872] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Oct 12 02:30:52 2022] POST /identity/v3/users => generated 289 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 02:30:52.908954 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c3720a-3777-4a17-8211-274fb32c02c8 admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:30:52.913955 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-92c3720a-3777-4a17-8211-274fb32c02c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:30:52.918470 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 933/1873] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Oct 12 02:30:52 2022] POST /identity/v3/users => generated 278 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 02:30:52.918470 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a46bea-140b-421e-a025-92dadd200d50 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:30:52.931373 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c3720a-3777-4a17-8211-274fb32c02c8 admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:30:52.935252 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a46bea-140b-421e-a025-92dadd200d50 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:30:52.939478 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ba4d63-ff54-44ec-bc04-b217abf25401 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:30:52.940134 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ba4d63-ff54-44ec-bc04-b217abf25401 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:52.940403 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ba4d63-ff54-44ec-bc04-b217abf25401 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:52.940714 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ba4d63-ff54-44ec-bc04-b217abf25401 admin admin] PATH_INFO: `/v3/projects/c82b9722184a4250bc1c48c5b23a0f4b` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:52.943683 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ba4d63-ff54-44ec-bc04-b217abf25401 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c82b9722184a4250bc1c48c5b23a0f4b)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:30:52.947154 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758e0a9b-b9e7-46c6-89ff-007afaac7365 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:30:52.947893 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758e0a9b-b9e7-46c6-89ff-007afaac7365 admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:52.948123 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758e0a9b-b9e7-46c6-89ff-007afaac7365 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:52.950724 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758e0a9b-b9e7-46c6-89ff-007afaac7365 admin admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:52.953144 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758e0a9b-b9e7-46c6-89ff-007afaac7365 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:30:52.953696 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ba4d63-ff54-44ec-bc04-b217abf25401 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:30:52.955505 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=90,keystone:DELETE=5,keystone:INSERT=5 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:30:52.957200 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758e0a9b-b9e7-46c6-89ff-007afaac7365 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:30:52.979349 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 934/1874] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Oct 12 02:30:52 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 02:30:52.980382 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758e0a9b-b9e7-46c6-89ff-007afaac7365 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:30:52.994009 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758e0a9b-b9e7-46c6-89ff-007afaac7365 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:30:53.001129 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0529a141-9b19-4e14-9cf7-1f1aa71922b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:30:53.001541 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0529a141-9b19-4e14-9cf7-1f1aa71922b4 admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:53.001898 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0529a141-9b19-4e14-9cf7-1f1aa71922b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:53.002312 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0529a141-9b19-4e14-9cf7-1f1aa71922b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:53.003447 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0529a141-9b19-4e14-9cf7-1f1aa71922b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:30:53.005573 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0529a141-9b19-4e14-9cf7-1f1aa71922b4 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:30:53.020032 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 935/1875] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Oct 12 02:30:52 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 02:30:53.021052 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0529a141-9b19-4e14-9cf7-1f1aa71922b4 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:30:53.028163 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-86ba4d63-ff54-44ec-bc04-b217abf25401 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c82b9722184a4250bc1c48c5b23a0f4b', 'request_id': 'req-86ba4d63-ff54-44ec-bc04-b217abf25401'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:30:53.036956 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-86ba4d63-ff54-44ec-bc04-b217abf25401 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c82b9722184a4250bc1c48c5b23a0f4b', 'request_id': 'req-86ba4d63-ff54-44ec-bc04-b217abf25401'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:30:53.040774 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0529a141-9b19-4e14-9cf7-1f1aa71922b4 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:30:53.046232 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-86ba4d63-ff54-44ec-bc04-b217abf25401 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c82b9722184a4250bc1c48c5b23a0f4b', 'request_id': 'req-86ba4d63-ff54-44ec-bc04-b217abf25401'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:30:53.066121 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-86ba4d63-ff54-44ec-bc04-b217abf25401 admin admin] The token cache is being invalidate because project c82b9722184a4250bc1c48c5b23a0f4b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81361) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 02:30:53.068335 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-86ba4d63-ff54-44ec-bc04-b217abf25401 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:30:53.069545 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-86ba4d63-ff54-44ec-bc04-b217abf25401 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:30:53.071410 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 941/1876] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Oct 12 02:30:52 2022] DELETE /identity/v3/projects/c82b9722184a4250bc1c48c5b23a0f4b => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 02:30:53.072671 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ba4d63-ff54-44ec-bc04-b217abf25401 admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:30:53.074441 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-86ba4d63-ff54-44ec-bc04-b217abf25401 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:30:53.158509 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90abedcb-b188-40d3-b378-ed5dba336238 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:30:53.159867 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90abedcb-b188-40d3-b378-ed5dba336238 admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:53.160213 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90abedcb-b188-40d3-b378-ed5dba336238 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:53.160613 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90abedcb-b188-40d3-b378-ed5dba336238 admin admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:53.161412 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90abedcb-b188-40d3-b378-ed5dba336238 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:30:53.163427 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90abedcb-b188-40d3-b378-ed5dba336238 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:30:53.177854 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 936/1877] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Oct 12 02:30:53 2022] GET /identity/v3/roles => generated 1420 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 02:30:53.179126 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82caf2c-2be9-4970-981c-a20574e31908 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:53.179413 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82caf2c-2be9-4970-981c-a20574e31908 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:53.179684 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82caf2c-2be9-4970-981c-a20574e31908 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:53.201457 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ba4d63-ff54-44ec-bc04-b217abf25401 admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:30:53.215321 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d29aefd-88c6-440f-bc55-9714edbc3086 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:30:53.216279 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d29aefd-88c6-440f-bc55-9714edbc3086 admin admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:53.216642 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d29aefd-88c6-440f-bc55-9714edbc3086 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:53.216936 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d29aefd-88c6-440f-bc55-9714edbc3086 admin admin] PATH_INFO: `/v3/roles` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:53.218156 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d29aefd-88c6-440f-bc55-9714edbc3086 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:30:53.220460 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d29aefd-88c6-440f-bc55-9714edbc3086 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:30:53.227051 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-a82caf2c-2be9-4970-981c-a20574e31908 None None] MFA Rules not processed for user `a326a5bb7364479382f528a592371656`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:30:53.229813 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-a82caf2c-2be9-4970-981c-a20574e31908 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:30:53.238441 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 942/1878] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Oct 12 02:30:53 2022] GET /identity/v3/roles => generated 1420 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 02:30:53.240596 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d29aefd-88c6-440f-bc55-9714edbc3086 admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:30:53.242551 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-1d29aefd-88c6-440f-bc55-9714edbc3086 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:30:53.254074 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 937/1879] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 02:30:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 02:30:53.255123 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82caf2c-2be9-4970-981c-a20574e31908 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:30:53.265010 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d29aefd-88c6-440f-bc55-9714edbc3086 admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:30:53.267347 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82caf2c-2be9-4970-981c-a20574e31908 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:30:53.271866 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41300021-6db5-482c-bd58-310fedafda81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:30:53.272069 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41300021-6db5-482c-bd58-310fedafda81 admin admin] REQUEST_METHOD: `PUT` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:53.272339 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41300021-6db5-482c-bd58-310fedafda81 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:53.272512 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41300021-6db5-482c-bd58-310fedafda81 admin admin] PATH_INFO: `/v3/projects/a2140688aab345e3884a5aa98c17d2aa/users/eeff63d8fa174895afac6e61fa07e004/roles/3d75c4d7f1a849b9a771504d1583ab28` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:53.273758 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18029453-6153-4e98-a5b0-af23690fa5dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:30:53.274496 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18029453-6153-4e98-a5b0-af23690fa5dd admin admin] REQUEST_METHOD: `PUT` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:53.275144 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18029453-6153-4e98-a5b0-af23690fa5dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:53.275782 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18029453-6153-4e98-a5b0-af23690fa5dd admin admin] PATH_INFO: `/v3/projects/bcf61b78dd6641928136ec6c0ac0bb59/users/eadcf6d173f24d74942b2d43d6767566/roles/3d75c4d7f1a849b9a771504d1583ab28` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:53.290160 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:30:53.298874 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41300021-6db5-482c-bd58-310fedafda81 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a2140688aab345e3884a5aa98c17d2aa, user_id=eeff63d8fa174895afac6e61fa07e004, role_id=3d75c4d7f1a849b9a771504d1583ab28)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:30:53.301400 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18029453-6153-4e98-a5b0-af23690fa5dd admin admin] RBAC: Authorizing `identity:create_grant(project_id=bcf61b78dd6641928136ec6c0ac0bb59, user_id=eadcf6d173f24d74942b2d43d6767566, role_id=3d75c4d7f1a849b9a771504d1583ab28)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:30:53.302160 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41300021-6db5-482c-bd58-310fedafda81 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:30:53.310736 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18029453-6153-4e98-a5b0-af23690fa5dd admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:30:53.323612 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 943/1880] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Oct 12 02:30:53 2022] PUT /identity/v3/projects/a2140688aab345e3884a5aa98c17d2aa/users/eeff63d8fa174895afac6e61fa07e004/roles/3d75c4d7f1a849b9a771504d1583ab28 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 02:30:53.325958 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4379b0-36f3-4ecb-b2c3-41faed85f2d1 None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:53.326363 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4379b0-36f3-4ecb-b2c3-41faed85f2d1 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:53.326646 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4379b0-36f3-4ecb-b2c3-41faed85f2d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:53.351471 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-9d4379b0-36f3-4ecb-b2c3-41faed85f2d1 None None] MFA Rules not processed for user `a326a5bb7364479382f528a592371656`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:30:53.352754 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-9d4379b0-36f3-4ecb-b2c3-41faed85f2d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:30:53.354667 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 938/1881] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Oct 12 02:30:53 2022] PUT /identity/v3/projects/bcf61b78dd6641928136ec6c0ac0bb59/users/eadcf6d173f24d74942b2d43d6767566/roles/3d75c4d7f1a849b9a771504d1583ab28 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 02:30:53.366592 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14458e37-7042-47bb-8fee-9fa04aebcaf1 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:53.366871 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14458e37-7042-47bb-8fee-9fa04aebcaf1 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:53.367152 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14458e37-7042-47bb-8fee-9fa04aebcaf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:53.424905 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-14458e37-7042-47bb-8fee-9fa04aebcaf1 None None] MFA Rules not processed for user `eadcf6d173f24d74942b2d43d6767566`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:30:53.426347 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-14458e37-7042-47bb-8fee-9fa04aebcaf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:30:53.430014 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 944/1882] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 02:30:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 02:30:53.431345 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f00907-a179-417c-a6d4-8d9dbfa5bf5a None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:53.432586 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f00907-a179-417c-a6d4-8d9dbfa5bf5a None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:53.432875 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f00907-a179-417c-a6d4-8d9dbfa5bf5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:53.441632 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:30:53.472645 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-f0f00907-a179-417c-a6d4-8d9dbfa5bf5a None None] MFA Rules not processed for user `eeff63d8fa174895afac6e61fa07e004`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:30:53.474295 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-f0f00907-a179-417c-a6d4-8d9dbfa5bf5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:30:53.559635 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 939/1883] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 02:30:53 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 02:30:53.559635 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14458e37-7042-47bb-8fee-9fa04aebcaf1 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:30:53.571548 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14458e37-7042-47bb-8fee-9fa04aebcaf1 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:30:53.578245 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6cd854-d0ab-4369-827e-97235ab1e644 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:30:53.578877 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6cd854-d0ab-4369-827e-97235ab1e644 admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:53.579168 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6cd854-d0ab-4369-827e-97235ab1e644 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:53.579443 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6cd854-d0ab-4369-827e-97235ab1e644 admin admin] PATH_INFO: `/v3/domains` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:53.580170 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6cd854-d0ab-4369-827e-97235ab1e644 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 02:30:53.580491 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6cd854-d0ab-4369-827e-97235ab1e644 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:30:53.582849 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6cd854-d0ab-4369-827e-97235ab1e644 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:30:53.595683 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 945/1884] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 02:30:53 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 02:30:53.596884 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f00907-a179-417c-a6d4-8d9dbfa5bf5a None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:30:53.603795 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 940/1885] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Oct 12 02:30:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 02:30:53.604766 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6cd854-d0ab-4369-827e-97235ab1e644 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:30:53.614168 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f00907-a179-417c-a6d4-8d9dbfa5bf5a None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:30:53.618959 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d53c1b-2d36-4655-9e40-03d41baaee2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:30:53.620047 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d53c1b-2d36-4655-9e40-03d41baaee2e admin admin] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:53.620327 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d53c1b-2d36-4655-9e40-03d41baaee2e admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:53.620961 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d53c1b-2d36-4655-9e40-03d41baaee2e admin admin] PATH_INFO: `/v3/projects` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:53.621148 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6cd854-d0ab-4369-827e-97235ab1e644 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:30:53.621600 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d53c1b-2d36-4655-9e40-03d41baaee2e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:30:53.623880 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d53c1b-2d36-4655-9e40-03d41baaee2e admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:30:53.629765 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371f600c-2458-4a86-9352-14b8b18dc552 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:30:53.630403 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371f600c-2458-4a86-9352-14b8b18dc552 admin admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:53.630687 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371f600c-2458-4a86-9352-14b8b18dc552 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:53.630960 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371f600c-2458-4a86-9352-14b8b18dc552 admin admin] PATH_INFO: `/v3/projects` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:53.631595 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371f600c-2458-4a86-9352-14b8b18dc552 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:30:53.634509 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371f600c-2458-4a86-9352-14b8b18dc552 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:30:53.664026 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 946/1886] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Oct 12 02:30:53 2022] POST /identity/v3/projects => generated 353 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 02:30:53.664026 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d53c1b-2d36-4655-9e40-03d41baaee2e admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:30:53.673001 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 941/1887] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Oct 12 02:30:53 2022] POST /identity/v3/projects => generated 375 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 02:30:53.674061 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371f600c-2458-4a86-9352-14b8b18dc552 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:30:53.829932 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371f600c-2458-4a86-9352-14b8b18dc552 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:30:53.831011 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d53c1b-2d36-4655-9e40-03d41baaee2e admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:30:53.844547 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a286a1b-0964-4df2-85de-a29fef4f20e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:30:53.844900 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a10f062-5627-410d-8c41-9f647d09c0d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:30:53.845560 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a286a1b-0964-4df2-85de-a29fef4f20e7 admin admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:53.845560 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a286a1b-0964-4df2-85de-a29fef4f20e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:53.845705 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a286a1b-0964-4df2-85de-a29fef4f20e7 admin admin] PATH_INFO: `/v3/users` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:53.846355 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a286a1b-0964-4df2-85de-a29fef4f20e7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:30:53.846665 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a10f062-5627-410d-8c41-9f647d09c0d2 admin admin] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:53.847066 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a10f062-5627-410d-8c41-9f647d09c0d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:53.847458 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a10f062-5627-410d-8c41-9f647d09c0d2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:53.848228 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a10f062-5627-410d-8c41-9f647d09c0d2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:30:53.848457 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a286a1b-0964-4df2-85de-a29fef4f20e7 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:30:53.850772 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a10f062-5627-410d-8c41-9f647d09c0d2 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:30:53.890547 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 947/1888] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Oct 12 02:30:53 2022] POST /identity/v3/projects => generated 385 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 02:30:53.891335 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a10f062-5627-410d-8c41-9f647d09c0d2 admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:30:53.897019 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 942/1889] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Oct 12 02:30:53 2022] POST /identity/v3/users => generated 283 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 02:30:53.898726 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a286a1b-0964-4df2-85de-a29fef4f20e7 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:30:53.913059 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a286a1b-0964-4df2-85de-a29fef4f20e7 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:30:53.971968 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:30:53.996609 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:30:54.005704 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a10f062-5627-410d-8c41-9f647d09c0d2 admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:30:54.011884 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a133de16-f62d-43cb-9f76-7de0c18c5a00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:30:54.013443 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a133de16-f62d-43cb-9f76-7de0c18c5a00 admin admin] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:54.014193 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a133de16-f62d-43cb-9f76-7de0c18c5a00 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:54.014887 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a133de16-f62d-43cb-9f76-7de0c18c5a00 admin admin] PATH_INFO: `/v3/users` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:54.015737 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a133de16-f62d-43cb-9f76-7de0c18c5a00 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:30:54.017989 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a133de16-f62d-43cb-9f76-7de0c18c5a00 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:30:54.028952 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9751173f-4616-4307-9e24-f8a032a3623d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:30:54.032855 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9751173f-4616-4307-9e24-f8a032a3623d admin admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:54.033152 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9751173f-4616-4307-9e24-f8a032a3623d admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:54.033437 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9751173f-4616-4307-9e24-f8a032a3623d admin admin] PATH_INFO: `/v3/users` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:54.034108 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9751173f-4616-4307-9e24-f8a032a3623d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:30:54.036846 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9751173f-4616-4307-9e24-f8a032a3623d admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:30:54.057186 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 948/1890] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Oct 12 02:30:53 2022] POST /identity/v3/users => generated 288 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 02:30:54.058879 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a133de16-f62d-43cb-9f76-7de0c18c5a00 admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:30:54.074566 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 943/1891] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Oct 12 02:30:53 2022] POST /identity/v3/users => generated 293 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 02:30:54.076915 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9751173f-4616-4307-9e24-f8a032a3623d admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:30:54.079530 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a133de16-f62d-43cb-9f76-7de0c18c5a00 admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:30:54.092781 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e764d4d5-cec9-4f9e-b800-d810a7d2fe45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:30:54.093738 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e764d4d5-cec9-4f9e-b800-d810a7d2fe45 admin admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:54.094196 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e764d4d5-cec9-4f9e-b800-d810a7d2fe45 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:54.094671 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e764d4d5-cec9-4f9e-b800-d810a7d2fe45 admin admin] PATH_INFO: `/v3/roles` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:54.095570 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e764d4d5-cec9-4f9e-b800-d810a7d2fe45 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:30:54.095929 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9751173f-4616-4307-9e24-f8a032a3623d admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:30:54.097899 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e764d4d5-cec9-4f9e-b800-d810a7d2fe45 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:30:54.106865 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f12a12f-6734-4256-be8b-466ce857735d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:30:54.107648 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f12a12f-6734-4256-be8b-466ce857735d admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:54.108002 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f12a12f-6734-4256-be8b-466ce857735d admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:54.109645 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f12a12f-6734-4256-be8b-466ce857735d admin admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:54.109645 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f12a12f-6734-4256-be8b-466ce857735d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:30:54.113432 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f12a12f-6734-4256-be8b-466ce857735d admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:30:54.114852 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 949/1892] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Oct 12 02:30:54 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 02:30:54.115907 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e764d4d5-cec9-4f9e-b800-d810a7d2fe45 admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:30:54.127522 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e764d4d5-cec9-4f9e-b800-d810a7d2fe45 admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:30:54.136929 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ded6b3-a968-40fc-a2f2-dfda3fef6d8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:30:54.137788 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 944/1893] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Oct 12 02:30:54 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 02:30:54.138740 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f12a12f-6734-4256-be8b-466ce857735d admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:30:54.140827 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ded6b3-a968-40fc-a2f2-dfda3fef6d8f admin admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:54.141158 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ded6b3-a968-40fc-a2f2-dfda3fef6d8f admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:54.141550 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ded6b3-a968-40fc-a2f2-dfda3fef6d8f admin admin] PATH_INFO: `/v3/roles` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:54.142234 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ded6b3-a968-40fc-a2f2-dfda3fef6d8f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:30:54.145350 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ded6b3-a968-40fc-a2f2-dfda3fef6d8f admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:30:54.158400 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 950/1894] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Oct 12 02:30:54 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 02:30:54.159285 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ded6b3-a968-40fc-a2f2-dfda3fef6d8f admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:30:54.172380 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f12a12f-6734-4256-be8b-466ce857735d admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:30:54.176147 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ded6b3-a968-40fc-a2f2-dfda3fef6d8f admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:30:54.179706 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c75a4f-c9c3-49e8-9b8d-824c04af95c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:30:54.180784 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c75a4f-c9c3-49e8-9b8d-824c04af95c1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:54.181209 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c75a4f-c9c3-49e8-9b8d-824c04af95c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:54.181777 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c75a4f-c9c3-49e8-9b8d-824c04af95c1 admin admin] PATH_INFO: `/v3/projects/1c93d8213e344008bb384f2a3c4cbdaa/users/d0490617213946d3a8b6b1c499121154/roles/39b1e8108dff402383def3c559f48189` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:54.183585 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63da82b-dd22-4158-92f9-764d931cf793 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:30:54.185146 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63da82b-dd22-4158-92f9-764d931cf793 admin admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:54.186638 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63da82b-dd22-4158-92f9-764d931cf793 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:54.186933 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63da82b-dd22-4158-92f9-764d931cf793 admin admin] PATH_INFO: `/v3/roles` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:54.187653 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63da82b-dd22-4158-92f9-764d931cf793 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:30:54.189344 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63da82b-dd22-4158-92f9-764d931cf793 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:30:54.207642 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c75a4f-c9c3-49e8-9b8d-824c04af95c1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c93d8213e344008bb384f2a3c4cbdaa, user_id=d0490617213946d3a8b6b1c499121154, role_id=39b1e8108dff402383def3c559f48189)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:30:54.211080 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c75a4f-c9c3-49e8-9b8d-824c04af95c1 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:30:54.214543 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 951/1895] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Oct 12 02:30:54 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 02:30:54.214543 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63da82b-dd22-4158-92f9-764d931cf793 admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:30:54.239846 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 945/1896] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Oct 12 02:30:54 2022] PUT /identity/v3/projects/1c93d8213e344008bb384f2a3c4cbdaa/users/d0490617213946d3a8b6b1c499121154/roles/39b1e8108dff402383def3c559f48189 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 02:30:54.239846 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c75a4f-c9c3-49e8-9b8d-824c04af95c1 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:30:54.267965 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63da82b-dd22-4158-92f9-764d931cf793 admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:30:54.353540 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c75a4f-c9c3-49e8-9b8d-824c04af95c1 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:30:54.364897 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794ec1fb-3d6c-42e6-ba4d-386fc5a53644 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:30:54.366464 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794ec1fb-3d6c-42e6-ba4d-386fc5a53644 admin admin] REQUEST_METHOD: `PUT` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:54.366814 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794ec1fb-3d6c-42e6-ba4d-386fc5a53644 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:54.370378 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794ec1fb-3d6c-42e6-ba4d-386fc5a53644 admin admin] PATH_INFO: `/v3/projects/c142382d0a9b422eb9d6921d1df9f512/users/ff01b495423d45e5baf33939d160118c/roles/3d75c4d7f1a849b9a771504d1583ab28` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:54.409862 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794ec1fb-3d6c-42e6-ba4d-386fc5a53644 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c142382d0a9b422eb9d6921d1df9f512, user_id=ff01b495423d45e5baf33939d160118c, role_id=3d75c4d7f1a849b9a771504d1583ab28)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:30:54.414005 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794ec1fb-3d6c-42e6-ba4d-386fc5a53644 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:30:54.434815 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be79e745-8318-47be-adba-bcb0f2b4712f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:30:54.435456 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be79e745-8318-47be-adba-bcb0f2b4712f admin admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:54.436277 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be79e745-8318-47be-adba-bcb0f2b4712f admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:54.436277 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be79e745-8318-47be-adba-bcb0f2b4712f admin admin] PATH_INFO: `/v3/roles` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:54.436690 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be79e745-8318-47be-adba-bcb0f2b4712f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:30:54.439279 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be79e745-8318-47be-adba-bcb0f2b4712f admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:30:54.459509 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 946/1897] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Oct 12 02:30:54 2022] PUT /identity/v3/projects/c142382d0a9b422eb9d6921d1df9f512/users/ff01b495423d45e5baf33939d160118c/roles/3d75c4d7f1a849b9a771504d1583ab28 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 02:30:54.459509 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794ec1fb-3d6c-42e6-ba4d-386fc5a53644 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:30:54.467708 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 952/1898] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Oct 12 02:30:54 2022] GET /identity/v3/roles => generated 1420 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 02:30:54.472802 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7610a384-7943-4e06-a17f-cb4c216a4041 None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:54.474332 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7610a384-7943-4e06-a17f-cb4c216a4041 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:54.474448 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7610a384-7943-4e06-a17f-cb4c216a4041 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:54.547243 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-7610a384-7943-4e06-a17f-cb4c216a4041 None None] MFA Rules not processed for user `ff01b495423d45e5baf33939d160118c`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:30:54.548545 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-7610a384-7943-4e06-a17f-cb4c216a4041 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:30:54.643469 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794ec1fb-3d6c-42e6-ba4d-386fc5a53644 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:30:54.653399 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20450240-34c9-4c7a-8efe-82c35580a02d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:30:54.654358 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20450240-34c9-4c7a-8efe-82c35580a02d admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:54.654642 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20450240-34c9-4c7a-8efe-82c35580a02d admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:54.654920 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20450240-34c9-4c7a-8efe-82c35580a02d admin admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:54.655580 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20450240-34c9-4c7a-8efe-82c35580a02d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:30:54.657353 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20450240-34c9-4c7a-8efe-82c35580a02d admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:30:54.672798 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 947/1899] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Oct 12 02:30:54 2022] GET /identity/v3/roles => generated 1420 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 02:30:54.673608 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20450240-34c9-4c7a-8efe-82c35580a02d admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:30:54.675173 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 953/1900] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 02:30:54 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 02:30:54.677827 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7610a384-7943-4e06-a17f-cb4c216a4041 None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:30:54.682298 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:30:54.687457 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20450240-34c9-4c7a-8efe-82c35580a02d admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:30:54.693246 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b82429-e650-4bee-a6ff-a71f40b86736 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:30:54.694051 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b82429-e650-4bee-a6ff-a71f40b86736 admin admin] REQUEST_METHOD: `PUT` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:54.695578 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b82429-e650-4bee-a6ff-a71f40b86736 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:54.697793 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b82429-e650-4bee-a6ff-a71f40b86736 admin admin] PATH_INFO: `/v3/projects/f6b071742149423995c67c40c840f14d/users/20865902190445fe890e632e85548ffb/roles/3d75c4d7f1a849b9a771504d1583ab28` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:54.700438 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7610a384-7943-4e06-a17f-cb4c216a4041 None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:30:54.708613 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed706c5e-c5b9-431a-992d-dcf90b278f21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:30:54.709527 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed706c5e-c5b9-431a-992d-dcf90b278f21 admin admin] REQUEST_METHOD: `PUT` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:54.710797 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed706c5e-c5b9-431a-992d-dcf90b278f21 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:54.711450 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed706c5e-c5b9-431a-992d-dcf90b278f21 admin admin] PATH_INFO: `/v3/projects/1c93d8213e344008bb384f2a3c4cbdaa/users/d0490617213946d3a8b6b1c499121154/roles/39b1e8108dff402383def3c559f48189` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:54.715999 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed706c5e-c5b9-431a-992d-dcf90b278f21 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c93d8213e344008bb384f2a3c4cbdaa, user_id=d0490617213946d3a8b6b1c499121154, role_id=39b1e8108dff402383def3c559f48189)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:30:54.719828 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed706c5e-c5b9-431a-992d-dcf90b278f21 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:30:54.727878 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b82429-e650-4bee-a6ff-a71f40b86736 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f6b071742149423995c67c40c840f14d, user_id=20865902190445fe890e632e85548ffb, role_id=3d75c4d7f1a849b9a771504d1583ab28)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:30:54.734450 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 954/1901] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Oct 12 02:30:54 2022] PUT /identity/v3/projects/1c93d8213e344008bb384f2a3c4cbdaa/users/d0490617213946d3a8b6b1c499121154/roles/39b1e8108dff402383def3c559f48189 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 02:30:54.735368 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed706c5e-c5b9-431a-992d-dcf90b278f21 admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:30:54.737033 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b82429-e650-4bee-a6ff-a71f40b86736 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:30:54.783149 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 948/1902] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Oct 12 02:30:54 2022] PUT /identity/v3/projects/f6b071742149423995c67c40c840f14d/users/20865902190445fe890e632e85548ffb/roles/3d75c4d7f1a849b9a771504d1583ab28 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 02:30:54.783149 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d854c09-a585-4cea-84c8-657cee94660c None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:54.783149 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d854c09-a585-4cea-84c8-657cee94660c None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:54.783149 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d854c09-a585-4cea-84c8-657cee94660c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:54.786410 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:30:54.817224 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-8d854c09-a585-4cea-84c8-657cee94660c None None] MFA Rules not processed for user `d0490617213946d3a8b6b1c499121154`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:30:54.818695 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-8d854c09-a585-4cea-84c8-657cee94660c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:30:54.853013 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed706c5e-c5b9-431a-992d-dcf90b278f21 admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:30:54.930672 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78b4c7b-1fb8-491a-857c-e96b048b3c6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:30:54.931528 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78b4c7b-1fb8-491a-857c-e96b048b3c6f admin admin] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:54.931871 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78b4c7b-1fb8-491a-857c-e96b048b3c6f admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:54.932250 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78b4c7b-1fb8-491a-857c-e96b048b3c6f admin admin] PATH_INFO: `/v3/projects` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:54.933123 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78b4c7b-1fb8-491a-857c-e96b048b3c6f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:30:54.935712 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78b4c7b-1fb8-491a-857c-e96b048b3c6f admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:30:54.962615 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 949/1903] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 02:30:54 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 02:30:54.966459 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b0bf20-b931-412d-9ca4-9b54b142efd8 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:54.967100 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b0bf20-b931-412d-9ca4-9b54b142efd8 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:54.967448 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b0bf20-b931-412d-9ca4-9b54b142efd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:54.983887 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 955/1904] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Oct 12 02:30:54 2022] POST /identity/v3/projects => generated 375 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 02:30:54.987145 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78b4c7b-1fb8-491a-857c-e96b048b3c6f admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:30:54.992887 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-b78b4c7b-1fb8-491a-857c-e96b048b3c6f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:30:55.023815 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-d8b0bf20-b931-412d-9ca4-9b54b142efd8 None None] MFA Rules not processed for user `20865902190445fe890e632e85548ffb`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:30:55.025177 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-d8b0bf20-b931-412d-9ca4-9b54b142efd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:30:55.112766 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78b4c7b-1fb8-491a-857c-e96b048b3c6f admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:30:55.119121 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879658f5-9cd8-4c90-8160-ae4cc2f90e1e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ba688e0c4d44d13898539ee886f95fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'beb6def6fcad45959e56425bb8bff4d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:30:55.120871 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879658f5-9cd8-4c90-8160-ae4cc2f90e1e service cinder] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:55.121150 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879658f5-9cd8-4c90-8160-ae4cc2f90e1e service cinder] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:55.121417 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879658f5-9cd8-4c90-8160-ae4cc2f90e1e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:55.155787 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 950/1905] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 02:30:54 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 02:30:55.156796 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b0bf20-b931-412d-9ca4-9b54b142efd8 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:30:55.229793 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879658f5-9cd8-4c90-8160-ae4cc2f90e1e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:30:55.231952 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879658f5-9cd8-4c90-8160-ae4cc2f90e1e service cinder] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:30:55.250239 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 956/1906] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 02:30:54 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 265 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 02:30:55.253714 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879658f5-9cd8-4c90-8160-ae4cc2f90e1e service cinder] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:30:55.273996 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:30:55.281734 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:30:55.292094 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b0bf20-b931-412d-9ca4-9b54b142efd8 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:30:55.311310 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf5f73a-aae2-46d8-b77e-04918c4f76ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:30:55.311310 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf5f73a-aae2-46d8-b77e-04918c4f76ca admin admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:55.311310 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf5f73a-aae2-46d8-b77e-04918c4f76ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:55.311310 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf5f73a-aae2-46d8-b77e-04918c4f76ca admin admin] PATH_INFO: `/v3/users` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:55.311731 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf5f73a-aae2-46d8-b77e-04918c4f76ca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:30:55.313778 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf5f73a-aae2-46d8-b77e-04918c4f76ca admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:30:55.368084 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 951/1907] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Oct 12 02:30:55 2022] POST /identity/v3/users => generated 294 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 02:30:55.369711 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf5f73a-aae2-46d8-b77e-04918c4f76ca admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:30:55.405629 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf5f73a-aae2-46d8-b77e-04918c4f76ca admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:30:55.421665 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5eb14f-75b5-44ec-abba-2021d1542839 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:30:55.423203 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5eb14f-75b5-44ec-abba-2021d1542839 admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:55.423569 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5eb14f-75b5-44ec-abba-2021d1542839 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:55.423917 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5eb14f-75b5-44ec-abba-2021d1542839 admin admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:55.425049 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5eb14f-75b5-44ec-abba-2021d1542839 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:30:55.427483 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5eb14f-75b5-44ec-abba-2021d1542839 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:30:55.447238 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 952/1908] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Oct 12 02:30:55 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 02:30:55.453457 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5eb14f-75b5-44ec-abba-2021d1542839 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:30:55.466406 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5eb14f-75b5-44ec-abba-2021d1542839 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:30:55.469416 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879658f5-9cd8-4c90-8160-ae4cc2f90e1e service cinder] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:30:55.472865 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50825934-5ec8-4a92-bad4-db9552b011d3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ba688e0c4d44d13898539ee886f95fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'beb6def6fcad45959e56425bb8bff4d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:30:55.474334 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50825934-5ec8-4a92-bad4-db9552b011d3 service cinder] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:55.474617 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50825934-5ec8-4a92-bad4-db9552b011d3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:55.474889 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50825934-5ec8-4a92-bad4-db9552b011d3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:55.487756 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b653c17-720f-4121-9d50-b07494e304e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:30:55.488385 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b653c17-720f-4121-9d50-b07494e304e8 admin admin] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:55.492183 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b653c17-720f-4121-9d50-b07494e304e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:55.492399 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b653c17-720f-4121-9d50-b07494e304e8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:55.493204 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b653c17-720f-4121-9d50-b07494e304e8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:30:55.495308 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b653c17-720f-4121-9d50-b07494e304e8 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:30:55.560972 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 957/1909] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Oct 12 02:30:55 2022] POST /identity/v3/projects => generated 385 bytes in 307 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 02:30:55.560972 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b653c17-720f-4121-9d50-b07494e304e8 admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:30:55.603294 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50825934-5ec8-4a92-bad4-db9552b011d3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:30:55.607300 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50825934-5ec8-4a92-bad4-db9552b011d3 service cinder] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:30:55.627705 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 953/1910] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 02:30:55 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 02:30:55.631091 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50825934-5ec8-4a92-bad4-db9552b011d3 service cinder] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:30:55.670810 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50825934-5ec8-4a92-bad4-db9552b011d3 service cinder] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:30:55.701472 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b653c17-720f-4121-9d50-b07494e304e8 admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:30:55.735055 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc5f153-f38a-4bc6-8a9d-c83bc73adf6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:30:55.735755 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc5f153-f38a-4bc6-8a9d-c83bc73adf6c admin admin] REQUEST_METHOD: `PUT` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:55.736022 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc5f153-f38a-4bc6-8a9d-c83bc73adf6c admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:55.736286 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc5f153-f38a-4bc6-8a9d-c83bc73adf6c admin admin] PATH_INFO: `/v3/projects/b7226b58854f4c5fba37b6606a505ed6/users/24c4a9769c8447bab33a0a74dac0f38e/roles/39b1e8108dff402383def3c559f48189` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:55.796125 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc5f153-f38a-4bc6-8a9d-c83bc73adf6c admin admin] RBAC: Authorizing `identity:create_grant(project_id=b7226b58854f4c5fba37b6606a505ed6, user_id=24c4a9769c8447bab33a0a74dac0f38e, role_id=39b1e8108dff402383def3c559f48189)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:30:55.800288 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc5f153-f38a-4bc6-8a9d-c83bc73adf6c admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:30:55.850613 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 958/1911] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Oct 12 02:30:55 2022] PUT /identity/v3/projects/b7226b58854f4c5fba37b6606a505ed6/users/24c4a9769c8447bab33a0a74dac0f38e/roles/39b1e8108dff402383def3c559f48189 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 02:30:55.851114 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc5f153-f38a-4bc6-8a9d-c83bc73adf6c admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:30:55.882861 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395f91ec-10f8-4415-aa8c-b7bb257c064d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:30:55.884789 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395f91ec-10f8-4415-aa8c-b7bb257c064d admin admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:55.885624 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395f91ec-10f8-4415-aa8c-b7bb257c064d admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:55.885943 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395f91ec-10f8-4415-aa8c-b7bb257c064d admin admin] PATH_INFO: `/v3/users` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:55.886606 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395f91ec-10f8-4415-aa8c-b7bb257c064d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:30:55.890419 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395f91ec-10f8-4415-aa8c-b7bb257c064d admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:30:55.935571 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 954/1912] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Oct 12 02:30:55 2022] POST /identity/v3/users => generated 299 bytes in 304 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 02:30:55.938240 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395f91ec-10f8-4415-aa8c-b7bb257c064d admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:30:55.976741 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395f91ec-10f8-4415-aa8c-b7bb257c064d admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:30:56.058725 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc5f153-f38a-4bc6-8a9d-c83bc73adf6c admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:30:56.063871 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab33240-bedf-4011-b397-025a34454ecd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:30:56.064577 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab33240-bedf-4011-b397-025a34454ecd admin admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:56.064820 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab33240-bedf-4011-b397-025a34454ecd admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:56.065351 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab33240-bedf-4011-b397-025a34454ecd admin admin] PATH_INFO: `/v3/roles` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:56.066014 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab33240-bedf-4011-b397-025a34454ecd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:30:56.067633 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab33240-bedf-4011-b397-025a34454ecd admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:30:56.080683 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 959/1913] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Oct 12 02:30:55 2022] GET /identity/v3/roles => generated 1420 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 02:30:56.085523 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab33240-bedf-4011-b397-025a34454ecd admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:30:56.102682 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab33240-bedf-4011-b397-025a34454ecd admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:30:56.116402 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36735594-58d2-4091-be5d-b6d1e813cce2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:30:56.117253 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36735594-58d2-4091-be5d-b6d1e813cce2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:56.120657 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36735594-58d2-4091-be5d-b6d1e813cce2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:56.120990 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36735594-58d2-4091-be5d-b6d1e813cce2 admin admin] PATH_INFO: `/v3/projects/b7226b58854f4c5fba37b6606a505ed6/users/24c4a9769c8447bab33a0a74dac0f38e/roles/39b1e8108dff402383def3c559f48189` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:56.123873 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36735594-58d2-4091-be5d-b6d1e813cce2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b7226b58854f4c5fba37b6606a505ed6, user_id=24c4a9769c8447bab33a0a74dac0f38e, role_id=39b1e8108dff402383def3c559f48189)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:30:56.126685 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36735594-58d2-4091-be5d-b6d1e813cce2 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:30:56.135088 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:30:56.155735 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 960/1914] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Oct 12 02:30:56 2022] PUT /identity/v3/projects/b7226b58854f4c5fba37b6606a505ed6/users/24c4a9769c8447bab33a0a74dac0f38e/roles/39b1e8108dff402383def3c559f48189 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 02:30:56.160706 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc678a60-b92a-4366-94cc-3acc495088f7 None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:56.161093 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc678a60-b92a-4366-94cc-3acc495088f7 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:56.161372 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc678a60-b92a-4366-94cc-3acc495088f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:56.164030 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a200795-2ffb-4bff-b5ef-27c2246f8f55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:30:56.165046 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a200795-2ffb-4bff-b5ef-27c2246f8f55 admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:56.165504 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a200795-2ffb-4bff-b5ef-27c2246f8f55 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:56.166063 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a200795-2ffb-4bff-b5ef-27c2246f8f55 admin admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:56.166900 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a200795-2ffb-4bff-b5ef-27c2246f8f55 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:30:56.170144 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a200795-2ffb-4bff-b5ef-27c2246f8f55 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:30:56.172829 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:30:56.197436 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 955/1915] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Oct 12 02:30:55 2022] GET /identity/v3/roles => generated 1420 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 12 02:30:56.198427 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a200795-2ffb-4bff-b5ef-27c2246f8f55 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:30:56.222935 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-bc678a60-b92a-4366-94cc-3acc495088f7 None None] MFA Rules not processed for user `24c4a9769c8447bab33a0a74dac0f38e`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:30:56.224771 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-bc678a60-b92a-4366-94cc-3acc495088f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:30:56.228616 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a200795-2ffb-4bff-b5ef-27c2246f8f55 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:30:56.354925 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a9199b-7785-4c1d-ab24-fd4ac56134ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:30:56.355637 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a9199b-7785-4c1d-ab24-fd4ac56134ba admin admin] REQUEST_METHOD: `PUT` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:56.355919 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a9199b-7785-4c1d-ab24-fd4ac56134ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:56.356402 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a9199b-7785-4c1d-ab24-fd4ac56134ba admin admin] PATH_INFO: `/v3/projects/9cade391f0f84dd8b163e6cee1dff430/users/6b1fdead936c4d4e8c393f1d7d9fe9e2/roles/39b1e8108dff402383def3c559f48189` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:56.362420 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 961/1916] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 02:30:56 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 02:30:56.378999 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc678a60-b92a-4366-94cc-3acc495088f7 None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:30:56.405992 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a9199b-7785-4c1d-ab24-fd4ac56134ba admin admin] RBAC: Authorizing `identity:create_grant(project_id=9cade391f0f84dd8b163e6cee1dff430, user_id=6b1fdead936c4d4e8c393f1d7d9fe9e2, role_id=39b1e8108dff402383def3c559f48189)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:30:56.411701 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a9199b-7785-4c1d-ab24-fd4ac56134ba admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:30:56.432334 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 956/1917] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Oct 12 02:30:56 2022] PUT /identity/v3/projects/9cade391f0f84dd8b163e6cee1dff430/users/6b1fdead936c4d4e8c393f1d7d9fe9e2/roles/39b1e8108dff402383def3c559f48189 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 02:30:56.440255 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a9199b-7785-4c1d-ab24-fd4ac56134ba admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:30:56.496364 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc678a60-b92a-4366-94cc-3acc495088f7 None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:30:56.577911 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a9199b-7785-4c1d-ab24-fd4ac56134ba admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:30:56.588497 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bdb643-39c0-4c07-b5da-a09e6b5205d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:30:56.589188 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bdb643-39c0-4c07-b5da-a09e6b5205d8 admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:56.589612 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bdb643-39c0-4c07-b5da-a09e6b5205d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:56.592320 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bdb643-39c0-4c07-b5da-a09e6b5205d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:56.593426 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0bdb643-39c0-4c07-b5da-a09e6b5205d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:30:56.595642 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0bdb643-39c0-4c07-b5da-a09e6b5205d8 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:30:56.615448 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 957/1918] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Oct 12 02:30:56 2022] GET /identity/v3/roles => generated 1420 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 02:30:56.619392 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a708ea4-7e1b-4825-8aac-922ed216c7c0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ba688e0c4d44d13898539ee886f95fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'beb6def6fcad45959e56425bb8bff4d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:30:56.619601 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bdb643-39c0-4c07-b5da-a09e6b5205d8 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:30:56.620375 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a708ea4-7e1b-4825-8aac-922ed216c7c0 service cinder] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:56.620938 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a708ea4-7e1b-4825-8aac-922ed216c7c0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:56.621362 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a708ea4-7e1b-4825-8aac-922ed216c7c0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:56.636534 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bdb643-39c0-4c07-b5da-a09e6b5205d8 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:30:56.642272 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04826ef-b71b-4b55-82fb-26a2b4b35ea0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:30:56.643704 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04826ef-b71b-4b55-82fb-26a2b4b35ea0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:56.643704 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04826ef-b71b-4b55-82fb-26a2b4b35ea0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:56.643704 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04826ef-b71b-4b55-82fb-26a2b4b35ea0 admin admin] PATH_INFO: `/v3/projects/9cade391f0f84dd8b163e6cee1dff430/users/6b1fdead936c4d4e8c393f1d7d9fe9e2/roles/39b1e8108dff402383def3c559f48189` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:56.645930 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04826ef-b71b-4b55-82fb-26a2b4b35ea0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9cade391f0f84dd8b163e6cee1dff430, user_id=6b1fdead936c4d4e8c393f1d7d9fe9e2, role_id=39b1e8108dff402383def3c559f48189)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:30:56.651651 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04826ef-b71b-4b55-82fb-26a2b4b35ea0 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:30:56.677211 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 958/1919] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Oct 12 02:30:56 2022] PUT /identity/v3/projects/9cade391f0f84dd8b163e6cee1dff430/users/6b1fdead936c4d4e8c393f1d7d9fe9e2/roles/39b1e8108dff402383def3c559f48189 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 02:30:56.691546 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33acaefd-6a58-41ca-8aa4-179764e641ab None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:56.693350 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33acaefd-6a58-41ca-8aa4-179764e641ab None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:56.693837 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33acaefd-6a58-41ca-8aa4-179764e641ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:56.734903 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:30:56.752136 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a708ea4-7e1b-4825-8aac-922ed216c7c0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:30:56.754154 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a708ea4-7e1b-4825-8aac-922ed216c7c0 service cinder] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:30:56.769235 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-33acaefd-6a58-41ca-8aa4-179764e641ab None None] MFA Rules not processed for user `6b1fdead936c4d4e8c393f1d7d9fe9e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:30:56.770855 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-33acaefd-6a58-41ca-8aa4-179764e641ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:30:56.794374 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 962/1920] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 02:30:56 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 416 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 12 02:30:56.864781 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:30:56.916665 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 959/1921] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 02:30:56 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 02:30:56.952416 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a708ea4-7e1b-4825-8aac-922ed216c7c0 service cinder] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:30:56.953957 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-7a708ea4-7e1b-4825-8aac-922ed216c7c0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:30:56.978594 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a708ea4-7e1b-4825-8aac-922ed216c7c0 service cinder] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:30:57.154001 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8eeaf5-5747-4edd-86e1-ed354527eba7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ba688e0c4d44d13898539ee886f95fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'beb6def6fcad45959e56425bb8bff4d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:30:57.156688 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8eeaf5-5747-4edd-86e1-ed354527eba7 service cinder] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:57.157058 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8eeaf5-5747-4edd-86e1-ed354527eba7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:57.157254 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8eeaf5-5747-4edd-86e1-ed354527eba7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:57.295968 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8eeaf5-5747-4edd-86e1-ed354527eba7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:30:57.298435 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8eeaf5-5747-4edd-86e1-ed354527eba7 service cinder] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:30:57.333012 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 963/1922] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 02:30:56 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 02:30:57.707076 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cceb2450-bcc4-4af4-8a61-8e26fe535036 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:57.707600 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cceb2450-bcc4-4af4-8a61-8e26fe535036 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:57.707600 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cceb2450-bcc4-4af4-8a61-8e26fe535036 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:57.752019 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-cceb2450-bcc4-4af4-8a61-8e26fe535036 None None] MFA Rules not processed for user `7a9ab860b4294375bf1bc1758e345644`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:30:57.756520 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-cceb2450-bcc4-4af4-8a61-8e26fe535036 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:30:57.920296 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8eeaf5-5747-4edd-86e1-ed354527eba7 service cinder] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:30:57.923267 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-2b8eeaf5-5747-4edd-86e1-ed354527eba7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:30:57.925190 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 960/1923] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 02:30:57 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 02:30:58.069185 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8eeaf5-5747-4edd-86e1-ed354527eba7 service cinder] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:30:58.075911 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf42b9c-5f11-4433-81f3-1e8bb2116e70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:30:58.076694 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf42b9c-5f11-4433-81f3-1e8bb2116e70 admin admin] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:58.076952 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf42b9c-5f11-4433-81f3-1e8bb2116e70 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:58.077223 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf42b9c-5f11-4433-81f3-1e8bb2116e70 admin admin] PATH_INFO: `/v3/projects` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:58.077986 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf42b9c-5f11-4433-81f3-1e8bb2116e70 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:30:58.082496 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf42b9c-5f11-4433-81f3-1e8bb2116e70 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:30:58.123410 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 964/1924] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Oct 12 02:30:57 2022] POST /identity/v3/projects => generated 383 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 02:30:58.127639 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cceb2450-bcc4-4af4-8a61-8e26fe535036 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:30:58.140765 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cceb2450-bcc4-4af4-8a61-8e26fe535036 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:30:58.219258 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690e8246-305c-4e7c-a53d-d1bcb5e99682 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:30:58.219883 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690e8246-305c-4e7c-a53d-d1bcb5e99682 admin admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:58.220156 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690e8246-305c-4e7c-a53d-d1bcb5e99682 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:58.220424 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690e8246-305c-4e7c-a53d-d1bcb5e99682 admin admin] PATH_INFO: `/v3/users` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:58.221108 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690e8246-305c-4e7c-a53d-d1bcb5e99682 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:30:58.223153 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690e8246-305c-4e7c-a53d-d1bcb5e99682 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:30:58.250135 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 961/1925] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Oct 12 02:30:58 2022] POST /identity/v3/users => generated 298 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 02:30:58.253974 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf42b9c-5f11-4433-81f3-1e8bb2116e70 admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:30:58.266571 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf42b9c-5f11-4433-81f3-1e8bb2116e70 admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:30:58.272278 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383abcc2-69eb-46eb-b10a-7d69a1c7efe8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:30:58.273069 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383abcc2-69eb-46eb-b10a-7d69a1c7efe8 admin admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:58.273420 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383abcc2-69eb-46eb-b10a-7d69a1c7efe8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:58.274395 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383abcc2-69eb-46eb-b10a-7d69a1c7efe8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:58.276542 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383abcc2-69eb-46eb-b10a-7d69a1c7efe8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:30:58.276542 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383abcc2-69eb-46eb-b10a-7d69a1c7efe8 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:30:58.291923 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 965/1926] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Oct 12 02:30:58 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 02:30:58.294430 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690e8246-305c-4e7c-a53d-d1bcb5e99682 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:30:58.306404 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690e8246-305c-4e7c-a53d-d1bcb5e99682 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:30:58.313041 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599c0837-5b65-4239-abd5-bbd2f0c58c23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:30:58.313895 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599c0837-5b65-4239-abd5-bbd2f0c58c23 admin admin] REQUEST_METHOD: `PUT` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:58.314166 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599c0837-5b65-4239-abd5-bbd2f0c58c23 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:58.314463 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599c0837-5b65-4239-abd5-bbd2f0c58c23 admin admin] PATH_INFO: `/v3/projects/b755104089d6459984db510b138b37e0/users/3e1c3acb0e4141278265235d6ffa5b32/roles/39b1e8108dff402383def3c559f48189` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:58.337485 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599c0837-5b65-4239-abd5-bbd2f0c58c23 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b755104089d6459984db510b138b37e0, user_id=3e1c3acb0e4141278265235d6ffa5b32, role_id=39b1e8108dff402383def3c559f48189)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:30:58.341180 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599c0837-5b65-4239-abd5-bbd2f0c58c23 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:30:58.358242 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 962/1927] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Oct 12 02:30:58 2022] PUT /identity/v3/projects/b755104089d6459984db510b138b37e0/users/3e1c3acb0e4141278265235d6ffa5b32/roles/39b1e8108dff402383def3c559f48189 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 02:30:58.362574 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383abcc2-69eb-46eb-b10a-7d69a1c7efe8 admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:30:58.389021 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383abcc2-69eb-46eb-b10a-7d69a1c7efe8 admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:30:58.420317 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:30:58.486103 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae9605a-712b-4209-a309-ac5ea872503f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:30:58.487003 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae9605a-712b-4209-a309-ac5ea872503f admin admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:58.487292 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae9605a-712b-4209-a309-ac5ea872503f admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:58.487567 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae9605a-712b-4209-a309-ac5ea872503f admin admin] PATH_INFO: `/v3/roles` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:58.489236 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae9605a-712b-4209-a309-ac5ea872503f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:30:58.492601 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae9605a-712b-4209-a309-ac5ea872503f admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:30:58.506707 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 966/1928] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Oct 12 02:30:58 2022] GET /identity/v3/roles => generated 1420 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 02:30:58.511100 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599c0837-5b65-4239-abd5-bbd2f0c58c23 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:30:58.526117 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599c0837-5b65-4239-abd5-bbd2f0c58c23 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:30:58.532043 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4587766-3d2e-4539-a351-513f68252595 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:30:58.534178 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4587766-3d2e-4539-a351-513f68252595 admin admin] REQUEST_METHOD: `PUT` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:58.535165 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4587766-3d2e-4539-a351-513f68252595 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:58.535165 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4587766-3d2e-4539-a351-513f68252595 admin admin] PATH_INFO: `/v3/projects/b755104089d6459984db510b138b37e0/users/3e1c3acb0e4141278265235d6ffa5b32/roles/39b1e8108dff402383def3c559f48189` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:58.541313 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4587766-3d2e-4539-a351-513f68252595 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b755104089d6459984db510b138b37e0, user_id=3e1c3acb0e4141278265235d6ffa5b32, role_id=39b1e8108dff402383def3c559f48189)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:30:58.544950 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4587766-3d2e-4539-a351-513f68252595 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:30:58.558925 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 963/1929] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Oct 12 02:30:58 2022] PUT /identity/v3/projects/b755104089d6459984db510b138b37e0/users/3e1c3acb0e4141278265235d6ffa5b32/roles/39b1e8108dff402383def3c559f48189 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 02:30:58.908945 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae9605a-712b-4209-a309-ac5ea872503f admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:30:59.070515 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae9605a-712b-4209-a309-ac5ea872503f admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:30:59.215147 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7d2ca7-eb82-4b12-83da-4e222b02892f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ba688e0c4d44d13898539ee886f95fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'beb6def6fcad45959e56425bb8bff4d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:30:59.216700 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7d2ca7-eb82-4b12-83da-4e222b02892f service cinder] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:30:59.217174 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7d2ca7-eb82-4b12-83da-4e222b02892f service cinder] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:30:59.217507 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7d2ca7-eb82-4b12-83da-4e222b02892f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:30:59.353145 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7d2ca7-eb82-4b12-83da-4e222b02892f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:30:59.355289 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7d2ca7-eb82-4b12-83da-4e222b02892f service cinder] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:30:59.376225 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 967/1930] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 02:30:58 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 468 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 02:31:00.502350 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4587766-3d2e-4539-a351-513f68252595 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:31:00.523888 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4587766-3d2e-4539-a351-513f68252595 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:31:00.533160 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d74748-7861-4a18-a16f-54bf6a51b70e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ba688e0c4d44d13898539ee886f95fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'beb6def6fcad45959e56425bb8bff4d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:31:00.533866 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d74748-7861-4a18-a16f-54bf6a51b70e service cinder] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:31:00.534341 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d74748-7861-4a18-a16f-54bf6a51b70e service cinder] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:31:00.534768 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d74748-7861-4a18-a16f-54bf6a51b70e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:31:00.667578 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:31:00.737832 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d74748-7861-4a18-a16f-54bf6a51b70e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:31:00.739509 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d74748-7861-4a18-a16f-54bf6a51b70e service cinder] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:31:00.753708 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 964/1931] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 02:31:00 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 252 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 02:31:03.785173 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7d2ca7-eb82-4b12-83da-4e222b02892f service cinder] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:31:03.799146 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7d2ca7-eb82-4b12-83da-4e222b02892f service cinder] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:31:03.829567 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9e82ac-e6b0-4962-8d8e-af05ebd2454d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ba688e0c4d44d13898539ee886f95fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'beb6def6fcad45959e56425bb8bff4d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:31:03.829567 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9e82ac-e6b0-4962-8d8e-af05ebd2454d service cinder] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:31:03.829771 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9e82ac-e6b0-4962-8d8e-af05ebd2454d service cinder] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:31:03.831740 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9e82ac-e6b0-4962-8d8e-af05ebd2454d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:31:03.931938 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:31:04.009430 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9e82ac-e6b0-4962-8d8e-af05ebd2454d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:31:04.011545 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9e82ac-e6b0-4962-8d8e-af05ebd2454d service cinder] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:31:04.040292 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 968/1932] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 02:31:03 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 255 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 02:31:05.719501 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d74748-7861-4a18-a16f-54bf6a51b70e service cinder] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:31:05.842778 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d74748-7861-4a18-a16f-54bf6a51b70e service cinder] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:31:05.850452 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae417e10-3d86-4b44-a305-cee3a0eb4da7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:31:05.851326 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae417e10-3d86-4b44-a305-cee3a0eb4da7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:31:05.852295 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae417e10-3d86-4b44-a305-cee3a0eb4da7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:31:05.853268 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae417e10-3d86-4b44-a305-cee3a0eb4da7 admin admin] PATH_INFO: `/v3/users/eeff63d8fa174895afac6e61fa07e004` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:31:05.855029 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae417e10-3d86-4b44-a305-cee3a0eb4da7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eeff63d8fa174895afac6e61fa07e004)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:31:05.860257 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae417e10-3d86-4b44-a305-cee3a0eb4da7 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:31:06.065741 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-ae417e10-3d86-4b44-a305-cee3a0eb4da7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eeff63d8fa174895afac6e61fa07e004'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:31:06.092502 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-ae417e10-3d86-4b44-a305-cee3a0eb4da7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eeff63d8fa174895afac6e61fa07e004'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:31:06.127263 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-ae417e10-3d86-4b44-a305-cee3a0eb4da7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eeff63d8fa174895afac6e61fa07e004'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:31:06.141814 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-ae417e10-3d86-4b44-a305-cee3a0eb4da7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eeff63d8fa174895afac6e61fa07e004'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:31:06.142569 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-ae417e10-3d86-4b44-a305-cee3a0eb4da7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eeff63d8fa174895afac6e61fa07e004'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:31:06.169771 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 965/1933] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Oct 12 02:31:05 2022] DELETE /identity/v3/users/eeff63d8fa174895afac6e61fa07e004 => generated 0 bytes in 451 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 02:31:06.175000 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f684ad12-9e6c-468f-87ac-896eaedf27a7 None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:31:06.175818 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f684ad12-9e6c-468f-87ac-896eaedf27a7 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:31:06.176971 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f684ad12-9e6c-468f-87ac-896eaedf27a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:31:06.210162 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-f684ad12-9e6c-468f-87ac-896eaedf27a7 None None] MFA Rules not processed for user `a326a5bb7364479382f528a592371656`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:31:06.212901 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-f684ad12-9e6c-468f-87ac-896eaedf27a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:31:06.416075 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 969/1934] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 02:31:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 02:31:06.432926 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae417e10-3d86-4b44-a305-cee3a0eb4da7 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:31:06.434969 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-ae417e10-3d86-4b44-a305-cee3a0eb4da7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:31:06.584783 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:31:06.633743 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae417e10-3d86-4b44-a305-cee3a0eb4da7 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:31:06.646383 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c64d82-0c4c-4b34-9148-cabc1a13b275 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5223b5cab3114e9b9a13c582f8ef8386', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'beb6def6fcad45959e56425bb8bff4d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:31:06.647027 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c64d82-0c4c-4b34-9148-cabc1a13b275 service neutron] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:31:06.647315 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c64d82-0c4c-4b34-9148-cabc1a13b275 service neutron] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:31:06.647606 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c64d82-0c4c-4b34-9148-cabc1a13b275 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:31:06.675022 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c64d82-0c4c-4b34-9148-cabc1a13b275 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:31:06.676637 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c64d82-0c4c-4b34-9148-cabc1a13b275 service neutron] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:31:06.704882 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 966/1935] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 02:31:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 272 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 02:31:06.815137 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbfee36-7f90-43cc-8bd2-aeadd162d2f1 None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:31:06.815773 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbfee36-7f90-43cc-8bd2-aeadd162d2f1 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:31:06.816279 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbfee36-7f90-43cc-8bd2-aeadd162d2f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:31:06.869376 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-6bbfee36-7f90-43cc-8bd2-aeadd162d2f1 None None] MFA Rules not processed for user `3e1c3acb0e4141278265235d6ffa5b32`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:31:06.871095 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-6bbfee36-7f90-43cc-8bd2-aeadd162d2f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:31:07.021145 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 970/1936] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 02:31:06 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 02:31:07.029310 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c64d82-0c4c-4b34-9148-cabc1a13b275 service neutron] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:31:07.030874 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-72c64d82-0c4c-4b34-9148-cabc1a13b275 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:31:07.164356 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c64d82-0c4c-4b34-9148-cabc1a13b275 service neutron] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:31:07.178766 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfd54e5-6784-40d2-9264-59fe044bb9f2 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8285a132afeb47558e1b3dcedfd7b4e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'beb6def6fcad45959e56425bb8bff4d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:31:07.179669 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfd54e5-6784-40d2-9264-59fe044bb9f2 service glance] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:31:07.179952 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfd54e5-6784-40d2-9264-59fe044bb9f2 service glance] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:31:07.180318 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfd54e5-6784-40d2-9264-59fe044bb9f2 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:31:07.189350 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-9bfd54e5-6784-40d2-9264-59fe044bb9f2 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:31:07.335919 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bfd54e5-6784-40d2-9264-59fe044bb9f2 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:31:07.338563 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bfd54e5-6784-40d2-9264-59fe044bb9f2 service glance] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:31:07.361228 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 967/1937] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 02:31:07 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 02:31:07.484649 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbfee36-7f90-43cc-8bd2-aeadd162d2f1 None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:31:07.486782 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-6bbfee36-7f90-43cc-8bd2-aeadd162d2f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:31:07.503346 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbfee36-7f90-43cc-8bd2-aeadd162d2f1 None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:31:07.511197 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a70b177-d1fc-4958-8884-cfe451ce5ccc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:31:07.512703 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a70b177-d1fc-4958-8884-cfe451ce5ccc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:31:07.513258 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a70b177-d1fc-4958-8884-cfe451ce5ccc admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:31:07.513610 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a70b177-d1fc-4958-8884-cfe451ce5ccc admin admin] PATH_INFO: `/v3/projects/a2140688aab345e3884a5aa98c17d2aa` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:31:07.514910 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a70b177-d1fc-4958-8884-cfe451ce5ccc admin admin] RBAC: Authorizing `identity:delete_project(project_id=a2140688aab345e3884a5aa98c17d2aa)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:31:07.517430 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a70b177-d1fc-4958-8884-cfe451ce5ccc admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:31:07.622494 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:31:07.628463 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-9a70b177-d1fc-4958-8884-cfe451ce5ccc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a2140688aab345e3884a5aa98c17d2aa', 'request_id': 'req-9a70b177-d1fc-4958-8884-cfe451ce5ccc'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:31:07.641385 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-9a70b177-d1fc-4958-8884-cfe451ce5ccc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a2140688aab345e3884a5aa98c17d2aa', 'request_id': 'req-9a70b177-d1fc-4958-8884-cfe451ce5ccc'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:31:07.656642 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-9a70b177-d1fc-4958-8884-cfe451ce5ccc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a2140688aab345e3884a5aa98c17d2aa', 'request_id': 'req-9a70b177-d1fc-4958-8884-cfe451ce5ccc'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:31:07.692490 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-9a70b177-d1fc-4958-8884-cfe451ce5ccc admin admin] The token cache is being invalidate because project a2140688aab345e3884a5aa98c17d2aa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81361) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 02:31:07.692490 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-9a70b177-d1fc-4958-8884-cfe451ce5ccc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:31:07.692490 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-9a70b177-d1fc-4958-8884-cfe451ce5ccc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:31:07.693033 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 971/1938] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Oct 12 02:31:07 2022] DELETE /identity/v3/projects/a2140688aab345e3884a5aa98c17d2aa => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 02:31:07.696678 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfd54e5-6784-40d2-9264-59fe044bb9f2 service glance] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:31:07.705807 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fa1ec7-f97b-4cf9-a3ce-c187a70f1b35 None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:31:07.706097 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fa1ec7-f97b-4cf9-a3ce-c187a70f1b35 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:31:07.706391 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fa1ec7-f97b-4cf9-a3ce-c187a70f1b35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:31:07.717698 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfd54e5-6784-40d2-9264-59fe044bb9f2 service glance] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:31:07.731845 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-84fa1ec7-f97b-4cf9-a3ce-c187a70f1b35 None None] MFA Rules not processed for user `8d0e2087e5324071926c3dc3a3cb9b1d`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:31:07.732962 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-84fa1ec7-f97b-4cf9-a3ce-c187a70f1b35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:31:07.804971 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d008588-d868-47aa-aff2-eb61fadf4be5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:31:07.805725 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d008588-d868-47aa-aff2-eb61fadf4be5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:31:07.806045 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d008588-d868-47aa-aff2-eb61fadf4be5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:31:07.806357 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d008588-d868-47aa-aff2-eb61fadf4be5 admin admin] PATH_INFO: `/v3/users/ff01b495423d45e5baf33939d160118c` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:31:07.807929 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d008588-d868-47aa-aff2-eb61fadf4be5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ff01b495423d45e5baf33939d160118c)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:31:07.810787 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d008588-d868-47aa-aff2-eb61fadf4be5 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:31:07.821861 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 972/1939] 10.222.0.18 () {58 vars in 1009 bytes} [Wed Oct 12 02:31:07 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 02:31:07.856252 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:31:07.887897 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fa1ec7-f97b-4cf9-a3ce-c187a70f1b35 None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:31:07.893900 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-84fa1ec7-f97b-4cf9-a3ce-c187a70f1b35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:31:07.900682 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-9d008588-d868-47aa-aff2-eb61fadf4be5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ff01b495423d45e5baf33939d160118c'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:31:07.913664 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-9d008588-d868-47aa-aff2-eb61fadf4be5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ff01b495423d45e5baf33939d160118c'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:31:07.947329 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-9d008588-d868-47aa-aff2-eb61fadf4be5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ff01b495423d45e5baf33939d160118c'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:31:07.962622 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-9d008588-d868-47aa-aff2-eb61fadf4be5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ff01b495423d45e5baf33939d160118c'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:31:07.963791 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-9d008588-d868-47aa-aff2-eb61fadf4be5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ff01b495423d45e5baf33939d160118c'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:31:07.975000 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 968/1940] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Oct 12 02:31:07 2022] DELETE /identity/v3/users/ff01b495423d45e5baf33939d160118c => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 02:31:08.040069 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fa1ec7-f97b-4cf9-a3ce-c187a70f1b35 None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:31:08.169008 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccead71-d5c2-419a-bb3f-7c7aa9c69561 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af9bd50c42cc437dbdd5a431d8adbb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'beb6def6fcad45959e56425bb8bff4d1', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:31:08.169906 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccead71-d5c2-419a-bb3f-7c7aa9c69561 service swift] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:31:08.170456 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccead71-d5c2-419a-bb3f-7c7aa9c69561 service swift] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:31:08.171812 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccead71-d5c2-419a-bb3f-7c7aa9c69561 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:31:08.174391 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-7ccead71-d5c2-419a-bb3f-7c7aa9c69561 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:31:08.220556 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:31:08.285225 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ccead71-d5c2-419a-bb3f-7c7aa9c69561 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:31:08.287043 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ccead71-d5c2-419a-bb3f-7c7aa9c69561 service swift] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:31:08.297595 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 973/1941] 10.222.0.18 () {60 vars in 1384 bytes} [Wed Oct 12 02:31:07 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 12 02:31:08.472387 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d008588-d868-47aa-aff2-eb61fadf4be5 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:31:08.473844 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-9d008588-d868-47aa-aff2-eb61fadf4be5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:31:08.607842 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d008588-d868-47aa-aff2-eb61fadf4be5 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:31:08.618383 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62a53cc-a320-4cf9-a816-49bdd1e2bc67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:31:08.620358 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62a53cc-a320-4cf9-a816-49bdd1e2bc67 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:31:08.621321 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62a53cc-a320-4cf9-a816-49bdd1e2bc67 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:31:08.621807 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62a53cc-a320-4cf9-a816-49bdd1e2bc67 admin admin] PATH_INFO: `/v3/projects/c142382d0a9b422eb9d6921d1df9f512` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:31:08.625395 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62a53cc-a320-4cf9-a816-49bdd1e2bc67 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c142382d0a9b422eb9d6921d1df9f512)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:31:08.629823 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62a53cc-a320-4cf9-a816-49bdd1e2bc67 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:31:08.742927 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-c62a53cc-a320-4cf9-a816-49bdd1e2bc67 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c142382d0a9b422eb9d6921d1df9f512', 'request_id': 'req-c62a53cc-a320-4cf9-a816-49bdd1e2bc67'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:31:08.751499 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-c62a53cc-a320-4cf9-a816-49bdd1e2bc67 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c142382d0a9b422eb9d6921d1df9f512', 'request_id': 'req-c62a53cc-a320-4cf9-a816-49bdd1e2bc67'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:31:08.781510 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-c62a53cc-a320-4cf9-a816-49bdd1e2bc67 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c142382d0a9b422eb9d6921d1df9f512', 'request_id': 'req-c62a53cc-a320-4cf9-a816-49bdd1e2bc67'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:31:08.805538 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-c62a53cc-a320-4cf9-a816-49bdd1e2bc67 admin admin] The token cache is being invalidate because project c142382d0a9b422eb9d6921d1df9f512 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81362) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 02:31:08.805888 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-c62a53cc-a320-4cf9-a816-49bdd1e2bc67 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:31:08.806520 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-c62a53cc-a320-4cf9-a816-49bdd1e2bc67 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:31:08.811889 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 969/1942] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Oct 12 02:31:08 2022] DELETE /identity/v3/projects/c142382d0a9b422eb9d6921d1df9f512 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 02:31:08.813261 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccead71-d5c2-419a-bb3f-7c7aa9c69561 service swift] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:31:08.833536 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccead71-d5c2-419a-bb3f-7c7aa9c69561 service swift] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:31:08.946706 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d331a20-0c67-4e8d-8da5-21ca17e4e33b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:31:08.947184 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d331a20-0c67-4e8d-8da5-21ca17e4e33b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:31:08.947546 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d331a20-0c67-4e8d-8da5-21ca17e4e33b admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:31:08.947921 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d331a20-0c67-4e8d-8da5-21ca17e4e33b admin admin] PATH_INFO: `/v3/users/24c4a9769c8447bab33a0a74dac0f38e` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:31:08.950584 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d331a20-0c67-4e8d-8da5-21ca17e4e33b admin admin] RBAC: Authorizing `identity:delete_user(user_id=24c4a9769c8447bab33a0a74dac0f38e)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:31:08.953018 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d331a20-0c67-4e8d-8da5-21ca17e4e33b admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:31:09.028917 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-5d331a20-0c67-4e8d-8da5-21ca17e4e33b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '24c4a9769c8447bab33a0a74dac0f38e'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:31:09.046240 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-5d331a20-0c67-4e8d-8da5-21ca17e4e33b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '24c4a9769c8447bab33a0a74dac0f38e'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:31:09.075959 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-5d331a20-0c67-4e8d-8da5-21ca17e4e33b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '24c4a9769c8447bab33a0a74dac0f38e'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:31:09.087582 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-5d331a20-0c67-4e8d-8da5-21ca17e4e33b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '24c4a9769c8447bab33a0a74dac0f38e'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:31:09.088420 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-5d331a20-0c67-4e8d-8da5-21ca17e4e33b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '24c4a9769c8447bab33a0a74dac0f38e'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:31:09.110595 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 974/1943] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Oct 12 02:31:08 2022] DELETE /identity/v3/users/24c4a9769c8447bab33a0a74dac0f38e => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 02:31:09.490702 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62a53cc-a320-4cf9-a816-49bdd1e2bc67 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:31:09.492366 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-c62a53cc-a320-4cf9-a816-49bdd1e2bc67 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:31:09.510102 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62a53cc-a320-4cf9-a816-49bdd1e2bc67 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:31:09.556211 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:31:09.606595 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8821b0b-afd7-491c-a132-a5e406c0aa3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:31:09.607377 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8821b0b-afd7-491c-a132-a5e406c0aa3b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:31:09.607580 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8821b0b-afd7-491c-a132-a5e406c0aa3b admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:31:09.607858 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8821b0b-afd7-491c-a132-a5e406c0aa3b admin admin] PATH_INFO: `/v3/projects/b7226b58854f4c5fba37b6606a505ed6` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:31:09.610483 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8821b0b-afd7-491c-a132-a5e406c0aa3b admin admin] RBAC: Authorizing `identity:delete_project(project_id=b7226b58854f4c5fba37b6606a505ed6)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:31:09.612716 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8821b0b-afd7-491c-a132-a5e406c0aa3b admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:31:09.678151 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-b8821b0b-afd7-491c-a132-a5e406c0aa3b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b7226b58854f4c5fba37b6606a505ed6', 'request_id': 'req-b8821b0b-afd7-491c-a132-a5e406c0aa3b'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:31:09.691810 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-b8821b0b-afd7-491c-a132-a5e406c0aa3b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b7226b58854f4c5fba37b6606a505ed6', 'request_id': 'req-b8821b0b-afd7-491c-a132-a5e406c0aa3b'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:31:09.700399 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-b8821b0b-afd7-491c-a132-a5e406c0aa3b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b7226b58854f4c5fba37b6606a505ed6', 'request_id': 'req-b8821b0b-afd7-491c-a132-a5e406c0aa3b'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:31:09.717726 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-b8821b0b-afd7-491c-a132-a5e406c0aa3b admin admin] The token cache is being invalidate because project b7226b58854f4c5fba37b6606a505ed6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81362) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 02:31:09.718335 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-b8821b0b-afd7-491c-a132-a5e406c0aa3b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:31:09.719188 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-b8821b0b-afd7-491c-a132-a5e406c0aa3b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:31:09.724570 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 970/1944] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Oct 12 02:31:09 2022] DELETE /identity/v3/projects/b7226b58854f4c5fba37b6606a505ed6 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 02:31:10.127247 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d331a20-0c67-4e8d-8da5-21ca17e4e33b admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:31:10.129310 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-5d331a20-0c67-4e8d-8da5-21ca17e4e33b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:31:10.145497 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d331a20-0c67-4e8d-8da5-21ca17e4e33b admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:31:10.207422 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:31:10.245784 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f057db5-32ad-4cd2-a0e5-28bcd7bd9380 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:31:10.246589 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f057db5-32ad-4cd2-a0e5-28bcd7bd9380 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:31:10.246890 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f057db5-32ad-4cd2-a0e5-28bcd7bd9380 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:31:10.247146 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f057db5-32ad-4cd2-a0e5-28bcd7bd9380 admin admin] PATH_INFO: `/v3/users/20865902190445fe890e632e85548ffb` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:31:10.248304 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f057db5-32ad-4cd2-a0e5-28bcd7bd9380 admin admin] RBAC: Authorizing `identity:delete_user(user_id=20865902190445fe890e632e85548ffb)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:31:10.251378 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f057db5-32ad-4cd2-a0e5-28bcd7bd9380 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:31:10.343139 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-6f057db5-32ad-4cd2-a0e5-28bcd7bd9380 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '20865902190445fe890e632e85548ffb'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:31:10.361139 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-6f057db5-32ad-4cd2-a0e5-28bcd7bd9380 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '20865902190445fe890e632e85548ffb'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:31:10.378383 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-6f057db5-32ad-4cd2-a0e5-28bcd7bd9380 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '20865902190445fe890e632e85548ffb'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:31:10.385802 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-6f057db5-32ad-4cd2-a0e5-28bcd7bd9380 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '20865902190445fe890e632e85548ffb'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:31:10.387249 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-6f057db5-32ad-4cd2-a0e5-28bcd7bd9380 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '20865902190445fe890e632e85548ffb'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:31:10.394338 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 975/1945] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Oct 12 02:31:10 2022] DELETE /identity/v3/users/20865902190445fe890e632e85548ffb => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 02:31:10.399772 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd23d8e8-967f-4afc-a88c-ccbe854cf461 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:31:10.400144 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd23d8e8-967f-4afc-a88c-ccbe854cf461 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:31:10.400548 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd23d8e8-967f-4afc-a88c-ccbe854cf461 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:31:10.425269 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-cd23d8e8-967f-4afc-a88c-ccbe854cf461 None None] MFA Rules not processed for user `a326a5bb7364479382f528a592371656`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:31:10.426641 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-cd23d8e8-967f-4afc-a88c-ccbe854cf461 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:31:10.514597 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 971/1946] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 02:31:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 02:31:10.521757 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f057db5-32ad-4cd2-a0e5-28bcd7bd9380 admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:31:10.523569 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-6f057db5-32ad-4cd2-a0e5-28bcd7bd9380 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:31:10.602277 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f057db5-32ad-4cd2-a0e5-28bcd7bd9380 admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:31:10.608391 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a6c4a7-f3b6-4743-8957-493036173799 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5223b5cab3114e9b9a13c582f8ef8386', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'beb6def6fcad45959e56425bb8bff4d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:31:10.609313 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a6c4a7-f3b6-4743-8957-493036173799 service neutron] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:31:10.609592 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a6c4a7-f3b6-4743-8957-493036173799 service neutron] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:31:10.609862 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a6c4a7-f3b6-4743-8957-493036173799 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:31:10.619961 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a6c4a7-f3b6-4743-8957-493036173799 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:31:10.622686 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a6c4a7-f3b6-4743-8957-493036173799 service neutron] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:31:10.635029 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 976/1947] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 02:31:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 02:31:11.000600 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd23d8e8-967f-4afc-a88c-ccbe854cf461 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:31:11.002167 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-cd23d8e8-967f-4afc-a88c-ccbe854cf461 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:31:11.016013 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd23d8e8-967f-4afc-a88c-ccbe854cf461 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:31:11.023565 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b479f3e-4ba2-41b1-aeb8-0c71a2fea2cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:31:11.024928 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b479f3e-4ba2-41b1-aeb8-0c71a2fea2cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:31:11.025315 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b479f3e-4ba2-41b1-aeb8-0c71a2fea2cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:31:11.025663 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b479f3e-4ba2-41b1-aeb8-0c71a2fea2cb admin admin] PATH_INFO: `/v3/projects/f6b071742149423995c67c40c840f14d` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:31:11.035046 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b479f3e-4ba2-41b1-aeb8-0c71a2fea2cb admin admin] RBAC: Authorizing `identity:delete_project(project_id=f6b071742149423995c67c40c840f14d)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:31:11.037784 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b479f3e-4ba2-41b1-aeb8-0c71a2fea2cb admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:31:11.119842 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-0b479f3e-4ba2-41b1-aeb8-0c71a2fea2cb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f6b071742149423995c67c40c840f14d', 'request_id': 'req-0b479f3e-4ba2-41b1-aeb8-0c71a2fea2cb'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:31:11.127396 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:31:11.130135 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-0b479f3e-4ba2-41b1-aeb8-0c71a2fea2cb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f6b071742149423995c67c40c840f14d', 'request_id': 'req-0b479f3e-4ba2-41b1-aeb8-0c71a2fea2cb'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:31:11.141560 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-0b479f3e-4ba2-41b1-aeb8-0c71a2fea2cb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f6b071742149423995c67c40c840f14d', 'request_id': 'req-0b479f3e-4ba2-41b1-aeb8-0c71a2fea2cb'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:31:11.165925 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-0b479f3e-4ba2-41b1-aeb8-0c71a2fea2cb admin admin] The token cache is being invalidate because project f6b071742149423995c67c40c840f14d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81362) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 02:31:11.166607 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-0b479f3e-4ba2-41b1-aeb8-0c71a2fea2cb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:31:11.167390 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-0b479f3e-4ba2-41b1-aeb8-0c71a2fea2cb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:31:11.170673 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 972/1948] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Oct 12 02:31:10 2022] DELETE /identity/v3/projects/f6b071742149423995c67c40c840f14d => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 02:31:11.174023 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a6c4a7-f3b6-4743-8957-493036173799 service neutron] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:31:11.187122 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a6c4a7-f3b6-4743-8957-493036173799 service neutron] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:31:11.284279 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f6f7c9-f904-4a20-b186-f880185a955a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:31:11.286077 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f6f7c9-f904-4a20-b186-f880185a955a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:31:11.286614 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f6f7c9-f904-4a20-b186-f880185a955a admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:31:11.286987 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f6f7c9-f904-4a20-b186-f880185a955a admin admin] PATH_INFO: `/v3/users/6b1fdead936c4d4e8c393f1d7d9fe9e2` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:31:11.301337 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f6f7c9-f904-4a20-b186-f880185a955a admin admin] RBAC: Authorizing `identity:delete_user(user_id=6b1fdead936c4d4e8c393f1d7d9fe9e2)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:31:11.303322 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f6f7c9-f904-4a20-b186-f880185a955a admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:31:11.312682 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:31:11.383453 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-c8f6f7c9-f904-4a20-b186-f880185a955a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6b1fdead936c4d4e8c393f1d7d9fe9e2'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:31:11.394905 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-c8f6f7c9-f904-4a20-b186-f880185a955a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6b1fdead936c4d4e8c393f1d7d9fe9e2'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:31:11.412447 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-c8f6f7c9-f904-4a20-b186-f880185a955a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6b1fdead936c4d4e8c393f1d7d9fe9e2'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:31:11.422644 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-c8f6f7c9-f904-4a20-b186-f880185a955a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6b1fdead936c4d4e8c393f1d7d9fe9e2'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:31:11.425653 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-c8f6f7c9-f904-4a20-b186-f880185a955a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6b1fdead936c4d4e8c393f1d7d9fe9e2'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:31:11.444787 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 977/1949] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Oct 12 02:31:11 2022] DELETE /identity/v3/users/6b1fdead936c4d4e8c393f1d7d9fe9e2 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 02:31:11.917553 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b479f3e-4ba2-41b1-aeb8-0c71a2fea2cb admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:31:11.920900 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-0b479f3e-4ba2-41b1-aeb8-0c71a2fea2cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:31:11.953845 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b479f3e-4ba2-41b1-aeb8-0c71a2fea2cb admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:31:12.076525 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc071a9f-8519-4520-a32c-9caaa9edb7b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:31:12.077534 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc071a9f-8519-4520-a32c-9caaa9edb7b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:31:12.077969 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc071a9f-8519-4520-a32c-9caaa9edb7b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:31:12.078391 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc071a9f-8519-4520-a32c-9caaa9edb7b9 admin admin] PATH_INFO: `/v3/projects/9cade391f0f84dd8b163e6cee1dff430` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:31:12.082778 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc071a9f-8519-4520-a32c-9caaa9edb7b9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9cade391f0f84dd8b163e6cee1dff430)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:31:12.085815 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc071a9f-8519-4520-a32c-9caaa9edb7b9 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:31:12.155066 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-bc071a9f-8519-4520-a32c-9caaa9edb7b9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9cade391f0f84dd8b163e6cee1dff430', 'request_id': 'req-bc071a9f-8519-4520-a32c-9caaa9edb7b9'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:31:12.170229 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-bc071a9f-8519-4520-a32c-9caaa9edb7b9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9cade391f0f84dd8b163e6cee1dff430', 'request_id': 'req-bc071a9f-8519-4520-a32c-9caaa9edb7b9'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:31:12.181102 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-bc071a9f-8519-4520-a32c-9caaa9edb7b9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9cade391f0f84dd8b163e6cee1dff430', 'request_id': 'req-bc071a9f-8519-4520-a32c-9caaa9edb7b9'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:31:12.201280 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-bc071a9f-8519-4520-a32c-9caaa9edb7b9 admin admin] The token cache is being invalidate because project 9cade391f0f84dd8b163e6cee1dff430 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81362) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 02:31:12.201595 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-bc071a9f-8519-4520-a32c-9caaa9edb7b9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:31:12.202300 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-bc071a9f-8519-4520-a32c-9caaa9edb7b9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:31:12.204392 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 973/1950] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Oct 12 02:31:11 2022] DELETE /identity/v3/projects/9cade391f0f84dd8b163e6cee1dff430 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 02:31:12.211035 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d27494d-d43e-4b5f-9437-930eae483fdf None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:31:12.212006 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d27494d-d43e-4b5f-9437-930eae483fdf None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:31:12.212557 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d27494d-d43e-4b5f-9437-930eae483fdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:31:12.239285 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-7d27494d-d43e-4b5f-9437-930eae483fdf None None] MFA Rules not processed for user `a326a5bb7364479382f528a592371656`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:31:12.240709 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-7d27494d-d43e-4b5f-9437-930eae483fdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:31:12.312512 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 978/1951] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 02:31:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 02:31:12.319716 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ef65f6-c4ad-4da0-a94e-ddf381e39bca None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:31:12.319998 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ef65f6-c4ad-4da0-a94e-ddf381e39bca None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:31:12.320279 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ef65f6-c4ad-4da0-a94e-ddf381e39bca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:31:12.355955 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-a4ef65f6-c4ad-4da0-a94e-ddf381e39bca None None] MFA Rules not processed for user `a326a5bb7364479382f528a592371656`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:31:12.357829 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-a4ef65f6-c4ad-4da0-a94e-ddf381e39bca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:31:12.372438 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d27494d-d43e-4b5f-9437-930eae483fdf None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:31:12.382516 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 974/1952] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 02:31:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 02:31:12.394044 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d27494d-d43e-4b5f-9437-930eae483fdf None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:31:12.407823 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a035bebe-973c-475e-8570-94920f91005c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:31:12.409165 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a035bebe-973c-475e-8570-94920f91005c admin admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:31:12.409632 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a035bebe-973c-475e-8570-94920f91005c admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:31:12.410224 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a035bebe-973c-475e-8570-94920f91005c admin admin] PATH_INFO: `/v3/domains` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:31:12.411095 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a035bebe-973c-475e-8570-94920f91005c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 02:31:12.411602 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a035bebe-973c-475e-8570-94920f91005c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:31:12.413700 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a035bebe-973c-475e-8570-94920f91005c admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:31:12.429304 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 979/1953] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Oct 12 02:31:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 02:31:12.437409 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ef65f6-c4ad-4da0-a94e-ddf381e39bca None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:31:12.449901 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ef65f6-c4ad-4da0-a94e-ddf381e39bca None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:31:12.461649 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de806f18-ca97-4a86-ab7f-6ca1480f8424 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:31:12.462362 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de806f18-ca97-4a86-ab7f-6ca1480f8424 admin admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:31:12.462771 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de806f18-ca97-4a86-ab7f-6ca1480f8424 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:31:12.466068 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de806f18-ca97-4a86-ab7f-6ca1480f8424 admin admin] PATH_INFO: `/v3/projects` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:31:12.468002 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de806f18-ca97-4a86-ab7f-6ca1480f8424 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:31:12.470918 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de806f18-ca97-4a86-ab7f-6ca1480f8424 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:31:12.558018 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a035bebe-973c-475e-8570-94920f91005c admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:31:12.559419 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 975/1954] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Oct 12 02:31:12 2022] POST /identity/v3/projects => generated 377 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 02:31:12.586218 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a035bebe-973c-475e-8570-94920f91005c admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:31:12.670952 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0c077a-6f7e-48e2-b2d4-437b1eb03704 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:31:12.671577 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0c077a-6f7e-48e2-b2d4-437b1eb03704 admin admin] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:31:12.672203 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0c077a-6f7e-48e2-b2d4-437b1eb03704 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:31:12.672496 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0c077a-6f7e-48e2-b2d4-437b1eb03704 admin admin] PATH_INFO: `/v3/users` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:31:12.673180 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0c077a-6f7e-48e2-b2d4-437b1eb03704 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:31:12.677524 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0c077a-6f7e-48e2-b2d4-437b1eb03704 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:31:12.705826 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:31:12.726236 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de806f18-ca97-4a86-ab7f-6ca1480f8424 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:31:12.731582 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 980/1955] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Oct 12 02:31:12 2022] POST /identity/v3/users => generated 289 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 02:31:12.745190 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de806f18-ca97-4a86-ab7f-6ca1480f8424 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:31:12.761408 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e007d78c-ea72-43c6-8fc9-f44d9bfbcef1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:31:12.762248 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e007d78c-ea72-43c6-8fc9-f44d9bfbcef1 admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:31:12.762530 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e007d78c-ea72-43c6-8fc9-f44d9bfbcef1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:31:12.762802 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e007d78c-ea72-43c6-8fc9-f44d9bfbcef1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:31:12.763443 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e007d78c-ea72-43c6-8fc9-f44d9bfbcef1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:31:12.773074 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e007d78c-ea72-43c6-8fc9-f44d9bfbcef1 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:31:12.794920 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 976/1956] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Oct 12 02:31:12 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 12 02:31:12.798742 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0c077a-6f7e-48e2-b2d4-437b1eb03704 admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:31:12.816977 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0c077a-6f7e-48e2-b2d4-437b1eb03704 admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:31:12.828311 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e7ed6e-3cff-4820-89d6-8b4d2e18e5a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:31:12.833240 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e7ed6e-3cff-4820-89d6-8b4d2e18e5a7 admin admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:31:12.833530 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e7ed6e-3cff-4820-89d6-8b4d2e18e5a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:31:12.833807 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e7ed6e-3cff-4820-89d6-8b4d2e18e5a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:31:12.835555 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e7ed6e-3cff-4820-89d6-8b4d2e18e5a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:31:12.841075 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e7ed6e-3cff-4820-89d6-8b4d2e18e5a7 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:31:12.878860 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 981/1957] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Oct 12 02:31:12 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 12 02:31:12.882731 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e007d78c-ea72-43c6-8fc9-f44d9bfbcef1 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:31:12.911725 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e007d78c-ea72-43c6-8fc9-f44d9bfbcef1 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:31:12.925999 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb081a2-98de-4a7c-b6c2-ecb893fb7827 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:31:12.927739 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb081a2-98de-4a7c-b6c2-ecb893fb7827 admin admin] REQUEST_METHOD: `PUT` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:31:12.928230 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb081a2-98de-4a7c-b6c2-ecb893fb7827 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:31:12.928690 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb081a2-98de-4a7c-b6c2-ecb893fb7827 admin admin] PATH_INFO: `/v3/projects/85eb90d06e4d4062875baa2069a1d56a/users/4144d6b3eda947488a378d2de560e6b6/roles/3d75c4d7f1a849b9a771504d1583ab28` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:31:12.972403 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb081a2-98de-4a7c-b6c2-ecb893fb7827 admin admin] RBAC: Authorizing `identity:create_grant(project_id=85eb90d06e4d4062875baa2069a1d56a, user_id=4144d6b3eda947488a378d2de560e6b6, role_id=3d75c4d7f1a849b9a771504d1583ab28)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:31:12.975562 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb081a2-98de-4a7c-b6c2-ecb893fb7827 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:31:13.011013 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 977/1958] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Oct 12 02:31:12 2022] PUT /identity/v3/projects/85eb90d06e4d4062875baa2069a1d56a/users/4144d6b3eda947488a378d2de560e6b6/roles/3d75c4d7f1a849b9a771504d1583ab28 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 02:31:13.024444 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee2e284-173a-47ed-bf72-38727edb80ce None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:31:13.024889 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee2e284-173a-47ed-bf72-38727edb80ce None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:31:13.025149 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee2e284-173a-47ed-bf72-38727edb80ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:31:13.067030 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-1ee2e284-173a-47ed-bf72-38727edb80ce None None] MFA Rules not processed for user `4144d6b3eda947488a378d2de560e6b6`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:31:13.068315 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-1ee2e284-173a-47ed-bf72-38727edb80ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:31:13.259091 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 982/1959] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 02:31:13 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 02:31:13.272754 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb081a2-98de-4a7c-b6c2-ecb893fb7827 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:31:13.274781 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-1fb081a2-98de-4a7c-b6c2-ecb893fb7827 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:31:13.319072 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=88,keystone:INSERT=4,keystone:DELETE=8 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:31:13.448691 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb081a2-98de-4a7c-b6c2-ecb893fb7827 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:31:13.453224 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fc4515-94f1-4f78-bbe6-ef8cb0bb4aca service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8285a132afeb47558e1b3dcedfd7b4e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'beb6def6fcad45959e56425bb8bff4d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:31:13.453930 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fc4515-94f1-4f78-bbe6-ef8cb0bb4aca service glance] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:31:13.454270 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fc4515-94f1-4f78-bbe6-ef8cb0bb4aca service glance] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:31:13.454544 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fc4515-94f1-4f78-bbe6-ef8cb0bb4aca service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:31:13.465261 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1fc4515-94f1-4f78-bbe6-ef8cb0bb4aca service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:31:13.466932 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1fc4515-94f1-4f78-bbe6-ef8cb0bb4aca service glance] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:31:13.487824 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 978/1960] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 02:31:13 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 02:31:16.447881 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee2e284-173a-47ed-bf72-38727edb80ce None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:31:16.453182 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-1ee2e284-173a-47ed-bf72-38727edb80ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:31:16.578990 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee2e284-173a-47ed-bf72-38727edb80ce None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:31:16.584354 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df0223b-48b0-495c-88be-5414f1dcfa19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:31:16.585079 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df0223b-48b0-495c-88be-5414f1dcfa19 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:31:16.585364 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df0223b-48b0-495c-88be-5414f1dcfa19 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:31:16.585636 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df0223b-48b0-495c-88be-5414f1dcfa19 admin admin] PATH_INFO: `/v3/users/eadcf6d173f24d74942b2d43d6767566` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:31:16.586762 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df0223b-48b0-495c-88be-5414f1dcfa19 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eadcf6d173f24d74942b2d43d6767566)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:31:16.588720 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df0223b-48b0-495c-88be-5414f1dcfa19 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:31:16.653179 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-3df0223b-48b0-495c-88be-5414f1dcfa19 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eadcf6d173f24d74942b2d43d6767566'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:31:16.663018 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-3df0223b-48b0-495c-88be-5414f1dcfa19 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eadcf6d173f24d74942b2d43d6767566'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:31:16.677040 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-3df0223b-48b0-495c-88be-5414f1dcfa19 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eadcf6d173f24d74942b2d43d6767566'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:31:16.686993 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-3df0223b-48b0-495c-88be-5414f1dcfa19 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eadcf6d173f24d74942b2d43d6767566'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:31:16.687829 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-3df0223b-48b0-495c-88be-5414f1dcfa19 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eadcf6d173f24d74942b2d43d6767566'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:31:16.693410 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:31:16.695233 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 983/1961] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Oct 12 02:31:16 2022] DELETE /identity/v3/users/eadcf6d173f24d74942b2d43d6767566 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 02:31:16.700920 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358a319e-7188-4d9d-b6b5-fb73050a131e None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:31:16.702129 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358a319e-7188-4d9d-b6b5-fb73050a131e None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:31:16.702687 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358a319e-7188-4d9d-b6b5-fb73050a131e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:31:16.730755 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-358a319e-7188-4d9d-b6b5-fb73050a131e None None] MFA Rules not processed for user `a326a5bb7364479382f528a592371656`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:31:16.732263 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-358a319e-7188-4d9d-b6b5-fb73050a131e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:31:16.817460 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 979/1962] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 02:31:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 02:31:16.827533 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df0223b-48b0-495c-88be-5414f1dcfa19 admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:31:16.829037 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-3df0223b-48b0-495c-88be-5414f1dcfa19 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:31:16.914432 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df0223b-48b0-495c-88be-5414f1dcfa19 admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:31:16.926816 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96ed231-91c5-4bc5-984b-f76a5deb9f12 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5223b5cab3114e9b9a13c582f8ef8386', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'beb6def6fcad45959e56425bb8bff4d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:31:16.927475 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96ed231-91c5-4bc5-984b-f76a5deb9f12 service neutron] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:31:16.927780 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96ed231-91c5-4bc5-984b-f76a5deb9f12 service neutron] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:31:16.928060 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96ed231-91c5-4bc5-984b-f76a5deb9f12 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:31:16.948346 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96ed231-91c5-4bc5-984b-f76a5deb9f12 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:31:16.950002 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96ed231-91c5-4bc5-984b-f76a5deb9f12 service neutron] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:31:16.961836 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 984/1963] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 02:31:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 12 02:31:17.404564 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358a319e-7188-4d9d-b6b5-fb73050a131e None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:31:17.406088 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-358a319e-7188-4d9d-b6b5-fb73050a131e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:31:17.425582 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358a319e-7188-4d9d-b6b5-fb73050a131e None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:31:17.467768 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b64c9d-f906-427b-8509-8e10c7f59ca4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:31:17.468555 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b64c9d-f906-427b-8509-8e10c7f59ca4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:31:17.468931 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b64c9d-f906-427b-8509-8e10c7f59ca4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:31:17.469362 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b64c9d-f906-427b-8509-8e10c7f59ca4 admin admin] PATH_INFO: `/v3/projects/bcf61b78dd6641928136ec6c0ac0bb59` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:31:17.471378 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b64c9d-f906-427b-8509-8e10c7f59ca4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bcf61b78dd6641928136ec6c0ac0bb59)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:31:17.473416 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b64c9d-f906-427b-8509-8e10c7f59ca4 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:31:17.580329 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-61b64c9d-f906-427b-8509-8e10c7f59ca4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bcf61b78dd6641928136ec6c0ac0bb59', 'request_id': 'req-61b64c9d-f906-427b-8509-8e10c7f59ca4'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:31:17.587598 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-61b64c9d-f906-427b-8509-8e10c7f59ca4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bcf61b78dd6641928136ec6c0ac0bb59', 'request_id': 'req-61b64c9d-f906-427b-8509-8e10c7f59ca4'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:31:17.595332 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-61b64c9d-f906-427b-8509-8e10c7f59ca4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bcf61b78dd6641928136ec6c0ac0bb59', 'request_id': 'req-61b64c9d-f906-427b-8509-8e10c7f59ca4'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:31:17.618513 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-61b64c9d-f906-427b-8509-8e10c7f59ca4 admin admin] The token cache is being invalidate because project bcf61b78dd6641928136ec6c0ac0bb59 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81362) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 02:31:17.618820 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-61b64c9d-f906-427b-8509-8e10c7f59ca4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:31:17.619482 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-61b64c9d-f906-427b-8509-8e10c7f59ca4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:31:17.622711 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 980/1964] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Oct 12 02:31:17 2022] DELETE /identity/v3/projects/bcf61b78dd6641928136ec6c0ac0bb59 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 02:31:17.626914 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96ed231-91c5-4bc5-984b-f76a5deb9f12 service neutron] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:31:17.640860 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96ed231-91c5-4bc5-984b-f76a5deb9f12 service neutron] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:31:17.714303 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a40f18-4ace-4271-ac3f-7cbb239b7aa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:31:17.715228 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a40f18-4ace-4271-ac3f-7cbb239b7aa6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:31:17.715614 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a40f18-4ace-4271-ac3f-7cbb239b7aa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:31:17.716132 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a40f18-4ace-4271-ac3f-7cbb239b7aa6 admin admin] PATH_INFO: `/v3/users/d0490617213946d3a8b6b1c499121154` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:31:17.717540 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a40f18-4ace-4271-ac3f-7cbb239b7aa6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d0490617213946d3a8b6b1c499121154)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:31:17.719682 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a40f18-4ace-4271-ac3f-7cbb239b7aa6 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:31:17.789669 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-74a40f18-4ace-4271-ac3f-7cbb239b7aa6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd0490617213946d3a8b6b1c499121154'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:31:17.809867 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-74a40f18-4ace-4271-ac3f-7cbb239b7aa6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd0490617213946d3a8b6b1c499121154'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:31:17.828553 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-74a40f18-4ace-4271-ac3f-7cbb239b7aa6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd0490617213946d3a8b6b1c499121154'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:31:17.836861 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-74a40f18-4ace-4271-ac3f-7cbb239b7aa6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd0490617213946d3a8b6b1c499121154'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:31:17.837723 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-74a40f18-4ace-4271-ac3f-7cbb239b7aa6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd0490617213946d3a8b6b1c499121154'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:31:17.850891 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 985/1965] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Oct 12 02:31:17 2022] DELETE /identity/v3/users/d0490617213946d3a8b6b1c499121154 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 02:31:18.207445 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b64c9d-f906-427b-8509-8e10c7f59ca4 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:31:18.210001 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-61b64c9d-f906-427b-8509-8e10c7f59ca4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:31:18.245143 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b64c9d-f906-427b-8509-8e10c7f59ca4 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:31:18.289733 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:31:18.326866 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49f0b50-2273-4c07-8f5e-febe7bc52dd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:31:18.328692 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49f0b50-2273-4c07-8f5e-febe7bc52dd4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:31:18.329196 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49f0b50-2273-4c07-8f5e-febe7bc52dd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:31:18.329677 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49f0b50-2273-4c07-8f5e-febe7bc52dd4 admin admin] PATH_INFO: `/v3/projects/1c93d8213e344008bb384f2a3c4cbdaa` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:31:18.331054 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49f0b50-2273-4c07-8f5e-febe7bc52dd4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1c93d8213e344008bb384f2a3c4cbdaa)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:31:18.333331 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49f0b50-2273-4c07-8f5e-febe7bc52dd4 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:31:18.385451 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-e49f0b50-2273-4c07-8f5e-febe7bc52dd4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1c93d8213e344008bb384f2a3c4cbdaa', 'request_id': 'req-e49f0b50-2273-4c07-8f5e-febe7bc52dd4'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:31:18.400565 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-e49f0b50-2273-4c07-8f5e-febe7bc52dd4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1c93d8213e344008bb384f2a3c4cbdaa', 'request_id': 'req-e49f0b50-2273-4c07-8f5e-febe7bc52dd4'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:31:18.409601 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-e49f0b50-2273-4c07-8f5e-febe7bc52dd4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1c93d8213e344008bb384f2a3c4cbdaa', 'request_id': 'req-e49f0b50-2273-4c07-8f5e-febe7bc52dd4'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:31:18.425315 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-e49f0b50-2273-4c07-8f5e-febe7bc52dd4 admin admin] The token cache is being invalidate because project 1c93d8213e344008bb384f2a3c4cbdaa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81362) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 02:31:18.425777 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-e49f0b50-2273-4c07-8f5e-febe7bc52dd4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:31:18.426503 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-e49f0b50-2273-4c07-8f5e-febe7bc52dd4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:31:18.430302 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 981/1966] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Oct 12 02:31:18 2022] DELETE /identity/v3/projects/1c93d8213e344008bb384f2a3c4cbdaa => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 02:31:18.435752 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab0bdfe-7ca3-47a9-9d0d-0e64da078e00 None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:31:18.436158 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab0bdfe-7ca3-47a9-9d0d-0e64da078e00 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:31:18.436572 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab0bdfe-7ca3-47a9-9d0d-0e64da078e00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:31:18.462736 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-9ab0bdfe-7ca3-47a9-9d0d-0e64da078e00 None None] MFA Rules not processed for user `a326a5bb7364479382f528a592371656`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:31:18.464121 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-9ab0bdfe-7ca3-47a9-9d0d-0e64da078e00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:31:18.480729 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:31:18.552184 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 986/1967] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 02:31:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 02:31:18.564973 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cb97ef-0ef0-4264-95fc-31be6ccdbd33 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:31:18.565278 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cb97ef-0ef0-4264-95fc-31be6ccdbd33 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:31:18.565629 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cb97ef-0ef0-4264-95fc-31be6ccdbd33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:31:18.594435 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-43cb97ef-0ef0-4264-95fc-31be6ccdbd33 None None] MFA Rules not processed for user `a326a5bb7364479382f528a592371656`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:31:18.597350 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-43cb97ef-0ef0-4264-95fc-31be6ccdbd33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:31:18.629539 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 982/1968] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 02:31:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 02:31:18.633520 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab0bdfe-7ca3-47a9-9d0d-0e64da078e00 None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:31:18.652110 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab0bdfe-7ca3-47a9-9d0d-0e64da078e00 None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:31:18.671111 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de01330a-5e0c-478f-9118-829d429d45ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:31:18.671772 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de01330a-5e0c-478f-9118-829d429d45ca admin admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:31:18.676100 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de01330a-5e0c-478f-9118-829d429d45ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:31:18.676380 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de01330a-5e0c-478f-9118-829d429d45ca admin admin] PATH_INFO: `/v3/domains` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:31:18.681004 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de01330a-5e0c-478f-9118-829d429d45ca admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 02:31:18.681334 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de01330a-5e0c-478f-9118-829d429d45ca admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:31:18.688644 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de01330a-5e0c-478f-9118-829d429d45ca admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:31:18.712924 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 987/1969] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Oct 12 02:31:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 02:31:18.716067 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43cb97ef-0ef0-4264-95fc-31be6ccdbd33 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:31:18.726048 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43cb97ef-0ef0-4264-95fc-31be6ccdbd33 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:31:18.742325 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3bc80d-d98a-4ce8-abe7-8c2ccd9cd4e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:31:18.742978 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3bc80d-d98a-4ce8-abe7-8c2ccd9cd4e8 admin admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:31:18.743249 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3bc80d-d98a-4ce8-abe7-8c2ccd9cd4e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:31:18.743525 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3bc80d-d98a-4ce8-abe7-8c2ccd9cd4e8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:31:18.744179 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3bc80d-d98a-4ce8-abe7-8c2ccd9cd4e8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:31:18.746896 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3bc80d-d98a-4ce8-abe7-8c2ccd9cd4e8 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:31:18.780011 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 983/1970] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Oct 12 02:31:18 2022] POST /identity/v3/projects => generated 389 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 02:31:18.784526 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de01330a-5e0c-478f-9118-829d429d45ca admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:31:18.795913 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de01330a-5e0c-478f-9118-829d429d45ca admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:31:18.868752 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a875919c-06d4-46bb-825d-27e42393675b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:31:18.869337 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a875919c-06d4-46bb-825d-27e42393675b admin admin] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:31:18.869612 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a875919c-06d4-46bb-825d-27e42393675b admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:31:18.869888 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a875919c-06d4-46bb-825d-27e42393675b admin admin] PATH_INFO: `/v3/users` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:31:18.871331 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a875919c-06d4-46bb-825d-27e42393675b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:31:18.873028 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a875919c-06d4-46bb-825d-27e42393675b admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:31:18.900679 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 988/1971] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Oct 12 02:31:18 2022] POST /identity/v3/users => generated 295 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 02:31:18.902934 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3bc80d-d98a-4ce8-abe7-8c2ccd9cd4e8 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:31:18.913629 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3bc80d-d98a-4ce8-abe7-8c2ccd9cd4e8 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:31:18.920681 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39c0b2a-efcf-4557-98a4-8db077537f01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:31:18.921308 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39c0b2a-efcf-4557-98a4-8db077537f01 admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:31:18.921635 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39c0b2a-efcf-4557-98a4-8db077537f01 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:31:18.921909 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39c0b2a-efcf-4557-98a4-8db077537f01 admin admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:31:18.922551 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39c0b2a-efcf-4557-98a4-8db077537f01 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:31:18.924146 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39c0b2a-efcf-4557-98a4-8db077537f01 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:31:18.936132 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 984/1972] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Oct 12 02:31:18 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 02:31:18.941122 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a875919c-06d4-46bb-825d-27e42393675b admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:31:18.965460 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a875919c-06d4-46bb-825d-27e42393675b admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:31:18.970952 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e265e488-efbe-44f0-8a53-b16bfd2dff79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:31:18.971613 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e265e488-efbe-44f0-8a53-b16bfd2dff79 admin admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:31:18.971895 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e265e488-efbe-44f0-8a53-b16bfd2dff79 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:31:18.972166 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e265e488-efbe-44f0-8a53-b16bfd2dff79 admin admin] PATH_INFO: `/v3/roles` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:31:18.972864 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e265e488-efbe-44f0-8a53-b16bfd2dff79 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:31:18.974550 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e265e488-efbe-44f0-8a53-b16bfd2dff79 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:31:19.029490 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 989/1973] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Oct 12 02:31:18 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 02:31:19.030378 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39c0b2a-efcf-4557-98a4-8db077537f01 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:31:19.064750 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39c0b2a-efcf-4557-98a4-8db077537f01 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:31:19.087665 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c2326b-bb07-4df2-a694-bd7f7b898ed4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:31:19.088637 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c2326b-bb07-4df2-a694-bd7f7b898ed4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:31:19.089033 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c2326b-bb07-4df2-a694-bd7f7b898ed4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:31:19.089506 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c2326b-bb07-4df2-a694-bd7f7b898ed4 admin admin] PATH_INFO: `/v3/projects/481d4e6e4bb84e9e9f98cbbcccf35f20/users/089b90df7509444f8a47dc270e98f2a7/roles/3d75c4d7f1a849b9a771504d1583ab28` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:31:19.121942 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c2326b-bb07-4df2-a694-bd7f7b898ed4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=481d4e6e4bb84e9e9f98cbbcccf35f20, user_id=089b90df7509444f8a47dc270e98f2a7, role_id=3d75c4d7f1a849b9a771504d1583ab28)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:31:19.121942 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c2326b-bb07-4df2-a694-bd7f7b898ed4 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:31:19.154564 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 985/1974] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Oct 12 02:31:18 2022] PUT /identity/v3/projects/481d4e6e4bb84e9e9f98cbbcccf35f20/users/089b90df7509444f8a47dc270e98f2a7/roles/3d75c4d7f1a849b9a771504d1583ab28 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 02:31:19.166311 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443a048d-5b8d-465a-b0bd-e38222098eeb None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:31:19.167068 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443a048d-5b8d-465a-b0bd-e38222098eeb None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:31:19.168056 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443a048d-5b8d-465a-b0bd-e38222098eeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:31:19.219970 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-443a048d-5b8d-465a-b0bd-e38222098eeb None None] MFA Rules not processed for user `089b90df7509444f8a47dc270e98f2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:31:19.221270 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-443a048d-5b8d-465a-b0bd-e38222098eeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:31:19.324912 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 990/1975] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 02:31:19 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 02:31:19.326987 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c2326b-bb07-4df2-a694-bd7f7b898ed4 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:31:19.401261 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c2326b-bb07-4df2-a694-bd7f7b898ed4 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:31:19.407444 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88072995-4be2-4feb-ac3a-e6b5c604cee4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:31:19.408133 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88072995-4be2-4feb-ac3a-e6b5c604cee4 admin admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:31:19.408493 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88072995-4be2-4feb-ac3a-e6b5c604cee4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:31:19.408840 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88072995-4be2-4feb-ac3a-e6b5c604cee4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:31:19.409491 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88072995-4be2-4feb-ac3a-e6b5c604cee4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:31:19.411625 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88072995-4be2-4feb-ac3a-e6b5c604cee4 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:31:19.429096 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:31:19.457957 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 986/1976] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Oct 12 02:31:19 2022] POST /identity/v3/projects => generated 389 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 02:31:19.459339 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443a048d-5b8d-465a-b0bd-e38222098eeb None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:31:19.474154 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443a048d-5b8d-465a-b0bd-e38222098eeb None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:31:19.487240 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:31:19.552735 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb3d06a-5786-46d2-9c39-055333e16796 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:31:19.553500 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb3d06a-5786-46d2-9c39-055333e16796 admin admin] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:31:19.556319 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb3d06a-5786-46d2-9c39-055333e16796 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:31:19.556319 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb3d06a-5786-46d2-9c39-055333e16796 admin admin] PATH_INFO: `/v3/users` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:31:19.556319 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb3d06a-5786-46d2-9c39-055333e16796 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:31:19.556680 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb3d06a-5786-46d2-9c39-055333e16796 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:31:19.588506 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 991/1977] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Oct 12 02:31:19 2022] POST /identity/v3/users => generated 301 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 02:31:19.590711 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88072995-4be2-4feb-ac3a-e6b5c604cee4 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:31:19.606835 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88072995-4be2-4feb-ac3a-e6b5c604cee4 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:31:19.613305 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b520bc62-f12e-4f14-8379-f389dc2c2a66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:31:19.614085 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b520bc62-f12e-4f14-8379-f389dc2c2a66 admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:31:19.614767 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b520bc62-f12e-4f14-8379-f389dc2c2a66 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:31:19.615151 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b520bc62-f12e-4f14-8379-f389dc2c2a66 admin admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:31:19.616020 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b520bc62-f12e-4f14-8379-f389dc2c2a66 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:31:19.618106 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b520bc62-f12e-4f14-8379-f389dc2c2a66 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:31:19.637403 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 987/1978] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Oct 12 02:31:19 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 02:31:19.638603 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb3d06a-5786-46d2-9c39-055333e16796 admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:31:19.649298 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb3d06a-5786-46d2-9c39-055333e16796 admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:31:19.655342 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb030b1-9eb6-404e-9a10-400789b3daac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:31:19.656283 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb030b1-9eb6-404e-9a10-400789b3daac admin admin] REQUEST_METHOD: `PUT` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:31:19.656599 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb030b1-9eb6-404e-9a10-400789b3daac admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:31:19.656883 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb030b1-9eb6-404e-9a10-400789b3daac admin admin] PATH_INFO: `/v3/projects/549cd4c5d4df430e882117edba8003fa/users/ba23c8143acd4e8db7a3410a9ce7f161/roles/39b1e8108dff402383def3c559f48189` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:31:19.680031 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb030b1-9eb6-404e-9a10-400789b3daac admin admin] RBAC: Authorizing `identity:create_grant(project_id=549cd4c5d4df430e882117edba8003fa, user_id=ba23c8143acd4e8db7a3410a9ce7f161, role_id=39b1e8108dff402383def3c559f48189)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:31:19.683124 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb030b1-9eb6-404e-9a10-400789b3daac admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:31:19.750825 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 992/1979] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Oct 12 02:31:19 2022] PUT /identity/v3/projects/549cd4c5d4df430e882117edba8003fa/users/ba23c8143acd4e8db7a3410a9ce7f161/roles/39b1e8108dff402383def3c559f48189 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 02:31:19.754768 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b520bc62-f12e-4f14-8379-f389dc2c2a66 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:31:19.767000 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b520bc62-f12e-4f14-8379-f389dc2c2a66 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:31:19.908458 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df4b17c-1776-456f-8bcd-94c5ba90a991 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:31:19.909042 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df4b17c-1776-456f-8bcd-94c5ba90a991 admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:31:19.909321 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df4b17c-1776-456f-8bcd-94c5ba90a991 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:31:19.909595 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df4b17c-1776-456f-8bcd-94c5ba90a991 admin admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:31:19.910268 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df4b17c-1776-456f-8bcd-94c5ba90a991 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:31:19.911871 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df4b17c-1776-456f-8bcd-94c5ba90a991 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:31:19.930341 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 988/1980] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Oct 12 02:31:19 2022] GET /identity/v3/roles => generated 1420 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 02:31:19.931193 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb030b1-9eb6-404e-9a10-400789b3daac admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:31:19.958781 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb030b1-9eb6-404e-9a10-400789b3daac admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:31:19.964970 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9424a68-545e-43d6-8ddf-cd2206179fb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:31:19.965819 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9424a68-545e-43d6-8ddf-cd2206179fb8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:31:19.966124 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9424a68-545e-43d6-8ddf-cd2206179fb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:31:19.966381 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9424a68-545e-43d6-8ddf-cd2206179fb8 admin admin] PATH_INFO: `/v3/projects/549cd4c5d4df430e882117edba8003fa/users/ba23c8143acd4e8db7a3410a9ce7f161/roles/39b1e8108dff402383def3c559f48189` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:31:19.968513 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9424a68-545e-43d6-8ddf-cd2206179fb8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=549cd4c5d4df430e882117edba8003fa, user_id=ba23c8143acd4e8db7a3410a9ce7f161, role_id=39b1e8108dff402383def3c559f48189)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:31:19.971278 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9424a68-545e-43d6-8ddf-cd2206179fb8 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:31:19.983439 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 993/1981] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Oct 12 02:31:19 2022] PUT /identity/v3/projects/549cd4c5d4df430e882117edba8003fa/users/ba23c8143acd4e8db7a3410a9ce7f161/roles/39b1e8108dff402383def3c559f48189 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 02:31:19.994105 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e8014a-8862-4a0f-abe1-0b2097ef3d05 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:31:19.994483 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e8014a-8862-4a0f-abe1-0b2097ef3d05 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:31:19.994795 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e8014a-8862-4a0f-abe1-0b2097ef3d05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:31:20.038903 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-e1e8014a-8862-4a0f-abe1-0b2097ef3d05 None None] MFA Rules not processed for user `ba23c8143acd4e8db7a3410a9ce7f161`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:31:20.040146 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-e1e8014a-8862-4a0f-abe1-0b2097ef3d05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:31:20.120166 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 989/1982] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 02:31:19 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 02:31:20.129483 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9424a68-545e-43d6-8ddf-cd2206179fb8 admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:31:20.131371 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-a9424a68-545e-43d6-8ddf-cd2206179fb8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:31:20.194460 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9424a68-545e-43d6-8ddf-cd2206179fb8 admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:31:20.199686 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4d8ffd-dde1-4239-9764-96e6d1b744c6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ba688e0c4d44d13898539ee886f95fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'beb6def6fcad45959e56425bb8bff4d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:31:20.200501 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4d8ffd-dde1-4239-9764-96e6d1b744c6 service cinder] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:31:20.200940 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4d8ffd-dde1-4239-9764-96e6d1b744c6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:31:20.201603 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4d8ffd-dde1-4239-9764-96e6d1b744c6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:31:20.213876 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4d8ffd-dde1-4239-9764-96e6d1b744c6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:31:20.215433 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4d8ffd-dde1-4239-9764-96e6d1b744c6 service cinder] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:31:20.229302 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 994/1983] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 02:31:20 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 02:31:20.398672 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e8014a-8862-4a0f-abe1-0b2097ef3d05 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:31:20.479078 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e8014a-8862-4a0f-abe1-0b2097ef3d05 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:31:20.484419 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d47f3f-f188-404b-97f3-8fb18e06ab74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:31:20.485165 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d47f3f-f188-404b-97f3-8fb18e06ab74 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:31:20.485613 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d47f3f-f188-404b-97f3-8fb18e06ab74 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:31:20.485956 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d47f3f-f188-404b-97f3-8fb18e06ab74 admin admin] PATH_INFO: `/v3/users/089b90df7509444f8a47dc270e98f2a7` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:31:20.487142 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d47f3f-f188-404b-97f3-8fb18e06ab74 admin admin] RBAC: Authorizing `identity:delete_user(user_id=089b90df7509444f8a47dc270e98f2a7)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:31:20.489151 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d47f3f-f188-404b-97f3-8fb18e06ab74 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:31:20.490957 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:31:20.557192 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-c7d47f3f-f188-404b-97f3-8fb18e06ab74 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '089b90df7509444f8a47dc270e98f2a7'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:31:20.571233 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7984ad-ddbb-44a1-bf4c-6360c9defe74 None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:31:20.572048 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7984ad-ddbb-44a1-bf4c-6360c9defe74 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:31:20.572270 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7984ad-ddbb-44a1-bf4c-6360c9defe74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:31:20.572859 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-c7d47f3f-f188-404b-97f3-8fb18e06ab74 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '089b90df7509444f8a47dc270e98f2a7'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:31:20.595176 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-c7d47f3f-f188-404b-97f3-8fb18e06ab74 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '089b90df7509444f8a47dc270e98f2a7'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:31:20.596093 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-9f7984ad-ddbb-44a1-bf4c-6360c9defe74 None None] MFA Rules not processed for user `7a9ab860b4294375bf1bc1758e345644`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:31:20.598029 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-9f7984ad-ddbb-44a1-bf4c-6360c9defe74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:31:20.611179 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-c7d47f3f-f188-404b-97f3-8fb18e06ab74 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '089b90df7509444f8a47dc270e98f2a7'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:31:20.612224 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-c7d47f3f-f188-404b-97f3-8fb18e06ab74 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '089b90df7509444f8a47dc270e98f2a7'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:31:20.618985 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 990/1984] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Oct 12 02:31:20 2022] DELETE /identity/v3/users/089b90df7509444f8a47dc270e98f2a7 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 02:31:20.624018 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d49fdc-205c-4dd6-b48f-44d3d0c03499 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:31:20.624309 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d49fdc-205c-4dd6-b48f-44d3d0c03499 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:31:20.624610 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d49fdc-205c-4dd6-b48f-44d3d0c03499 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:31:20.646271 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-27d49fdc-205c-4dd6-b48f-44d3d0c03499 None None] MFA Rules not processed for user `a326a5bb7364479382f528a592371656`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:31:20.647505 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-27d49fdc-205c-4dd6-b48f-44d3d0c03499 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:31:20.664736 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 995/1985] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 02:31:20 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 02:31:20.733904 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 991/1986] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 02:31:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 02:31:20.759984 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7984ad-ddbb-44a1-bf4c-6360c9defe74 None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:31:20.761470 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-9f7984ad-ddbb-44a1-bf4c-6360c9defe74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:31:20.785384 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:31:20.837440 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7984ad-ddbb-44a1-bf4c-6360c9defe74 None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:31:20.895673 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d39d42-8bae-49e4-8511-f9d93704954a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5223b5cab3114e9b9a13c582f8ef8386', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'beb6def6fcad45959e56425bb8bff4d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:31:20.896285 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d39d42-8bae-49e4-8511-f9d93704954a service neutron] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:31:20.896589 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d39d42-8bae-49e4-8511-f9d93704954a service neutron] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:31:20.896859 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d39d42-8bae-49e4-8511-f9d93704954a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:31:20.906629 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d39d42-8bae-49e4-8511-f9d93704954a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:31:20.908048 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d39d42-8bae-49e4-8511-f9d93704954a service neutron] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:31:20.918080 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 996/1987] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 02:31:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 02:31:21.381803 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d49fdc-205c-4dd6-b48f-44d3d0c03499 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:31:21.383482 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-27d49fdc-205c-4dd6-b48f-44d3d0c03499 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:31:21.421430 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d49fdc-205c-4dd6-b48f-44d3d0c03499 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:31:21.428499 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea635fa6-36b9-4a3a-8100-9c867a88b945 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:31:21.429232 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea635fa6-36b9-4a3a-8100-9c867a88b945 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:31:21.429577 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea635fa6-36b9-4a3a-8100-9c867a88b945 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:31:21.429915 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea635fa6-36b9-4a3a-8100-9c867a88b945 admin admin] PATH_INFO: `/v3/projects/481d4e6e4bb84e9e9f98cbbcccf35f20` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:31:21.431142 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea635fa6-36b9-4a3a-8100-9c867a88b945 admin admin] RBAC: Authorizing `identity:delete_project(project_id=481d4e6e4bb84e9e9f98cbbcccf35f20)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:31:21.433193 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea635fa6-36b9-4a3a-8100-9c867a88b945 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:31:21.486073 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-ea635fa6-36b9-4a3a-8100-9c867a88b945 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '481d4e6e4bb84e9e9f98cbbcccf35f20', 'request_id': 'req-ea635fa6-36b9-4a3a-8100-9c867a88b945'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:31:21.492588 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-ea635fa6-36b9-4a3a-8100-9c867a88b945 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '481d4e6e4bb84e9e9f98cbbcccf35f20', 'request_id': 'req-ea635fa6-36b9-4a3a-8100-9c867a88b945'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:31:21.500051 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-ea635fa6-36b9-4a3a-8100-9c867a88b945 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '481d4e6e4bb84e9e9f98cbbcccf35f20', 'request_id': 'req-ea635fa6-36b9-4a3a-8100-9c867a88b945'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:31:21.516978 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-ea635fa6-36b9-4a3a-8100-9c867a88b945 admin admin] The token cache is being invalidate because project 481d4e6e4bb84e9e9f98cbbcccf35f20 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81362) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 02:31:21.517308 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-ea635fa6-36b9-4a3a-8100-9c867a88b945 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:31:21.518582 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-ea635fa6-36b9-4a3a-8100-9c867a88b945 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:31:21.520450 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 992/1988] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Oct 12 02:31:21 2022] DELETE /identity/v3/projects/481d4e6e4bb84e9e9f98cbbcccf35f20 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 02:31:21.524644 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d39d42-8bae-49e4-8511-f9d93704954a service neutron] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:31:21.538335 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d39d42-8bae-49e4-8511-f9d93704954a service neutron] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:31:21.604401 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6e25ab-ff3b-4a5f-bc3d-09e1a54a9d67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:31:21.605232 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6e25ab-ff3b-4a5f-bc3d-09e1a54a9d67 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:31:21.605608 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6e25ab-ff3b-4a5f-bc3d-09e1a54a9d67 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:31:21.605915 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6e25ab-ff3b-4a5f-bc3d-09e1a54a9d67 admin admin] PATH_INFO: `/v3/users/ba23c8143acd4e8db7a3410a9ce7f161` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:31:21.607567 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6e25ab-ff3b-4a5f-bc3d-09e1a54a9d67 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ba23c8143acd4e8db7a3410a9ce7f161)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:31:21.609967 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6e25ab-ff3b-4a5f-bc3d-09e1a54a9d67 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:31:21.666209 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-9a6e25ab-ff3b-4a5f-bc3d-09e1a54a9d67 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ba23c8143acd4e8db7a3410a9ce7f161'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:31:21.676008 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-9a6e25ab-ff3b-4a5f-bc3d-09e1a54a9d67 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ba23c8143acd4e8db7a3410a9ce7f161'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:31:21.692199 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-9a6e25ab-ff3b-4a5f-bc3d-09e1a54a9d67 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ba23c8143acd4e8db7a3410a9ce7f161'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:31:21.699967 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:31:21.707584 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-9a6e25ab-ff3b-4a5f-bc3d-09e1a54a9d67 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ba23c8143acd4e8db7a3410a9ce7f161'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:31:21.715577 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-9a6e25ab-ff3b-4a5f-bc3d-09e1a54a9d67 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ba23c8143acd4e8db7a3410a9ce7f161'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:31:21.730651 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 997/1989] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Oct 12 02:31:21 2022] DELETE /identity/v3/users/ba23c8143acd4e8db7a3410a9ce7f161 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 02:31:22.145019 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea635fa6-36b9-4a3a-8100-9c867a88b945 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:31:22.146490 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-ea635fa6-36b9-4a3a-8100-9c867a88b945 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:31:22.157651 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:31:22.166736 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea635fa6-36b9-4a3a-8100-9c867a88b945 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:31:22.234415 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74daa243-229a-4396-bc7f-0f2089900bd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:31:22.235176 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74daa243-229a-4396-bc7f-0f2089900bd9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:31:22.235443 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74daa243-229a-4396-bc7f-0f2089900bd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:31:22.235718 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74daa243-229a-4396-bc7f-0f2089900bd9 admin admin] PATH_INFO: `/v3/projects/549cd4c5d4df430e882117edba8003fa` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:31:22.236906 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74daa243-229a-4396-bc7f-0f2089900bd9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=549cd4c5d4df430e882117edba8003fa)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:31:22.238837 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74daa243-229a-4396-bc7f-0f2089900bd9 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:31:22.287655 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-74daa243-229a-4396-bc7f-0f2089900bd9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '549cd4c5d4df430e882117edba8003fa', 'request_id': 'req-74daa243-229a-4396-bc7f-0f2089900bd9'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:31:22.294322 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-74daa243-229a-4396-bc7f-0f2089900bd9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '549cd4c5d4df430e882117edba8003fa', 'request_id': 'req-74daa243-229a-4396-bc7f-0f2089900bd9'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:31:22.301001 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-74daa243-229a-4396-bc7f-0f2089900bd9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '549cd4c5d4df430e882117edba8003fa', 'request_id': 'req-74daa243-229a-4396-bc7f-0f2089900bd9'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:31:22.316285 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-74daa243-229a-4396-bc7f-0f2089900bd9 admin admin] The token cache is being invalidate because project 549cd4c5d4df430e882117edba8003fa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81362) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 02:31:22.316712 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-74daa243-229a-4396-bc7f-0f2089900bd9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:31:22.317532 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-74daa243-229a-4396-bc7f-0f2089900bd9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:31:22.319139 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 993/1990] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Oct 12 02:31:22 2022] DELETE /identity/v3/projects/549cd4c5d4df430e882117edba8003fa => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 02:31:22.330276 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af07a5f8-a0ba-4dfc-bf4b-e88f1ef71f8e None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:31:22.330761 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af07a5f8-a0ba-4dfc-bf4b-e88f1ef71f8e None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:31:22.331120 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af07a5f8-a0ba-4dfc-bf4b-e88f1ef71f8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:31:22.354165 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-af07a5f8-a0ba-4dfc-bf4b-e88f1ef71f8e None None] MFA Rules not processed for user `a326a5bb7364479382f528a592371656`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:31:22.355416 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-af07a5f8-a0ba-4dfc-bf4b-e88f1ef71f8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:31:22.414674 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 998/1991] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 02:31:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 02:31:22.423571 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb34aeee-6dcb-4c62-b0c5-0a2275763d87 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:31:22.424076 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb34aeee-6dcb-4c62-b0c5-0a2275763d87 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:31:22.424181 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb34aeee-6dcb-4c62-b0c5-0a2275763d87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:31:22.445000 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-eb34aeee-6dcb-4c62-b0c5-0a2275763d87 None None] MFA Rules not processed for user `a326a5bb7364479382f528a592371656`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:31:22.446224 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-eb34aeee-6dcb-4c62-b0c5-0a2275763d87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:31:22.455095 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 994/1992] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 02:31:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 02:31:22.460323 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af07a5f8-a0ba-4dfc-bf4b-e88f1ef71f8e None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:31:22.470968 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af07a5f8-a0ba-4dfc-bf4b-e88f1ef71f8e None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:31:22.475559 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf28429-61b5-4454-80bb-4913d7f433c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:31:22.476161 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf28429-61b5-4454-80bb-4913d7f433c3 admin admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:31:22.476443 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf28429-61b5-4454-80bb-4913d7f433c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:31:22.476743 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf28429-61b5-4454-80bb-4913d7f433c3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:31:22.477548 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf28429-61b5-4454-80bb-4913d7f433c3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 02:31:22.477674 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf28429-61b5-4454-80bb-4913d7f433c3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:31:22.479282 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf28429-61b5-4454-80bb-4913d7f433c3 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:31:22.491722 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 999/1993] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Oct 12 02:31:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 02:31:22.496735 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb34aeee-6dcb-4c62-b0c5-0a2275763d87 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:31:22.505865 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb34aeee-6dcb-4c62-b0c5-0a2275763d87 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:31:22.510386 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30178150-fc8a-4fe2-be07-32efa15df096 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:31:22.511096 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30178150-fc8a-4fe2-be07-32efa15df096 admin admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:31:22.511922 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30178150-fc8a-4fe2-be07-32efa15df096 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:31:22.512151 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30178150-fc8a-4fe2-be07-32efa15df096 admin admin] PATH_INFO: `/v3/projects` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:31:22.512838 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30178150-fc8a-4fe2-be07-32efa15df096 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:31:22.514725 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30178150-fc8a-4fe2-be07-32efa15df096 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:31:22.554309 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 995/1994] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Oct 12 02:31:22 2022] POST /identity/v3/projects => generated 367 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 02:31:22.555751 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf28429-61b5-4454-80bb-4913d7f433c3 admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:31:22.567095 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf28429-61b5-4454-80bb-4913d7f433c3 admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:31:22.624444 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c05884b-9990-4247-9a75-d77cb3872f5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:31:22.625084 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c05884b-9990-4247-9a75-d77cb3872f5c admin admin] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:31:22.625356 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c05884b-9990-4247-9a75-d77cb3872f5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:31:22.625624 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c05884b-9990-4247-9a75-d77cb3872f5c admin admin] PATH_INFO: `/v3/users` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:31:22.626258 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c05884b-9990-4247-9a75-d77cb3872f5c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:31:22.628167 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c05884b-9990-4247-9a75-d77cb3872f5c admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:31:22.649956 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1000/1995] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Oct 12 02:31:22 2022] POST /identity/v3/users => generated 284 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 02:31:22.654107 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30178150-fc8a-4fe2-be07-32efa15df096 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:31:22.664711 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30178150-fc8a-4fe2-be07-32efa15df096 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:31:22.669533 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2c2a75-e3ee-470d-9457-4f2121c8ca8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:31:22.670139 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2c2a75-e3ee-470d-9457-4f2121c8ca8b admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:31:22.670416 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2c2a75-e3ee-470d-9457-4f2121c8ca8b admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:31:22.670700 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2c2a75-e3ee-470d-9457-4f2121c8ca8b admin admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:31:22.671355 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2c2a75-e3ee-470d-9457-4f2121c8ca8b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:31:22.672962 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2c2a75-e3ee-470d-9457-4f2121c8ca8b admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:31:22.683341 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 996/1996] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Oct 12 02:31:22 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 02:31:22.687179 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c05884b-9990-4247-9a75-d77cb3872f5c admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:31:22.697065 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c05884b-9990-4247-9a75-d77cb3872f5c admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:31:22.702496 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd0839c-9862-45b2-9df5-1204e43d01a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:31:22.703084 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd0839c-9862-45b2-9df5-1204e43d01a3 admin admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:31:22.703359 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd0839c-9862-45b2-9df5-1204e43d01a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:31:22.703654 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd0839c-9862-45b2-9df5-1204e43d01a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:31:22.704288 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd0839c-9862-45b2-9df5-1204e43d01a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:31:22.705896 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd0839c-9862-45b2-9df5-1204e43d01a3 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:31:22.717053 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1001/1997] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Oct 12 02:31:22 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 02:31:22.721039 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2c2a75-e3ee-470d-9457-4f2121c8ca8b admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:31:22.731155 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2c2a75-e3ee-470d-9457-4f2121c8ca8b admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:31:22.735944 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530bf388-bfef-4436-ae3a-8cbd31ed7e95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:31:22.736612 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530bf388-bfef-4436-ae3a-8cbd31ed7e95 admin admin] REQUEST_METHOD: `PUT` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:31:22.736892 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530bf388-bfef-4436-ae3a-8cbd31ed7e95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:31:22.737164 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530bf388-bfef-4436-ae3a-8cbd31ed7e95 admin admin] PATH_INFO: `/v3/projects/2ed85028a48747d38923e1466934d2d6/users/8721b5ec712848f0a279f7204b5d5543/roles/3d75c4d7f1a849b9a771504d1583ab28` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:31:22.752558 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530bf388-bfef-4436-ae3a-8cbd31ed7e95 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2ed85028a48747d38923e1466934d2d6, user_id=8721b5ec712848f0a279f7204b5d5543, role_id=3d75c4d7f1a849b9a771504d1583ab28)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:31:22.755298 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530bf388-bfef-4436-ae3a-8cbd31ed7e95 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:31:22.771388 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 997/1998] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Oct 12 02:31:22 2022] PUT /identity/v3/projects/2ed85028a48747d38923e1466934d2d6/users/8721b5ec712848f0a279f7204b5d5543/roles/3d75c4d7f1a849b9a771504d1583ab28 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 02:31:22.784562 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f8e77e-435a-454d-9ab1-aacbd33e978d None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:31:22.784940 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f8e77e-435a-454d-9ab1-aacbd33e978d None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:31:22.785137 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f8e77e-435a-454d-9ab1-aacbd33e978d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:31:22.823902 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-12f8e77e-435a-454d-9ab1-aacbd33e978d None None] MFA Rules not processed for user `8721b5ec712848f0a279f7204b5d5543`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:31:22.825142 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-12f8e77e-435a-454d-9ab1-aacbd33e978d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:31:22.878283 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:31:22.904867 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1002/1999] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 02:31:22 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 02:31:22.905957 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530bf388-bfef-4436-ae3a-8cbd31ed7e95 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:31:22.938280 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:31:22.986195 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530bf388-bfef-4436-ae3a-8cbd31ed7e95 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:31:22.991204 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5c530f-663d-467d-9e28-ec793eac75e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:31:22.991959 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5c530f-663d-467d-9e28-ec793eac75e0 admin admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:31:22.992244 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5c530f-663d-467d-9e28-ec793eac75e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:31:22.992540 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5c530f-663d-467d-9e28-ec793eac75e0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:31:22.993186 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5c530f-663d-467d-9e28-ec793eac75e0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:31:22.995094 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5c530f-663d-467d-9e28-ec793eac75e0 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:31:23.023077 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 998/2000] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Oct 12 02:31:22 2022] POST /identity/v3/projects => generated 367 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 02:31:23.027349 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f8e77e-435a-454d-9ab1-aacbd33e978d None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:31:23.038356 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f8e77e-435a-454d-9ab1-aacbd33e978d None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:31:23.109089 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e878d7-aa39-47a5-9238-7e7b895dd7ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:31:23.109592 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e878d7-aa39-47a5-9238-7e7b895dd7ac admin admin] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:31:23.109869 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e878d7-aa39-47a5-9238-7e7b895dd7ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:31:23.110141 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e878d7-aa39-47a5-9238-7e7b895dd7ac admin admin] PATH_INFO: `/v3/users` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:31:23.110804 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e878d7-aa39-47a5-9238-7e7b895dd7ac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:31:23.112752 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e878d7-aa39-47a5-9238-7e7b895dd7ac admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:31:23.137923 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1003/2001] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Oct 12 02:31:23 2022] POST /identity/v3/users => generated 290 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 02:31:23.139184 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5c530f-663d-467d-9e28-ec793eac75e0 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:31:23.149792 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5c530f-663d-467d-9e28-ec793eac75e0 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:31:23.154984 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7377f03-6cf2-496c-8b12-713bcc1823d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:31:23.155617 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7377f03-6cf2-496c-8b12-713bcc1823d2 admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:31:23.156019 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7377f03-6cf2-496c-8b12-713bcc1823d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:31:23.156322 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7377f03-6cf2-496c-8b12-713bcc1823d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:31:23.157067 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7377f03-6cf2-496c-8b12-713bcc1823d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:31:23.158728 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7377f03-6cf2-496c-8b12-713bcc1823d2 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:31:23.170379 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 999/2002] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Oct 12 02:31:23 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 02:31:23.174459 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e878d7-aa39-47a5-9238-7e7b895dd7ac admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:31:23.185533 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e878d7-aa39-47a5-9238-7e7b895dd7ac admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:31:23.190171 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c604872-c839-49e7-b8d2-c83cb19988d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:31:23.190832 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c604872-c839-49e7-b8d2-c83cb19988d1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:31:23.191110 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c604872-c839-49e7-b8d2-c83cb19988d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:31:23.191383 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c604872-c839-49e7-b8d2-c83cb19988d1 admin admin] PATH_INFO: `/v3/projects/f16d7fef334a43098e501add10bece21/users/b86924d5cafe41738581fe1fbba6d248/roles/39b1e8108dff402383def3c559f48189` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:31:23.209853 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c604872-c839-49e7-b8d2-c83cb19988d1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f16d7fef334a43098e501add10bece21, user_id=b86924d5cafe41738581fe1fbba6d248, role_id=39b1e8108dff402383def3c559f48189)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:31:23.212929 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c604872-c839-49e7-b8d2-c83cb19988d1 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:31:23.226216 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1004/2003] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Oct 12 02:31:23 2022] PUT /identity/v3/projects/f16d7fef334a43098e501add10bece21/users/b86924d5cafe41738581fe1fbba6d248/roles/39b1e8108dff402383def3c559f48189 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 02:31:23.230497 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7377f03-6cf2-496c-8b12-713bcc1823d2 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:31:23.240759 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7377f03-6cf2-496c-8b12-713bcc1823d2 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:31:23.300648 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a1db4d-ca2e-4021-9ee0-84fd46b09a64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:31:23.301275 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a1db4d-ca2e-4021-9ee0-84fd46b09a64 admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:31:23.301553 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a1db4d-ca2e-4021-9ee0-84fd46b09a64 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:31:23.301826 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a1db4d-ca2e-4021-9ee0-84fd46b09a64 admin admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:31:23.302472 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a1db4d-ca2e-4021-9ee0-84fd46b09a64 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:31:23.304063 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a1db4d-ca2e-4021-9ee0-84fd46b09a64 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:31:23.315009 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1000/2004] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Oct 12 02:31:23 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 02:31:23.319413 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c604872-c839-49e7-b8d2-c83cb19988d1 admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:31:23.330355 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c604872-c839-49e7-b8d2-c83cb19988d1 admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:31:23.335038 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30da30fd-ded0-4e41-9d3e-6f3a8d38012d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:31:23.335685 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30da30fd-ded0-4e41-9d3e-6f3a8d38012d admin admin] REQUEST_METHOD: `PUT` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:31:23.335966 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30da30fd-ded0-4e41-9d3e-6f3a8d38012d admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:31:23.336248 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30da30fd-ded0-4e41-9d3e-6f3a8d38012d admin admin] PATH_INFO: `/v3/projects/f16d7fef334a43098e501add10bece21/users/b86924d5cafe41738581fe1fbba6d248/roles/39b1e8108dff402383def3c559f48189` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:31:23.338187 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30da30fd-ded0-4e41-9d3e-6f3a8d38012d admin admin] RBAC: Authorizing `identity:create_grant(project_id=f16d7fef334a43098e501add10bece21, user_id=b86924d5cafe41738581fe1fbba6d248, role_id=39b1e8108dff402383def3c559f48189)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:31:23.340987 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30da30fd-ded0-4e41-9d3e-6f3a8d38012d admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:31:23.351648 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1005/2005] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Oct 12 02:31:23 2022] PUT /identity/v3/projects/f16d7fef334a43098e501add10bece21/users/b86924d5cafe41738581fe1fbba6d248/roles/39b1e8108dff402383def3c559f48189 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 02:31:23.362358 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58de6791-0a3e-432c-9680-c66a5ad98d06 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:31:23.362571 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58de6791-0a3e-432c-9680-c66a5ad98d06 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:31:23.362840 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58de6791-0a3e-432c-9680-c66a5ad98d06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:31:23.392507 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-58de6791-0a3e-432c-9680-c66a5ad98d06 None None] MFA Rules not processed for user `b86924d5cafe41738581fe1fbba6d248`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:31:23.393727 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-58de6791-0a3e-432c-9680-c66a5ad98d06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:31:23.463216 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1001/2006] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 02:31:23 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 02:31:23.475213 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30da30fd-ded0-4e41-9d3e-6f3a8d38012d admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:31:23.477069 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-30da30fd-ded0-4e41-9d3e-6f3a8d38012d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:31:23.541398 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30da30fd-ded0-4e41-9d3e-6f3a8d38012d admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:31:23.545623 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fcd608-2b12-4fa2-b007-197963f3a7a9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ba688e0c4d44d13898539ee886f95fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'beb6def6fcad45959e56425bb8bff4d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:31:23.546239 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fcd608-2b12-4fa2-b007-197963f3a7a9 service cinder] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:31:23.546517 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fcd608-2b12-4fa2-b007-197963f3a7a9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:31:23.546790 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fcd608-2b12-4fa2-b007-197963f3a7a9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:31:23.555957 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48fcd608-2b12-4fa2-b007-197963f3a7a9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:31:23.557428 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48fcd608-2b12-4fa2-b007-197963f3a7a9 service cinder] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:31:23.567755 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1006/2007] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 02:31:23 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 02:31:23.651290 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58de6791-0a3e-432c-9680-c66a5ad98d06 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:31:23.663233 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58de6791-0a3e-432c-9680-c66a5ad98d06 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:31:23.667800 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf98eaf-f45e-4dcf-a07a-00fa0cc85de7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ba688e0c4d44d13898539ee886f95fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'beb6def6fcad45959e56425bb8bff4d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:31:23.668714 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf98eaf-f45e-4dcf-a07a-00fa0cc85de7 service cinder] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:31:23.669100 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf98eaf-f45e-4dcf-a07a-00fa0cc85de7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:31:23.669474 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf98eaf-f45e-4dcf-a07a-00fa0cc85de7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:31:23.693192 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:31:23.736430 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf98eaf-f45e-4dcf-a07a-00fa0cc85de7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:31:23.737936 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf98eaf-f45e-4dcf-a07a-00fa0cc85de7 service cinder] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:31:23.749708 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1002/2008] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 02:31:23 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 02:31:24.630001 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5b50c9-db85-4433-9e67-00c2696a468c None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:31:24.630486 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5b50c9-db85-4433-9e67-00c2696a468c None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:31:24.630564 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5b50c9-db85-4433-9e67-00c2696a468c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:31:24.660025 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-7f5b50c9-db85-4433-9e67-00c2696a468c None None] MFA Rules not processed for user `8d0e2087e5324071926c3dc3a3cb9b1d`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:31:24.661771 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-7f5b50c9-db85-4433-9e67-00c2696a468c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:31:24.720025 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:31:24.742933 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1007/2009] 10.222.0.18 () {58 vars in 1009 bytes} [Wed Oct 12 02:31:24 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 02:31:24.764759 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf98eaf-f45e-4dcf-a07a-00fa0cc85de7 service cinder] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:31:24.767172 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-baf98eaf-f45e-4dcf-a07a-00fa0cc85de7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:31:24.880627 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf98eaf-f45e-4dcf-a07a-00fa0cc85de7 service cinder] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:31:24.898817 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493eff05-60a0-4391-a9ef-b478db641b18 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af9bd50c42cc437dbdd5a431d8adbb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'beb6def6fcad45959e56425bb8bff4d1', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:31:24.899667 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493eff05-60a0-4391-a9ef-b478db641b18 service swift] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:31:24.900015 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493eff05-60a0-4391-a9ef-b478db641b18 service swift] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:31:24.900550 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493eff05-60a0-4391-a9ef-b478db641b18 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:31:24.916557 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493eff05-60a0-4391-a9ef-b478db641b18 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:31:24.917992 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493eff05-60a0-4391-a9ef-b478db641b18 service swift] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:31:24.929028 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1003/2010] 10.222.0.18 () {60 vars in 1384 bytes} [Wed Oct 12 02:31:24 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 12 02:31:29.146111 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5b50c9-db85-4433-9e67-00c2696a468c None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:31:29.223921 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5b50c9-db85-4433-9e67-00c2696a468c None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:31:29.229481 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7223e3a4-ee4c-459c-8633-26bd077c450b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:31:29.230703 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7223e3a4-ee4c-459c-8633-26bd077c450b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:31:29.230996 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7223e3a4-ee4c-459c-8633-26bd077c450b admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:31:29.231216 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7223e3a4-ee4c-459c-8633-26bd077c450b admin admin] PATH_INFO: `/v3/users/8721b5ec712848f0a279f7204b5d5543` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:31:29.232501 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7223e3a4-ee4c-459c-8633-26bd077c450b admin admin] RBAC: Authorizing `identity:delete_user(user_id=8721b5ec712848f0a279f7204b5d5543)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:31:29.234707 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7223e3a4-ee4c-459c-8633-26bd077c450b admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:31:29.315774 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-7223e3a4-ee4c-459c-8633-26bd077c450b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8721b5ec712848f0a279f7204b5d5543'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:31:29.327403 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-7223e3a4-ee4c-459c-8633-26bd077c450b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8721b5ec712848f0a279f7204b5d5543'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:31:29.347857 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-7223e3a4-ee4c-459c-8633-26bd077c450b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8721b5ec712848f0a279f7204b5d5543'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:31:29.356943 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-7223e3a4-ee4c-459c-8633-26bd077c450b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8721b5ec712848f0a279f7204b5d5543'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:31:29.357672 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-7223e3a4-ee4c-459c-8633-26bd077c450b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8721b5ec712848f0a279f7204b5d5543'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:31:29.364183 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1008/2011] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Oct 12 02:31:29 2022] DELETE /identity/v3/users/8721b5ec712848f0a279f7204b5d5543 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 02:31:29.368800 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff20fca-8b49-48f5-92f2-acdb5dff1f62 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:31:29.369361 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff20fca-8b49-48f5-92f2-acdb5dff1f62 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:31:29.369361 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff20fca-8b49-48f5-92f2-acdb5dff1f62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:31:29.391446 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-cff20fca-8b49-48f5-92f2-acdb5dff1f62 None None] MFA Rules not processed for user `a326a5bb7364479382f528a592371656`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:31:29.391446 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-cff20fca-8b49-48f5-92f2-acdb5dff1f62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:31:29.506290 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1004/2012] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 02:31:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 02:31:29.519289 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7223e3a4-ee4c-459c-8633-26bd077c450b admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:31:29.520899 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-7223e3a4-ee4c-459c-8633-26bd077c450b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:31:29.652414 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7223e3a4-ee4c-459c-8633-26bd077c450b admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:31:29.657814 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae503beb-893b-4483-a550-4058d24ef1ed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5223b5cab3114e9b9a13c582f8ef8386', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'beb6def6fcad45959e56425bb8bff4d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:31:29.658773 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae503beb-893b-4483-a550-4058d24ef1ed service neutron] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:31:29.659334 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae503beb-893b-4483-a550-4058d24ef1ed service neutron] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:31:29.659954 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae503beb-893b-4483-a550-4058d24ef1ed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:31:29.693694 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae503beb-893b-4483-a550-4058d24ef1ed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:31:29.695535 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae503beb-893b-4483-a550-4058d24ef1ed service neutron] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:31:29.711358 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1009/2013] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 02:31:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 02:31:30.359391 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff20fca-8b49-48f5-92f2-acdb5dff1f62 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:31:30.360927 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-cff20fca-8b49-48f5-92f2-acdb5dff1f62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:31:30.375757 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff20fca-8b49-48f5-92f2-acdb5dff1f62 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:31:30.380922 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16aed405-3b2f-4f16-a10f-748fe46986cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:31:30.381595 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16aed405-3b2f-4f16-a10f-748fe46986cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:31:30.382006 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16aed405-3b2f-4f16-a10f-748fe46986cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:31:30.382810 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16aed405-3b2f-4f16-a10f-748fe46986cf admin admin] PATH_INFO: `/v3/projects/2ed85028a48747d38923e1466934d2d6` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:31:30.383987 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16aed405-3b2f-4f16-a10f-748fe46986cf admin admin] RBAC: Authorizing `identity:delete_project(project_id=2ed85028a48747d38923e1466934d2d6)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:31:30.386685 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16aed405-3b2f-4f16-a10f-748fe46986cf admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:31:30.453565 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:31:30.455542 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-16aed405-3b2f-4f16-a10f-748fe46986cf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2ed85028a48747d38923e1466934d2d6', 'request_id': 'req-16aed405-3b2f-4f16-a10f-748fe46986cf'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:31:30.463012 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-16aed405-3b2f-4f16-a10f-748fe46986cf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2ed85028a48747d38923e1466934d2d6', 'request_id': 'req-16aed405-3b2f-4f16-a10f-748fe46986cf'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:31:30.478121 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-16aed405-3b2f-4f16-a10f-748fe46986cf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2ed85028a48747d38923e1466934d2d6', 'request_id': 'req-16aed405-3b2f-4f16-a10f-748fe46986cf'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:31:30.498314 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-16aed405-3b2f-4f16-a10f-748fe46986cf admin admin] The token cache is being invalidate because project 2ed85028a48747d38923e1466934d2d6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81362) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 02:31:30.498648 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-16aed405-3b2f-4f16-a10f-748fe46986cf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:31:30.499435 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-16aed405-3b2f-4f16-a10f-748fe46986cf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:31:30.501209 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1005/2014] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Oct 12 02:31:30 2022] DELETE /identity/v3/projects/2ed85028a48747d38923e1466934d2d6 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 02:31:30.505281 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae503beb-893b-4483-a550-4058d24ef1ed service neutron] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:31:30.521475 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae503beb-893b-4483-a550-4058d24ef1ed service neutron] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:31:30.529453 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:31:30.614033 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95776583-aca7-4010-8fe0-39872d562663 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:31:30.614860 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95776583-aca7-4010-8fe0-39872d562663 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:31:30.615209 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95776583-aca7-4010-8fe0-39872d562663 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:31:30.615676 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95776583-aca7-4010-8fe0-39872d562663 admin admin] PATH_INFO: `/v3/users/b86924d5cafe41738581fe1fbba6d248` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:31:30.617120 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95776583-aca7-4010-8fe0-39872d562663 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b86924d5cafe41738581fe1fbba6d248)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:31:30.622667 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95776583-aca7-4010-8fe0-39872d562663 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:31:30.693505 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-95776583-aca7-4010-8fe0-39872d562663 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b86924d5cafe41738581fe1fbba6d248'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:31:30.707691 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-95776583-aca7-4010-8fe0-39872d562663 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b86924d5cafe41738581fe1fbba6d248'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:31:30.722794 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-95776583-aca7-4010-8fe0-39872d562663 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b86924d5cafe41738581fe1fbba6d248'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:31:30.731241 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-95776583-aca7-4010-8fe0-39872d562663 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b86924d5cafe41738581fe1fbba6d248'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:31:30.732101 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-95776583-aca7-4010-8fe0-39872d562663 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b86924d5cafe41738581fe1fbba6d248'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:31:30.740695 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1010/2015] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Oct 12 02:31:30 2022] DELETE /identity/v3/users/b86924d5cafe41738581fe1fbba6d248 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 02:31:31.175216 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16aed405-3b2f-4f16-a10f-748fe46986cf admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:31:31.177569 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-16aed405-3b2f-4f16-a10f-748fe46986cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:31:31.222229 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16aed405-3b2f-4f16-a10f-748fe46986cf admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:31:31.366183 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97e1bb0-7e18-4dd0-a850-00c228c2a657 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:31:31.366939 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97e1bb0-7e18-4dd0-a850-00c228c2a657 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:31:31.367220 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97e1bb0-7e18-4dd0-a850-00c228c2a657 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:31:31.367496 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97e1bb0-7e18-4dd0-a850-00c228c2a657 admin admin] PATH_INFO: `/v3/users/4144d6b3eda947488a378d2de560e6b6` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:31:31.368768 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97e1bb0-7e18-4dd0-a850-00c228c2a657 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4144d6b3eda947488a378d2de560e6b6)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:31:31.371831 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97e1bb0-7e18-4dd0-a850-00c228c2a657 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:31:31.474287 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-c97e1bb0-7e18-4dd0-a850-00c228c2a657 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4144d6b3eda947488a378d2de560e6b6'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:31:31.475951 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95776583-aca7-4010-8fe0-39872d562663 admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:31:31.477949 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-95776583-aca7-4010-8fe0-39872d562663 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:31:31.486460 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-c97e1bb0-7e18-4dd0-a850-00c228c2a657 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4144d6b3eda947488a378d2de560e6b6'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:31:31.514997 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95776583-aca7-4010-8fe0-39872d562663 admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:31:31.521959 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fb8340-0bcf-449b-9028-fe87972f2f51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:31:31.521959 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fb8340-0bcf-449b-9028-fe87972f2f51 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:31:31.522286 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fb8340-0bcf-449b-9028-fe87972f2f51 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:31:31.528742 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fb8340-0bcf-449b-9028-fe87972f2f51 admin admin] PATH_INFO: `/v3/projects/f16d7fef334a43098e501add10bece21` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:31:31.529399 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5fb8340-0bcf-449b-9028-fe87972f2f51 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f16d7fef334a43098e501add10bece21)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:31:31.531353 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5fb8340-0bcf-449b-9028-fe87972f2f51 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:31:31.539182 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-c97e1bb0-7e18-4dd0-a850-00c228c2a657 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4144d6b3eda947488a378d2de560e6b6'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:31:31.563831 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-c97e1bb0-7e18-4dd0-a850-00c228c2a657 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4144d6b3eda947488a378d2de560e6b6'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:31:31.565107 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-c97e1bb0-7e18-4dd0-a850-00c228c2a657 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4144d6b3eda947488a378d2de560e6b6'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:31:31.585089 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1006/2016] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Oct 12 02:31:31 2022] DELETE /identity/v3/users/4144d6b3eda947488a378d2de560e6b6 => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 02:31:31.596244 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd8a6f1-b28e-4ddf-a9b9-6055d1241ce0 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:31:31.597553 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd8a6f1-b28e-4ddf-a9b9-6055d1241ce0 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:31:31.597822 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd8a6f1-b28e-4ddf-a9b9-6055d1241ce0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:31:31.620776 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-f5fb8340-0bcf-449b-9028-fe87972f2f51 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f16d7fef334a43098e501add10bece21', 'request_id': 'req-f5fb8340-0bcf-449b-9028-fe87972f2f51'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:31:31.628027 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-afd8a6f1-b28e-4ddf-a9b9-6055d1241ce0 None None] MFA Rules not processed for user `a326a5bb7364479382f528a592371656`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:31:31.629305 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-afd8a6f1-b28e-4ddf-a9b9-6055d1241ce0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:31:31.629583 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-f5fb8340-0bcf-449b-9028-fe87972f2f51 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f16d7fef334a43098e501add10bece21', 'request_id': 'req-f5fb8340-0bcf-449b-9028-fe87972f2f51'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:31:31.645728 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-f5fb8340-0bcf-449b-9028-fe87972f2f51 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f16d7fef334a43098e501add10bece21', 'request_id': 'req-f5fb8340-0bcf-449b-9028-fe87972f2f51'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:31:31.673000 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-f5fb8340-0bcf-449b-9028-fe87972f2f51 admin admin] The token cache is being invalidate because project f16d7fef334a43098e501add10bece21 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81361) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 02:31:31.673323 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-f5fb8340-0bcf-449b-9028-fe87972f2f51 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:31:31.674083 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-f5fb8340-0bcf-449b-9028-fe87972f2f51 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:31:31.682086 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1011/2017] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Oct 12 02:31:31 2022] DELETE /identity/v3/projects/f16d7fef334a43098e501add10bece21 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 02:31:31.683996 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f998b36a-4f06-4ce0-b934-fca6dd37ca02 None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:31:31.684422 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f998b36a-4f06-4ce0-b934-fca6dd37ca02 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:31:31.684822 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f998b36a-4f06-4ce0-b934-fca6dd37ca02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:31:31.722338 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:31:31.725140 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-f998b36a-4f06-4ce0-b934-fca6dd37ca02 None None] MFA Rules not processed for user `a326a5bb7364479382f528a592371656`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:31:31.726592 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-f998b36a-4f06-4ce0-b934-fca6dd37ca02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:31:31.733986 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:31:31.743364 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1007/2018] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 02:31:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 02:31:31.754889 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd8a6f1-b28e-4ddf-a9b9-6055d1241ce0 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:31:31.756725 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-afd8a6f1-b28e-4ddf-a9b9-6055d1241ce0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:31:31.813851 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1012/2019] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 02:31:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 02:31:31.824601 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734f2b59-4716-400b-bde5-e6f786f2ff99 None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:31:31.825044 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734f2b59-4716-400b-bde5-e6f786f2ff99 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:31:31.825480 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734f2b59-4716-400b-bde5-e6f786f2ff99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:31:31.850995 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-734f2b59-4716-400b-bde5-e6f786f2ff99 None None] MFA Rules not processed for user `a326a5bb7364479382f528a592371656`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:31:31.851825 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd8a6f1-b28e-4ddf-a9b9-6055d1241ce0 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:31:31.852412 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-734f2b59-4716-400b-bde5-e6f786f2ff99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:31:31.857742 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08024268-6405-47b4-9177-b1b0feaa51c2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5223b5cab3114e9b9a13c582f8ef8386', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'beb6def6fcad45959e56425bb8bff4d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:31:31.858371 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08024268-6405-47b4-9177-b1b0feaa51c2 service neutron] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:31:31.858905 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08024268-6405-47b4-9177-b1b0feaa51c2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:31:31.859175 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08024268-6405-47b4-9177-b1b0feaa51c2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:31:31.863622 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1013/2020] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 02:31:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 02:31:31.868212 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734f2b59-4716-400b-bde5-e6f786f2ff99 None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:31:31.869477 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08024268-6405-47b4-9177-b1b0feaa51c2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:31:31.872430 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08024268-6405-47b4-9177-b1b0feaa51c2 service neutron] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:31:31.884695 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734f2b59-4716-400b-bde5-e6f786f2ff99 None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:31:31.900326 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5d7b45-09c4-49a2-97eb-f9f046a8da28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:31:31.900326 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5d7b45-09c4-49a2-97eb-f9f046a8da28 admin admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:31:31.900326 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5d7b45-09c4-49a2-97eb-f9f046a8da28 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:31:31.900326 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5d7b45-09c4-49a2-97eb-f9f046a8da28 admin admin] PATH_INFO: `/v3/domains` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:31:31.900875 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1008/2021] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 02:31:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 02:31:31.905122 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5d7b45-09c4-49a2-97eb-f9f046a8da28 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 02:31:31.905696 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5d7b45-09c4-49a2-97eb-f9f046a8da28 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:31:31.907349 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5d7b45-09c4-49a2-97eb-f9f046a8da28 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:31:31.922315 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1014/2022] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Oct 12 02:31:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 02:31:31.934770 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08024268-6405-47b4-9177-b1b0feaa51c2 service neutron] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:31:31.954470 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08024268-6405-47b4-9177-b1b0feaa51c2 service neutron] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:31:31.965852 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0b5711-7d5e-47c2-9dee-d2757756e7fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:31:31.966890 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0b5711-7d5e-47c2-9dee-d2757756e7fa admin admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:31:31.968738 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0b5711-7d5e-47c2-9dee-d2757756e7fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:31:31.969129 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0b5711-7d5e-47c2-9dee-d2757756e7fa admin admin] PATH_INFO: `/v3/projects` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:31:31.970365 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0b5711-7d5e-47c2-9dee-d2757756e7fa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:31:31.972295 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0b5711-7d5e-47c2-9dee-d2757756e7fa admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:31:32.040294 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1009/2023] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Oct 12 02:31:31 2022] POST /identity/v3/projects => generated 367 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 02:31:32.045863 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5d7b45-09c4-49a2-97eb-f9f046a8da28 admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:31:32.058393 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5d7b45-09c4-49a2-97eb-f9f046a8da28 admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:31:32.141444 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aff71ae-6aeb-4bbf-9661-e38013798fe6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:31:32.142267 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aff71ae-6aeb-4bbf-9661-e38013798fe6 admin admin] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:31:32.142655 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aff71ae-6aeb-4bbf-9661-e38013798fe6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:31:32.143016 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aff71ae-6aeb-4bbf-9661-e38013798fe6 admin admin] PATH_INFO: `/v3/users` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:31:32.143814 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aff71ae-6aeb-4bbf-9661-e38013798fe6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:31:32.145931 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aff71ae-6aeb-4bbf-9661-e38013798fe6 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:31:32.190733 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1015/2024] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Oct 12 02:31:32 2022] POST /identity/v3/users => generated 284 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 02:31:32.193164 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0b5711-7d5e-47c2-9dee-d2757756e7fa admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:31:32.219929 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0b5711-7d5e-47c2-9dee-d2757756e7fa admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:31:32.227976 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0160ee-9815-4650-90a6-63bf61a4c26d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:31:32.228766 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0160ee-9815-4650-90a6-63bf61a4c26d admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:31:32.229049 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0160ee-9815-4650-90a6-63bf61a4c26d admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:31:32.229400 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0160ee-9815-4650-90a6-63bf61a4c26d admin admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:31:32.230371 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0160ee-9815-4650-90a6-63bf61a4c26d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:31:32.232244 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0160ee-9815-4650-90a6-63bf61a4c26d admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:31:32.263960 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1010/2025] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Oct 12 02:31:32 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 02:31:32.268066 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aff71ae-6aeb-4bbf-9661-e38013798fe6 admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:31:32.287650 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aff71ae-6aeb-4bbf-9661-e38013798fe6 admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:31:32.297652 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9dd71e-cc7e-481c-ae71-e78911bb0e06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:31:32.298287 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9dd71e-cc7e-481c-ae71-e78911bb0e06 admin admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:31:32.298561 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9dd71e-cc7e-481c-ae71-e78911bb0e06 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:31:32.298829 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9dd71e-cc7e-481c-ae71-e78911bb0e06 admin admin] PATH_INFO: `/v3/roles` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:31:32.299652 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9dd71e-cc7e-481c-ae71-e78911bb0e06 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:31:32.301296 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9dd71e-cc7e-481c-ae71-e78911bb0e06 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:31:32.329474 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1016/2026] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Oct 12 02:31:32 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 02:31:32.333717 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0160ee-9815-4650-90a6-63bf61a4c26d admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:31:32.345849 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0160ee-9815-4650-90a6-63bf61a4c26d admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:31:32.351021 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2693cc39-40d1-4d9e-8cc5-0934d745b6ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:31:32.351826 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2693cc39-40d1-4d9e-8cc5-0934d745b6ab admin admin] REQUEST_METHOD: `PUT` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:31:32.352211 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2693cc39-40d1-4d9e-8cc5-0934d745b6ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:31:32.352952 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2693cc39-40d1-4d9e-8cc5-0934d745b6ab admin admin] PATH_INFO: `/v3/projects/bc62da245b73463ab6c0339c89f8ab9f/users/50c8c2600ace4a5b8ac342096260bffc/roles/3d75c4d7f1a849b9a771504d1583ab28` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:31:32.369562 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2693cc39-40d1-4d9e-8cc5-0934d745b6ab admin admin] RBAC: Authorizing `identity:create_grant(project_id=bc62da245b73463ab6c0339c89f8ab9f, user_id=50c8c2600ace4a5b8ac342096260bffc, role_id=3d75c4d7f1a849b9a771504d1583ab28)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:31:32.374200 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2693cc39-40d1-4d9e-8cc5-0934d745b6ab admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:31:32.414229 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1011/2027] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Oct 12 02:31:32 2022] PUT /identity/v3/projects/bc62da245b73463ab6c0339c89f8ab9f/users/50c8c2600ace4a5b8ac342096260bffc/roles/3d75c4d7f1a849b9a771504d1583ab28 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 02:31:32.416604 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd87fe6-1284-4c84-ac61-6633c3310aa9 None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:31:32.416928 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd87fe6-1284-4c84-ac61-6633c3310aa9 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:31:32.417198 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd87fe6-1284-4c84-ac61-6633c3310aa9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:31:32.446064 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2693cc39-40d1-4d9e-8cc5-0934d745b6ab admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:31:32.448982 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-2693cc39-40d1-4d9e-8cc5-0934d745b6ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:31:32.474216 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-ebd87fe6-1284-4c84-ac61-6633c3310aa9 None None] MFA Rules not processed for user `50c8c2600ace4a5b8ac342096260bffc`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:31:32.476091 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-ebd87fe6-1284-4c84-ac61-6633c3310aa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:31:32.557611 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2693cc39-40d1-4d9e-8cc5-0934d745b6ab admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:31:32.563352 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acac31d7-064f-41d2-9037-66d128b1ae21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:31:32.564197 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acac31d7-064f-41d2-9037-66d128b1ae21 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:31:32.564504 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acac31d7-064f-41d2-9037-66d128b1ae21 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:31:32.564780 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acac31d7-064f-41d2-9037-66d128b1ae21 admin admin] PATH_INFO: `/v3/projects/85eb90d06e4d4062875baa2069a1d56a` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:31:32.566255 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acac31d7-064f-41d2-9037-66d128b1ae21 admin admin] RBAC: Authorizing `identity:delete_project(project_id=85eb90d06e4d4062875baa2069a1d56a)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:31:32.568003 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acac31d7-064f-41d2-9037-66d128b1ae21 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:31:32.627504 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:31:32.633254 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:31:32.633879 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-acac31d7-064f-41d2-9037-66d128b1ae21 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '85eb90d06e4d4062875baa2069a1d56a', 'request_id': 'req-acac31d7-064f-41d2-9037-66d128b1ae21'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:31:32.648268 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1017/2028] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 02:31:32 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 02:31:32.658617 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-acac31d7-064f-41d2-9037-66d128b1ae21 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '85eb90d06e4d4062875baa2069a1d56a', 'request_id': 'req-acac31d7-064f-41d2-9037-66d128b1ae21'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:31:32.663554 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd87fe6-1284-4c84-ac61-6633c3310aa9 None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:31:32.665148 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-ebd87fe6-1284-4c84-ac61-6633c3310aa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:31:32.675298 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-acac31d7-064f-41d2-9037-66d128b1ae21 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '85eb90d06e4d4062875baa2069a1d56a', 'request_id': 'req-acac31d7-064f-41d2-9037-66d128b1ae21'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:31:32.701949 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-acac31d7-064f-41d2-9037-66d128b1ae21 admin admin] The token cache is being invalidate because project 85eb90d06e4d4062875baa2069a1d56a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81362) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 02:31:32.704844 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-acac31d7-064f-41d2-9037-66d128b1ae21 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:31:32.707651 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-acac31d7-064f-41d2-9037-66d128b1ae21 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:31:32.716847 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1012/2029] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Oct 12 02:31:32 2022] DELETE /identity/v3/projects/85eb90d06e4d4062875baa2069a1d56a => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 02:31:32.718413 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6914a6d-a1d4-4a24-950c-b34e78a7a192 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:31:32.718794 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6914a6d-a1d4-4a24-950c-b34e78a7a192 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:31:32.719657 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6914a6d-a1d4-4a24-950c-b34e78a7a192 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:31:32.752765 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-c6914a6d-a1d4-4a24-950c-b34e78a7a192 None None] MFA Rules not processed for user `a326a5bb7364479382f528a592371656`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:31:32.754182 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-c6914a6d-a1d4-4a24-950c-b34e78a7a192 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:31:32.793181 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd87fe6-1284-4c84-ac61-6633c3310aa9 None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:31:32.847115 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1013/2030] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 02:31:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 02:31:32.855953 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5012b87c-351a-4267-b044-e30deb4506ad None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:31:32.856614 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5012b87c-351a-4267-b044-e30deb4506ad None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:31:32.857159 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5012b87c-351a-4267-b044-e30deb4506ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:31:32.896874 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54681a20-9da1-420d-8c27-e98f1b004427 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8285a132afeb47558e1b3dcedfd7b4e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'beb6def6fcad45959e56425bb8bff4d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:31:32.897644 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54681a20-9da1-420d-8c27-e98f1b004427 service glance] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:31:32.898013 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54681a20-9da1-420d-8c27-e98f1b004427 service glance] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:31:32.898697 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54681a20-9da1-420d-8c27-e98f1b004427 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:31:32.899822 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-5012b87c-351a-4267-b044-e30deb4506ad None None] MFA Rules not processed for user `a326a5bb7364479382f528a592371656`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:31:32.901934 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-5012b87c-351a-4267-b044-e30deb4506ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:31:32.913003 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1014/2031] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 02:31:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 02:31:32.916621 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-54681a20-9da1-420d-8c27-e98f1b004427 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:31:32.918451 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5012b87c-351a-4267-b044-e30deb4506ad None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:31:32.929784 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5012b87c-351a-4267-b044-e30deb4506ad None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:31:32.936058 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446072c5-3828-4a6b-8f1e-631da7fdc4c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:31:32.936988 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446072c5-3828-4a6b-8f1e-631da7fdc4c8 admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:31:32.937431 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446072c5-3828-4a6b-8f1e-631da7fdc4c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:31:32.937850 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446072c5-3828-4a6b-8f1e-631da7fdc4c8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:31:32.938724 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446072c5-3828-4a6b-8f1e-631da7fdc4c8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 02:31:32.939168 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446072c5-3828-4a6b-8f1e-631da7fdc4c8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:31:32.941519 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446072c5-3828-4a6b-8f1e-631da7fdc4c8 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:31:32.956653 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1015/2032] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Oct 12 02:31:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 02:31:32.960024 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446072c5-3828-4a6b-8f1e-631da7fdc4c8 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:31:32.972849 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446072c5-3828-4a6b-8f1e-631da7fdc4c8 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:31:32.978740 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fb1d13-a388-47bb-ab5f-daa55bfd00a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:31:32.979448 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fb1d13-a388-47bb-ab5f-daa55bfd00a1 admin admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:31:32.979977 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fb1d13-a388-47bb-ab5f-daa55bfd00a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:31:32.980408 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fb1d13-a388-47bb-ab5f-daa55bfd00a1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:31:32.981087 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fb1d13-a388-47bb-ab5f-daa55bfd00a1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:31:32.982993 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fb1d13-a388-47bb-ab5f-daa55bfd00a1 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:31:33.001908 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54681a20-9da1-420d-8c27-e98f1b004427 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:31:33.003528 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54681a20-9da1-420d-8c27-e98f1b004427 service glance] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:31:33.014665 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1018/2033] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 02:31:32 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 02:31:33.017828 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1016/2034] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Oct 12 02:31:32 2022] POST /identity/v3/projects => generated 357 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 02:31:33.025596 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54681a20-9da1-420d-8c27-e98f1b004427 service glance] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:31:33.053935 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54681a20-9da1-420d-8c27-e98f1b004427 service glance] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:31:33.144588 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16840de9-7348-49e2-85a8-fe91388e0430 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:31:33.145405 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16840de9-7348-49e2-85a8-fe91388e0430 admin admin] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:31:33.145900 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16840de9-7348-49e2-85a8-fe91388e0430 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:31:33.146399 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16840de9-7348-49e2-85a8-fe91388e0430 admin admin] PATH_INFO: `/v3/users` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:31:33.147192 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16840de9-7348-49e2-85a8-fe91388e0430 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:31:33.149594 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16840de9-7348-49e2-85a8-fe91388e0430 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:31:33.170410 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:31:33.183344 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1019/2035] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Oct 12 02:31:33 2022] POST /identity/v3/users => generated 279 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 02:31:33.187557 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fb1d13-a388-47bb-ab5f-daa55bfd00a1 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:31:33.199097 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fb1d13-a388-47bb-ab5f-daa55bfd00a1 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:31:33.208006 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f30f31-574a-4e6d-a883-4f3653909197 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:31:33.208874 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f30f31-574a-4e6d-a883-4f3653909197 admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:31:33.209306 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f30f31-574a-4e6d-a883-4f3653909197 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:31:33.209712 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f30f31-574a-4e6d-a883-4f3653909197 admin admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:31:33.211701 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f30f31-574a-4e6d-a883-4f3653909197 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:31:33.213684 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f30f31-574a-4e6d-a883-4f3653909197 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:31:33.230650 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1017/2036] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Oct 12 02:31:33 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 12 02:31:33.231432 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16840de9-7348-49e2-85a8-fe91388e0430 admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:31:33.248845 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16840de9-7348-49e2-85a8-fe91388e0430 admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:31:33.273881 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53ed18e-8149-412a-a88a-f7e24dbeece5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:31:33.274914 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53ed18e-8149-412a-a88a-f7e24dbeece5 admin admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:31:33.275359 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53ed18e-8149-412a-a88a-f7e24dbeece5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:31:33.276806 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53ed18e-8149-412a-a88a-f7e24dbeece5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:31:33.277639 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53ed18e-8149-412a-a88a-f7e24dbeece5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:31:33.279802 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53ed18e-8149-412a-a88a-f7e24dbeece5 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:31:33.297872 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1020/2037] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Oct 12 02:31:33 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 12 02:31:33.302078 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f30f31-574a-4e6d-a883-4f3653909197 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:31:33.325799 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f30f31-574a-4e6d-a883-4f3653909197 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:31:33.332015 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d64413-e0a7-4744-8896-b72c5c3ec7cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:31:33.332838 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d64413-e0a7-4744-8896-b72c5c3ec7cb admin admin] REQUEST_METHOD: `PUT` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:31:33.333159 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d64413-e0a7-4744-8896-b72c5c3ec7cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:31:33.333510 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d64413-e0a7-4744-8896-b72c5c3ec7cb admin admin] PATH_INFO: `/v3/projects/de5fd1eaf7af4b59a023081f645a2261/users/e1ab95d676b44993bab55449ba4fd4c9/roles/3d75c4d7f1a849b9a771504d1583ab28` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:31:33.351756 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d64413-e0a7-4744-8896-b72c5c3ec7cb admin admin] RBAC: Authorizing `identity:create_grant(project_id=de5fd1eaf7af4b59a023081f645a2261, user_id=e1ab95d676b44993bab55449ba4fd4c9, role_id=3d75c4d7f1a849b9a771504d1583ab28)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:31:33.355079 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d64413-e0a7-4744-8896-b72c5c3ec7cb admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:31:33.376141 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1018/2038] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Oct 12 02:31:33 2022] PUT /identity/v3/projects/de5fd1eaf7af4b59a023081f645a2261/users/e1ab95d676b44993bab55449ba4fd4c9/roles/3d75c4d7f1a849b9a771504d1583ab28 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 02:31:33.387714 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b5d9a0-5a0c-45e8-bbe5-7c73a46b3a7b None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:31:33.388015 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b5d9a0-5a0c-45e8-bbe5-7c73a46b3a7b None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:31:33.388368 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b5d9a0-5a0c-45e8-bbe5-7c73a46b3a7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:31:33.442469 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-d5b5d9a0-5a0c-45e8-bbe5-7c73a46b3a7b None None] MFA Rules not processed for user `e1ab95d676b44993bab55449ba4fd4c9`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:31:33.443753 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-d5b5d9a0-5a0c-45e8-bbe5-7c73a46b3a7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:31:33.556651 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1021/2039] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 02:31:33 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 02:31:33.593673 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d64413-e0a7-4744-8896-b72c5c3ec7cb admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:31:33.595706 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-a1d64413-e0a7-4744-8896-b72c5c3ec7cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:31:33.674513 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d64413-e0a7-4744-8896-b72c5c3ec7cb admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:31:33.683111 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9b02f3-557c-4932-b370-a991920be607 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ba688e0c4d44d13898539ee886f95fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'beb6def6fcad45959e56425bb8bff4d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:31:33.683895 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9b02f3-557c-4932-b370-a991920be607 service cinder] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:31:33.684702 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9b02f3-557c-4932-b370-a991920be607 service cinder] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:31:33.692436 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9b02f3-557c-4932-b370-a991920be607 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:31:33.705141 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9b02f3-557c-4932-b370-a991920be607 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:31:33.706642 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9b02f3-557c-4932-b370-a991920be607 service cinder] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:31:33.712938 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:31:33.732211 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1019/2040] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 02:31:33 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 02:31:33.762632 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b5d9a0-5a0c-45e8-bbe5-7c73a46b3a7b None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:31:33.841317 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b5d9a0-5a0c-45e8-bbe5-7c73a46b3a7b None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:31:33.846647 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bfdb38-e5b1-4e7b-9258-dd8e8d9d6fd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:31:33.847383 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bfdb38-e5b1-4e7b-9258-dd8e8d9d6fd8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:31:33.847661 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bfdb38-e5b1-4e7b-9258-dd8e8d9d6fd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:31:33.847948 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bfdb38-e5b1-4e7b-9258-dd8e8d9d6fd8 admin admin] PATH_INFO: `/v3/users/e1ab95d676b44993bab55449ba4fd4c9` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:31:33.849073 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5bfdb38-e5b1-4e7b-9258-dd8e8d9d6fd8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e1ab95d676b44993bab55449ba4fd4c9)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:31:33.850995 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5bfdb38-e5b1-4e7b-9258-dd8e8d9d6fd8 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:31:33.907445 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-c5bfdb38-e5b1-4e7b-9258-dd8e8d9d6fd8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e1ab95d676b44993bab55449ba4fd4c9'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:31:33.915348 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-c5bfdb38-e5b1-4e7b-9258-dd8e8d9d6fd8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e1ab95d676b44993bab55449ba4fd4c9'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:31:33.937485 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-c5bfdb38-e5b1-4e7b-9258-dd8e8d9d6fd8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e1ab95d676b44993bab55449ba4fd4c9'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:31:33.949872 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-c5bfdb38-e5b1-4e7b-9258-dd8e8d9d6fd8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e1ab95d676b44993bab55449ba4fd4c9'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:31:33.950661 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-c5bfdb38-e5b1-4e7b-9258-dd8e8d9d6fd8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e1ab95d676b44993bab55449ba4fd4c9'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:31:33.952184 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:31:33.959561 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1022/2041] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Oct 12 02:31:33 2022] DELETE /identity/v3/users/e1ab95d676b44993bab55449ba4fd4c9 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 02:31:33.964531 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118ae4ea-476b-466f-8942-ad820d1bf82f None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:31:33.964837 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118ae4ea-476b-466f-8942-ad820d1bf82f None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:31:33.965104 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118ae4ea-476b-466f-8942-ad820d1bf82f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:31:33.985597 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-118ae4ea-476b-466f-8942-ad820d1bf82f None None] MFA Rules not processed for user `a326a5bb7364479382f528a592371656`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:31:33.987377 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-118ae4ea-476b-466f-8942-ad820d1bf82f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:31:34.057035 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1020/2042] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 02:31:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 02:31:34.072696 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bfdb38-e5b1-4e7b-9258-dd8e8d9d6fd8 admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:31:34.074857 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-c5bfdb38-e5b1-4e7b-9258-dd8e8d9d6fd8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:31:34.134779 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bfdb38-e5b1-4e7b-9258-dd8e8d9d6fd8 admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:31:34.139989 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9286df-667b-422c-abce-0cf8b6bf013e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5223b5cab3114e9b9a13c582f8ef8386', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'beb6def6fcad45959e56425bb8bff4d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:31:34.140709 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9286df-667b-422c-abce-0cf8b6bf013e service neutron] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:31:34.141052 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9286df-667b-422c-abce-0cf8b6bf013e service neutron] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:31:34.141391 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9286df-667b-422c-abce-0cf8b6bf013e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:31:34.154106 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9286df-667b-422c-abce-0cf8b6bf013e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:31:34.155643 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9286df-667b-422c-abce-0cf8b6bf013e service neutron] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:31:34.172441 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1023/2043] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 02:31:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 02:31:34.476924 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118ae4ea-476b-466f-8942-ad820d1bf82f None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:31:34.478382 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-118ae4ea-476b-466f-8942-ad820d1bf82f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:31:34.492754 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118ae4ea-476b-466f-8942-ad820d1bf82f None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:31:34.499075 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10a04b8-f389-415c-b64c-ddacf56401c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:31:34.499858 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10a04b8-f389-415c-b64c-ddacf56401c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:31:34.499983 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10a04b8-f389-415c-b64c-ddacf56401c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:31:34.500238 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10a04b8-f389-415c-b64c-ddacf56401c2 admin admin] PATH_INFO: `/v3/projects/de5fd1eaf7af4b59a023081f645a2261` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:31:34.501441 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10a04b8-f389-415c-b64c-ddacf56401c2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=de5fd1eaf7af4b59a023081f645a2261)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:31:34.503377 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10a04b8-f389-415c-b64c-ddacf56401c2 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:31:34.560370 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-a10a04b8-f389-415c-b64c-ddacf56401c2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'de5fd1eaf7af4b59a023081f645a2261', 'request_id': 'req-a10a04b8-f389-415c-b64c-ddacf56401c2'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:31:34.566667 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-a10a04b8-f389-415c-b64c-ddacf56401c2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'de5fd1eaf7af4b59a023081f645a2261', 'request_id': 'req-a10a04b8-f389-415c-b64c-ddacf56401c2'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:31:34.574918 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-a10a04b8-f389-415c-b64c-ddacf56401c2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'de5fd1eaf7af4b59a023081f645a2261', 'request_id': 'req-a10a04b8-f389-415c-b64c-ddacf56401c2'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:31:34.597951 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-a10a04b8-f389-415c-b64c-ddacf56401c2 admin admin] The token cache is being invalidate because project de5fd1eaf7af4b59a023081f645a2261 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81362) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 02:31:34.598638 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-a10a04b8-f389-415c-b64c-ddacf56401c2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:31:34.598909 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-a10a04b8-f389-415c-b64c-ddacf56401c2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:31:34.600447 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1021/2044] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Oct 12 02:31:34 2022] DELETE /identity/v3/projects/de5fd1eaf7af4b59a023081f645a2261 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 02:31:34.607487 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9fec93-be24-4c54-8de8-21fb95726541 None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:31:34.608803 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9fec93-be24-4c54-8de8-21fb95726541 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:31:34.609174 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9fec93-be24-4c54-8de8-21fb95726541 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:31:34.632761 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-dd9fec93-be24-4c54-8de8-21fb95726541 None None] MFA Rules not processed for user `a326a5bb7364479382f528a592371656`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:31:34.633981 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-dd9fec93-be24-4c54-8de8-21fb95726541 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:31:34.698654 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1024/2045] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 02:31:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 02:31:34.706590 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13aa0c74-77db-4861-8594-7ba24e55e9dc None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:31:34.707159 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13aa0c74-77db-4861-8594-7ba24e55e9dc None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:31:34.707631 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13aa0c74-77db-4861-8594-7ba24e55e9dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:31:34.740220 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-13aa0c74-77db-4861-8594-7ba24e55e9dc None None] MFA Rules not processed for user `a326a5bb7364479382f528a592371656`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:31:34.743042 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-13aa0c74-77db-4861-8594-7ba24e55e9dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:31:34.754398 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1022/2046] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 02:31:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 02:31:34.759378 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9fec93-be24-4c54-8de8-21fb95726541 None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:31:34.778897 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9fec93-be24-4c54-8de8-21fb95726541 None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:31:34.783445 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b9d57f-fa09-4238-8708-57be04dfd78b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:31:34.784223 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b9d57f-fa09-4238-8708-57be04dfd78b admin admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:31:34.784659 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b9d57f-fa09-4238-8708-57be04dfd78b admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:31:34.785322 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b9d57f-fa09-4238-8708-57be04dfd78b admin admin] PATH_INFO: `/v3/domains` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:31:34.786152 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b9d57f-fa09-4238-8708-57be04dfd78b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 02:31:34.786555 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b9d57f-fa09-4238-8708-57be04dfd78b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:31:34.788744 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b9d57f-fa09-4238-8708-57be04dfd78b admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:31:34.815234 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1025/2047] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Oct 12 02:31:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 02:31:34.819780 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13aa0c74-77db-4861-8594-7ba24e55e9dc None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:31:34.836748 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13aa0c74-77db-4861-8594-7ba24e55e9dc None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:31:34.845252 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0765db22-7c43-4b22-8bfc-c98e9ec3d3e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:31:34.846190 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0765db22-7c43-4b22-8bfc-c98e9ec3d3e8 admin admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:31:34.846575 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0765db22-7c43-4b22-8bfc-c98e9ec3d3e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:31:34.846957 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0765db22-7c43-4b22-8bfc-c98e9ec3d3e8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:31:34.850450 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0765db22-7c43-4b22-8bfc-c98e9ec3d3e8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:31:34.852726 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0765db22-7c43-4b22-8bfc-c98e9ec3d3e8 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:31:34.902516 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1023/2048] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Oct 12 02:31:34 2022] POST /identity/v3/projects => generated 373 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 02:31:34.903326 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b9d57f-fa09-4238-8708-57be04dfd78b admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:31:34.920833 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b9d57f-fa09-4238-8708-57be04dfd78b admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:31:35.031409 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe74755-ebf4-4ba3-8ed4-9ae70ccb078a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:31:35.031957 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe74755-ebf4-4ba3-8ed4-9ae70ccb078a admin admin] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:31:35.032255 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe74755-ebf4-4ba3-8ed4-9ae70ccb078a admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:31:35.032557 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe74755-ebf4-4ba3-8ed4-9ae70ccb078a admin admin] PATH_INFO: `/v3/users` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:31:35.033352 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe74755-ebf4-4ba3-8ed4-9ae70ccb078a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:31:35.035279 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe74755-ebf4-4ba3-8ed4-9ae70ccb078a admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:31:35.063034 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1026/2049] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Oct 12 02:31:34 2022] POST /identity/v3/users => generated 287 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 02:31:35.064587 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0765db22-7c43-4b22-8bfc-c98e9ec3d3e8 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:31:35.079343 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0765db22-7c43-4b22-8bfc-c98e9ec3d3e8 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:31:35.095618 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530e0898-9f57-4339-8696-52b067a09ac1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:31:35.097543 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530e0898-9f57-4339-8696-52b067a09ac1 admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:31:35.097706 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530e0898-9f57-4339-8696-52b067a09ac1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:31:35.098019 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530e0898-9f57-4339-8696-52b067a09ac1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:31:35.098803 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530e0898-9f57-4339-8696-52b067a09ac1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:31:35.100949 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530e0898-9f57-4339-8696-52b067a09ac1 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:31:35.113702 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1024/2050] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Oct 12 02:31:35 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 02:31:35.117903 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe74755-ebf4-4ba3-8ed4-9ae70ccb078a admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:31:35.130722 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe74755-ebf4-4ba3-8ed4-9ae70ccb078a admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:31:35.143911 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7d1144-ba5b-46d9-94f1-2aed3081d5f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:31:35.144801 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7d1144-ba5b-46d9-94f1-2aed3081d5f1 admin admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:31:35.145149 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7d1144-ba5b-46d9-94f1-2aed3081d5f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:31:35.145523 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7d1144-ba5b-46d9-94f1-2aed3081d5f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:31:35.146948 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7d1144-ba5b-46d9-94f1-2aed3081d5f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:31:35.148723 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7d1144-ba5b-46d9-94f1-2aed3081d5f1 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:31:35.162744 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1027/2051] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Oct 12 02:31:35 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 02:31:35.167881 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530e0898-9f57-4339-8696-52b067a09ac1 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:31:35.179006 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530e0898-9f57-4339-8696-52b067a09ac1 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:31:35.184742 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0909bd1e-29b3-4466-ac3c-355c43cc656e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:31:35.185802 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0909bd1e-29b3-4466-ac3c-355c43cc656e admin admin] REQUEST_METHOD: `PUT` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:31:35.186246 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0909bd1e-29b3-4466-ac3c-355c43cc656e admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:31:35.186591 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0909bd1e-29b3-4466-ac3c-355c43cc656e admin admin] PATH_INFO: `/v3/projects/6fc52397af5e43f088b80ace86b9d736/users/583c1dce3dcb4dfb92a8af9d9e5adf9a/roles/3d75c4d7f1a849b9a771504d1583ab28` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:31:35.215108 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0909bd1e-29b3-4466-ac3c-355c43cc656e admin admin] RBAC: Authorizing `identity:create_grant(project_id=6fc52397af5e43f088b80ace86b9d736, user_id=583c1dce3dcb4dfb92a8af9d9e5adf9a, role_id=3d75c4d7f1a849b9a771504d1583ab28)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:31:35.218306 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0909bd1e-29b3-4466-ac3c-355c43cc656e admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:31:35.236425 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1025/2052] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Oct 12 02:31:35 2022] PUT /identity/v3/projects/6fc52397af5e43f088b80ace86b9d736/users/583c1dce3dcb4dfb92a8af9d9e5adf9a/roles/3d75c4d7f1a849b9a771504d1583ab28 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 02:31:35.241762 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347d8acf-e56c-4077-a3eb-50f3fd793dfc None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:31:35.242049 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347d8acf-e56c-4077-a3eb-50f3fd793dfc None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:31:35.242381 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347d8acf-e56c-4077-a3eb-50f3fd793dfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:31:35.264544 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:31:35.273377 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-347d8acf-e56c-4077-a3eb-50f3fd793dfc None None] MFA Rules not processed for user `a326a5bb7364479382f528a592371656`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:31:35.275677 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-347d8acf-e56c-4077-a3eb-50f3fd793dfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:31:35.351980 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1028/2053] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 02:31:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 02:31:35.362059 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0909bd1e-29b3-4466-ac3c-355c43cc656e admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:31:35.363872 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-0909bd1e-29b3-4466-ac3c-355c43cc656e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:31:35.397550 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:31:35.438682 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0909bd1e-29b3-4466-ac3c-355c43cc656e admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:31:35.443632 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be35ba01-463a-49ba-9fe0-594499df9d1a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5223b5cab3114e9b9a13c582f8ef8386', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'beb6def6fcad45959e56425bb8bff4d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:31:35.444536 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be35ba01-463a-49ba-9fe0-594499df9d1a service neutron] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:31:35.444719 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be35ba01-463a-49ba-9fe0-594499df9d1a service neutron] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:31:35.445003 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be35ba01-463a-49ba-9fe0-594499df9d1a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:31:35.462341 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be35ba01-463a-49ba-9fe0-594499df9d1a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:31:35.464232 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be35ba01-463a-49ba-9fe0-594499df9d1a service neutron] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:31:35.484552 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1026/2054] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 02:31:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 02:31:36.837729 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390f0842-d7f4-4327-80d5-545beb4e1c6b None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:31:36.838270 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390f0842-d7f4-4327-80d5-545beb4e1c6b None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:31:36.838270 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390f0842-d7f4-4327-80d5-545beb4e1c6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:31:36.866079 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-390f0842-d7f4-4327-80d5-545beb4e1c6b None None] MFA Rules not processed for user `583c1dce3dcb4dfb92a8af9d9e5adf9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:31:36.867327 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-390f0842-d7f4-4327-80d5-545beb4e1c6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:31:36.954102 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1029/2055] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 02:31:36 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 02:31:36.965923 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be35ba01-463a-49ba-9fe0-594499df9d1a service neutron] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:31:36.968041 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-be35ba01-463a-49ba-9fe0-594499df9d1a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:31:37.056336 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be35ba01-463a-49ba-9fe0-594499df9d1a service neutron] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:31:37.061095 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ec67ec-dcff-41ae-98c0-ee385cf1eb0b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ba688e0c4d44d13898539ee886f95fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'beb6def6fcad45959e56425bb8bff4d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:31:37.061930 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ec67ec-dcff-41ae-98c0-ee385cf1eb0b service cinder] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:31:37.062212 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ec67ec-dcff-41ae-98c0-ee385cf1eb0b service cinder] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:31:37.062489 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ec67ec-dcff-41ae-98c0-ee385cf1eb0b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:31:37.072612 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ec67ec-dcff-41ae-98c0-ee385cf1eb0b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:31:37.074734 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ec67ec-dcff-41ae-98c0-ee385cf1eb0b service cinder] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:31:37.086527 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1027/2056] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 02:31:36 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 02:31:38.574784 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f90407c-141b-462e-88b9-b408ea326dde None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:31:38.575374 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f90407c-141b-462e-88b9-b408ea326dde None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:31:38.575374 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f90407c-141b-462e-88b9-b408ea326dde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:31:38.616833 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-1f90407c-141b-462e-88b9-b408ea326dde None None] MFA Rules not processed for user `583c1dce3dcb4dfb92a8af9d9e5adf9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:31:38.621732 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-1f90407c-141b-462e-88b9-b408ea326dde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:31:38.629386 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1030/2057] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 02:31:38 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 02:31:40.839724 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6a3026-0b27-4bfd-bdb5-838b6ddb9ce1 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:31:40.840284 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6a3026-0b27-4bfd-bdb5-838b6ddb9ce1 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:31:40.840284 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6a3026-0b27-4bfd-bdb5-838b6ddb9ce1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:31:40.859860 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-ce6a3026-0b27-4bfd-bdb5-838b6ddb9ce1 None None] MFA Rules not processed for user `e5a8c753a1c54dddaac24b5faaaf197a`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:31:40.861083 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-ce6a3026-0b27-4bfd-bdb5-838b6ddb9ce1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:31:40.922457 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1028/2058] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 02:31:40 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 02:31:42.215158 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c677f9d4-d065-4c26-9950-6b87cecfac74 None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:31:42.215741 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c677f9d4-d065-4c26-9950-6b87cecfac74 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:31:42.216981 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c677f9d4-d065-4c26-9950-6b87cecfac74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:31:42.240826 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-c677f9d4-d065-4c26-9950-6b87cecfac74 None None] MFA Rules not processed for user `8d0e2087e5324071926c3dc3a3cb9b1d`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:31:42.242206 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-c677f9d4-d065-4c26-9950-6b87cecfac74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:31:42.329680 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1031/2059] 10.222.0.18 () {58 vars in 1009 bytes} [Wed Oct 12 02:31:42 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 02:31:42.348986 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6a3026-0b27-4bfd-bdb5-838b6ddb9ce1 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:31:42.351378 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-ce6a3026-0b27-4bfd-bdb5-838b6ddb9ce1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:31:42.444209 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6a3026-0b27-4bfd-bdb5-838b6ddb9ce1 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:31:42.450622 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605dc261-8931-4930-8710-b11b8144cb44 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af9bd50c42cc437dbdd5a431d8adbb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'beb6def6fcad45959e56425bb8bff4d1', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:31:42.451388 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605dc261-8931-4930-8710-b11b8144cb44 service swift] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:31:42.451807 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605dc261-8931-4930-8710-b11b8144cb44 service swift] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:31:42.452185 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605dc261-8931-4930-8710-b11b8144cb44 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:31:42.462151 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605dc261-8931-4930-8710-b11b8144cb44 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:31:42.463849 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605dc261-8931-4930-8710-b11b8144cb44 service swift] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:31:42.467335 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:31:42.475410 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1029/2060] 10.222.0.18 () {60 vars in 1384 bytes} [Wed Oct 12 02:31:42 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 12 02:31:52.319023 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=84 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:31:52.471755 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=1 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:31:54.386883 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c677f9d4-d065-4c26-9950-6b87cecfac74 None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:31:54.396592 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c677f9d4-d065-4c26-9950-6b87cecfac74 None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:31:54.401411 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f3194a-fd91-429a-be23-cb7dc79d7cb6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5223b5cab3114e9b9a13c582f8ef8386', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'beb6def6fcad45959e56425bb8bff4d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:31:54.402018 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f3194a-fd91-429a-be23-cb7dc79d7cb6 service neutron] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:31:54.402293 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f3194a-fd91-429a-be23-cb7dc79d7cb6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:31:54.402807 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f3194a-fd91-429a-be23-cb7dc79d7cb6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:31:54.405461 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-38f3194a-fd91-429a-be23-cb7dc79d7cb6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:31:54.487196 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f3194a-fd91-429a-be23-cb7dc79d7cb6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:31:54.489608 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f3194a-fd91-429a-be23-cb7dc79d7cb6 service neutron] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:31:54.502577 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1032/2061] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 02:31:54 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 02:31:59.636265 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605dc261-8931-4930-8710-b11b8144cb44 service swift] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:31:59.637722 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-605dc261-8931-4930-8710-b11b8144cb44 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:31:59.651466 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605dc261-8931-4930-8710-b11b8144cb44 service swift] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:31:59.655917 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a09d8b9-8819-4dfe-9d44-5ce88a3ac3b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:31:59.656569 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a09d8b9-8819-4dfe-9d44-5ce88a3ac3b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:31:59.656851 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a09d8b9-8819-4dfe-9d44-5ce88a3ac3b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:31:59.657123 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a09d8b9-8819-4dfe-9d44-5ce88a3ac3b8 admin admin] PATH_INFO: `/v3/users/50c8c2600ace4a5b8ac342096260bffc` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:31:59.658230 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a09d8b9-8819-4dfe-9d44-5ce88a3ac3b8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=50c8c2600ace4a5b8ac342096260bffc)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:31:59.660134 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a09d8b9-8819-4dfe-9d44-5ce88a3ac3b8 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:31:59.706389 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-7a09d8b9-8819-4dfe-9d44-5ce88a3ac3b8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '50c8c2600ace4a5b8ac342096260bffc'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:31:59.713993 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-7a09d8b9-8819-4dfe-9d44-5ce88a3ac3b8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '50c8c2600ace4a5b8ac342096260bffc'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:31:59.726328 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-7a09d8b9-8819-4dfe-9d44-5ce88a3ac3b8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '50c8c2600ace4a5b8ac342096260bffc'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:31:59.734168 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-7a09d8b9-8819-4dfe-9d44-5ce88a3ac3b8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '50c8c2600ace4a5b8ac342096260bffc'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:31:59.734839 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-7a09d8b9-8819-4dfe-9d44-5ce88a3ac3b8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '50c8c2600ace4a5b8ac342096260bffc'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:31:59.740728 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1030/2062] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Oct 12 02:31:59 2022] DELETE /identity/v3/users/50c8c2600ace4a5b8ac342096260bffc => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 02:31:59.745934 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e22abff-7e9e-4733-a42c-fe1ebd953a29 None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:31:59.746411 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e22abff-7e9e-4733-a42c-fe1ebd953a29 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:31:59.746504 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e22abff-7e9e-4733-a42c-fe1ebd953a29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:31:59.765236 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-2e22abff-7e9e-4733-a42c-fe1ebd953a29 None None] MFA Rules not processed for user `a326a5bb7364479382f528a592371656`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:31:59.766428 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-2e22abff-7e9e-4733-a42c-fe1ebd953a29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:31:59.836409 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1033/2063] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 02:31:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 02:31:59.847350 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a09d8b9-8819-4dfe-9d44-5ce88a3ac3b8 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:31:59.848892 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-7a09d8b9-8819-4dfe-9d44-5ce88a3ac3b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:31:59.911654 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a09d8b9-8819-4dfe-9d44-5ce88a3ac3b8 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:31:59.915864 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3ceb70-86d0-4092-a4ae-36288fe99f52 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5223b5cab3114e9b9a13c582f8ef8386', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'beb6def6fcad45959e56425bb8bff4d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:31:59.916632 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3ceb70-86d0-4092-a4ae-36288fe99f52 service neutron] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:31:59.916911 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3ceb70-86d0-4092-a4ae-36288fe99f52 service neutron] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:31:59.917212 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3ceb70-86d0-4092-a4ae-36288fe99f52 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:31:59.926526 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3ceb70-86d0-4092-a4ae-36288fe99f52 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:31:59.927933 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3ceb70-86d0-4092-a4ae-36288fe99f52 service neutron] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:31:59.938148 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1031/2064] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 02:31:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 12 02:32:00.208635 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e22abff-7e9e-4733-a42c-fe1ebd953a29 None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:32:00.210349 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-2e22abff-7e9e-4733-a42c-fe1ebd953a29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:32:00.225251 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e22abff-7e9e-4733-a42c-fe1ebd953a29 None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:32:00.230365 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a693672f-5611-49d7-b24f-278a412c61e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:32:00.231078 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a693672f-5611-49d7-b24f-278a412c61e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:32:00.231425 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a693672f-5611-49d7-b24f-278a412c61e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:32:00.231764 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a693672f-5611-49d7-b24f-278a412c61e3 admin admin] PATH_INFO: `/v3/projects/bc62da245b73463ab6c0339c89f8ab9f` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:32:00.233794 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a693672f-5611-49d7-b24f-278a412c61e3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bc62da245b73463ab6c0339c89f8ab9f)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:32:00.235891 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a693672f-5611-49d7-b24f-278a412c61e3 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:32:00.289228 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-a693672f-5611-49d7-b24f-278a412c61e3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bc62da245b73463ab6c0339c89f8ab9f', 'request_id': 'req-a693672f-5611-49d7-b24f-278a412c61e3'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:32:00.296123 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-a693672f-5611-49d7-b24f-278a412c61e3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bc62da245b73463ab6c0339c89f8ab9f', 'request_id': 'req-a693672f-5611-49d7-b24f-278a412c61e3'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:32:00.302849 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-a693672f-5611-49d7-b24f-278a412c61e3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bc62da245b73463ab6c0339c89f8ab9f', 'request_id': 'req-a693672f-5611-49d7-b24f-278a412c61e3'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:32:00.316855 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-a693672f-5611-49d7-b24f-278a412c61e3 admin admin] The token cache is being invalidate because project bc62da245b73463ab6c0339c89f8ab9f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81361) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 02:32:00.317069 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-a693672f-5611-49d7-b24f-278a412c61e3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:32:00.317717 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-a693672f-5611-49d7-b24f-278a412c61e3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:32:00.319472 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1034/2065] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Oct 12 02:32:00 2022] DELETE /identity/v3/projects/bc62da245b73463ab6c0339c89f8ab9f => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 02:32:00.324842 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646950cd-aa8b-4bc9-a152-c689b51ff16f None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:32:00.325130 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646950cd-aa8b-4bc9-a152-c689b51ff16f None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:32:00.325408 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646950cd-aa8b-4bc9-a152-c689b51ff16f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:32:00.347625 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-646950cd-aa8b-4bc9-a152-c689b51ff16f None None] MFA Rules not processed for user `a326a5bb7364479382f528a592371656`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:32:00.348868 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-646950cd-aa8b-4bc9-a152-c689b51ff16f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:32:00.414799 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1032/2066] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 02:32:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 02:32:00.423918 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a98abb2-1199-46db-9610-58967e994cb8 None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:32:00.424203 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a98abb2-1199-46db-9610-58967e994cb8 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:32:00.424503 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a98abb2-1199-46db-9610-58967e994cb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:32:00.454240 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-0a98abb2-1199-46db-9610-58967e994cb8 None None] MFA Rules not processed for user `a326a5bb7364479382f528a592371656`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:32:00.455446 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-0a98abb2-1199-46db-9610-58967e994cb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:32:00.463583 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1035/2067] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 02:32:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 02:32:00.469088 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646950cd-aa8b-4bc9-a152-c689b51ff16f None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:32:00.480099 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646950cd-aa8b-4bc9-a152-c689b51ff16f None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:32:00.485043 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4de83a2-de44-4618-8956-99d667dc08b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:32:00.485646 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4de83a2-de44-4618-8956-99d667dc08b9 admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:32:00.485918 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4de83a2-de44-4618-8956-99d667dc08b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:32:00.486184 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4de83a2-de44-4618-8956-99d667dc08b9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:32:00.486825 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4de83a2-de44-4618-8956-99d667dc08b9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 02:32:00.487117 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4de83a2-de44-4618-8956-99d667dc08b9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:32:00.488730 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4de83a2-de44-4618-8956-99d667dc08b9 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:32:00.501046 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1033/2068] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Oct 12 02:32:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 02:32:00.505406 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a98abb2-1199-46db-9610-58967e994cb8 None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:32:00.514739 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a98abb2-1199-46db-9610-58967e994cb8 None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:32:00.519520 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3ee84b-dd2b-45a9-838f-89b98cbe117d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:32:00.520111 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3ee84b-dd2b-45a9-838f-89b98cbe117d admin admin] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:32:00.520386 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3ee84b-dd2b-45a9-838f-89b98cbe117d admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:32:00.520738 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3ee84b-dd2b-45a9-838f-89b98cbe117d admin admin] PATH_INFO: `/v3/projects` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:32:00.521374 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3ee84b-dd2b-45a9-838f-89b98cbe117d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:32:00.523328 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3ee84b-dd2b-45a9-838f-89b98cbe117d admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:32:00.533662 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:32:00.555217 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1036/2069] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Oct 12 02:32:00 2022] POST /identity/v3/projects => generated 375 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 02:32:00.560311 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4de83a2-de44-4618-8956-99d667dc08b9 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:32:00.565528 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:32:00.574164 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4de83a2-de44-4618-8956-99d667dc08b9 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:32:00.631254 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e355f16b-0a06-400d-8c4f-100244868d61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:32:00.631807 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e355f16b-0a06-400d-8c4f-100244868d61 admin admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:32:00.632053 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e355f16b-0a06-400d-8c4f-100244868d61 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:32:00.632282 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e355f16b-0a06-400d-8c4f-100244868d61 admin admin] PATH_INFO: `/v3/users` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:32:00.632936 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e355f16b-0a06-400d-8c4f-100244868d61 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:32:00.635447 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e355f16b-0a06-400d-8c4f-100244868d61 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:32:00.656628 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1034/2070] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Oct 12 02:32:00 2022] POST /identity/v3/users => generated 288 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 02:32:00.660829 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3ee84b-dd2b-45a9-838f-89b98cbe117d admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:32:00.671479 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3ee84b-dd2b-45a9-838f-89b98cbe117d admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:32:00.676077 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a245589-b22f-45fc-9a03-5fd39911b4da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:32:00.676703 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a245589-b22f-45fc-9a03-5fd39911b4da admin admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:32:00.676979 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a245589-b22f-45fc-9a03-5fd39911b4da admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:32:00.677247 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a245589-b22f-45fc-9a03-5fd39911b4da admin admin] PATH_INFO: `/v3/roles` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:32:00.677884 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a245589-b22f-45fc-9a03-5fd39911b4da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:32:00.679470 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a245589-b22f-45fc-9a03-5fd39911b4da admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:32:00.690553 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1037/2071] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Oct 12 02:32:00 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 02:32:00.694513 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e355f16b-0a06-400d-8c4f-100244868d61 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:32:00.705716 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e355f16b-0a06-400d-8c4f-100244868d61 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:32:00.710304 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1970433-c5de-4b4c-a986-a88a7a3d7a55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:32:00.710898 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1970433-c5de-4b4c-a986-a88a7a3d7a55 admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:32:00.711176 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1970433-c5de-4b4c-a986-a88a7a3d7a55 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:32:00.711447 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1970433-c5de-4b4c-a986-a88a7a3d7a55 admin admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:32:00.712090 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1970433-c5de-4b4c-a986-a88a7a3d7a55 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:32:00.714262 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1970433-c5de-4b4c-a986-a88a7a3d7a55 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:32:00.724964 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1035/2072] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Oct 12 02:32:00 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 02:32:00.729286 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a245589-b22f-45fc-9a03-5fd39911b4da admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:32:00.739463 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a245589-b22f-45fc-9a03-5fd39911b4da admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:32:00.745032 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4532d4d4-6f9c-46bc-92e2-2af7464b15a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:32:00.745670 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4532d4d4-6f9c-46bc-92e2-2af7464b15a3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:32:00.745951 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4532d4d4-6f9c-46bc-92e2-2af7464b15a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:32:00.746503 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4532d4d4-6f9c-46bc-92e2-2af7464b15a3 admin admin] PATH_INFO: `/v3/projects/b309923a39404a45bafd95579e014ea7/users/219d81f5e46d4c9e85627e506ce2b2f2/roles/3d75c4d7f1a849b9a771504d1583ab28` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:32:00.762330 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4532d4d4-6f9c-46bc-92e2-2af7464b15a3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b309923a39404a45bafd95579e014ea7, user_id=219d81f5e46d4c9e85627e506ce2b2f2, role_id=3d75c4d7f1a849b9a771504d1583ab28)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:32:00.765207 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4532d4d4-6f9c-46bc-92e2-2af7464b15a3 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:32:00.780617 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1038/2073] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Oct 12 02:32:00 2022] PUT /identity/v3/projects/b309923a39404a45bafd95579e014ea7/users/219d81f5e46d4c9e85627e506ce2b2f2/roles/3d75c4d7f1a849b9a771504d1583ab28 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 02:32:00.790940 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63885296-15dc-4154-9129-f56371d45e6f None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:32:00.791318 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63885296-15dc-4154-9129-f56371d45e6f None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:32:00.791594 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63885296-15dc-4154-9129-f56371d45e6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:32:00.819462 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-63885296-15dc-4154-9129-f56371d45e6f None None] MFA Rules not processed for user `219d81f5e46d4c9e85627e506ce2b2f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:32:00.820649 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-63885296-15dc-4154-9129-f56371d45e6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:32:00.883539 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1036/2074] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 02:32:00 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 02:32:00.894903 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4532d4d4-6f9c-46bc-92e2-2af7464b15a3 admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:32:00.896653 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-4532d4d4-6f9c-46bc-92e2-2af7464b15a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:32:00.953858 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4532d4d4-6f9c-46bc-92e2-2af7464b15a3 admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:32:00.957521 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50e5961-0c57-4790-bf95-e1daa5051a38 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ba688e0c4d44d13898539ee886f95fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'beb6def6fcad45959e56425bb8bff4d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:32:00.958131 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50e5961-0c57-4790-bf95-e1daa5051a38 service cinder] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:32:00.958410 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50e5961-0c57-4790-bf95-e1daa5051a38 service cinder] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:32:00.958685 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50e5961-0c57-4790-bf95-e1daa5051a38 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:32:00.967981 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50e5961-0c57-4790-bf95-e1daa5051a38 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:32:00.969449 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50e5961-0c57-4790-bf95-e1daa5051a38 service cinder] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:32:00.978889 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1039/2075] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 02:32:00 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 02:32:03.433087 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f078ba05-2f71-42c8-a9e5-613e28eeb512 None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:32:03.433617 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f078ba05-2f71-42c8-a9e5-613e28eeb512 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:32:03.433713 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f078ba05-2f71-42c8-a9e5-613e28eeb512 None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:32:03.435229 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1037/2076] 10.222.0.18 () {54 vars in 921 bytes} [Wed Oct 12 02:32:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 02:32:03.442508 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45b7f5f-8734-4b6e-a337-cb40a616c7bf None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:32:03.443144 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45b7f5f-8734-4b6e-a337-cb40a616c7bf None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:32:03.443144 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45b7f5f-8734-4b6e-a337-cb40a616c7bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:32:03.464297 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-e45b7f5f-8734-4b6e-a337-cb40a616c7bf None None] MFA Rules not processed for user `f2fca96c111b45b795fb757f77908ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:32:03.465536 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-e45b7f5f-8734-4b6e-a337-cb40a616c7bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:32:03.537934 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1040/2077] 10.222.0.18 () {58 vars in 1018 bytes} [Wed Oct 12 02:32:03 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 02:32:03.550407 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f078ba05-2f71-42c8-a9e5-613e28eeb512 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:32:03.552184 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-f078ba05-2f71-42c8-a9e5-613e28eeb512 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:32:03.634515 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f078ba05-2f71-42c8-a9e5-613e28eeb512 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:32:03.640445 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abdbad2-8908-4b66-94d2-2b0d797ca94f service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8285a132afeb47558e1b3dcedfd7b4e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'beb6def6fcad45959e56425bb8bff4d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:32:03.641057 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abdbad2-8908-4b66-94d2-2b0d797ca94f service glance] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:32:03.641626 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abdbad2-8908-4b66-94d2-2b0d797ca94f service glance] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:32:03.642084 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abdbad2-8908-4b66-94d2-2b0d797ca94f service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:32:03.659349 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5abdbad2-8908-4b66-94d2-2b0d797ca94f service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:32:03.662197 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5abdbad2-8908-4b66-94d2-2b0d797ca94f service glance] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:32:03.674508 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1038/2078] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 02:32:03 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 02:32:03.754700 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8758754-e49e-48dc-a306-f07aafde3023 None None] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:32:03.755049 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8758754-e49e-48dc-a306-f07aafde3023 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:32:03.755333 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8758754-e49e-48dc-a306-f07aafde3023 None None] PATH_INFO: `/` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:32:03.757104 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1041/2079] 10.222.0.18 () {54 vars in 921 bytes} [Wed Oct 12 02:32:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 12 02:32:03.762061 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850946ee-296b-46b0-88da-98566a82bfda None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:32:03.762354 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850946ee-296b-46b0-88da-98566a82bfda None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:32:03.762654 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850946ee-296b-46b0-88da-98566a82bfda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:32:03.784114 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-850946ee-296b-46b0-88da-98566a82bfda None None] MFA Rules not processed for user `5223b5cab3114e9b9a13c582f8ef8386`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:32:03.785337 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-850946ee-296b-46b0-88da-98566a82bfda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:32:03.794434 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:32:03.848587 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1039/2080] 10.222.0.18 () {58 vars in 1018 bytes} [Wed Oct 12 02:32:03 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 02:32:03.862439 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8758754-e49e-48dc-a306-f07aafde3023 None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:32:03.864455 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-d8758754-e49e-48dc-a306-f07aafde3023 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:32:03.884916 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8758754-e49e-48dc-a306-f07aafde3023 None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:32:03.888031 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cba1ed-ebfd-4612-89e1-4e7ddf9780db service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5223b5cab3114e9b9a13c582f8ef8386', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'beb6def6fcad45959e56425bb8bff4d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:32:03.888682 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cba1ed-ebfd-4612-89e1-4e7ddf9780db service neutron] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:32:03.888965 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cba1ed-ebfd-4612-89e1-4e7ddf9780db service neutron] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:32:03.889240 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cba1ed-ebfd-4612-89e1-4e7ddf9780db service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:32:03.898593 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60cba1ed-ebfd-4612-89e1-4e7ddf9780db service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:32:03.901109 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60cba1ed-ebfd-4612-89e1-4e7ddf9780db service neutron] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:32:03.911496 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1042/2081] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 02:32:03 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 02:32:04.013935 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fed75d-4a8d-4733-801b-2c1558a0fa96 None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:32:04.014668 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fed75d-4a8d-4733-801b-2c1558a0fa96 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:32:04.015156 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fed75d-4a8d-4733-801b-2c1558a0fa96 None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:32:04.017159 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1040/2082] 10.222.0.18 () {54 vars in 921 bytes} [Wed Oct 12 02:32:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 02:32:04.023532 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1b4ad7-d998-4d2e-8d7a-220dab76b554 None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:32:04.025042 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1b4ad7-d998-4d2e-8d7a-220dab76b554 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:32:04.025521 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1b4ad7-d998-4d2e-8d7a-220dab76b554 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:32:04.092747 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-9e1b4ad7-d998-4d2e-8d7a-220dab76b554 None None] MFA Rules not processed for user `f2fca96c111b45b795fb757f77908ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:32:04.092747 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-9e1b4ad7-d998-4d2e-8d7a-220dab76b554 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:32:04.121225 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1043/2083] 10.222.0.18 () {58 vars in 1018 bytes} [Wed Oct 12 02:32:04 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 02:32:04.133132 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fed75d-4a8d-4733-801b-2c1558a0fa96 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:32:04.147856 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fed75d-4a8d-4733-801b-2c1558a0fa96 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:32:04.151796 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a5fe65-d0c0-4056-a255-f9c15bf0439c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5223b5cab3114e9b9a13c582f8ef8386', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'beb6def6fcad45959e56425bb8bff4d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:32:04.152488 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a5fe65-d0c0-4056-a255-f9c15bf0439c service neutron] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:32:04.152951 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a5fe65-d0c0-4056-a255-f9c15bf0439c service neutron] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:32:04.153314 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a5fe65-d0c0-4056-a255-f9c15bf0439c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:32:04.169292 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a5fe65-d0c0-4056-a255-f9c15bf0439c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:32:04.169292 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a5fe65-d0c0-4056-a255-f9c15bf0439c service neutron] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:32:04.191608 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1041/2084] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 02:32:04 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 02:32:05.194714 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b99382-1dac-4f54-9884-ad16f985ccd5 None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:32:05.195218 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b99382-1dac-4f54-9884-ad16f985ccd5 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:32:05.195354 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b99382-1dac-4f54-9884-ad16f985ccd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:32:05.220984 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-f7b99382-1dac-4f54-9884-ad16f985ccd5 None None] MFA Rules not processed for user `583c1dce3dcb4dfb92a8af9d9e5adf9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:32:05.222284 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-f7b99382-1dac-4f54-9884-ad16f985ccd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:32:05.252732 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:32:05.295766 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1044/2085] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 02:32:05 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 02:32:08.032368 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7c5395-c571-45a8-b2a6-ba8cc73b92d0 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:32:08.032919 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7c5395-c571-45a8-b2a6-ba8cc73b92d0 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:32:08.033182 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7c5395-c571-45a8-b2a6-ba8cc73b92d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:32:08.055969 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-3a7c5395-c571-45a8-b2a6-ba8cc73b92d0 None None] MFA Rules not processed for user `8d0e2087e5324071926c3dc3a3cb9b1d`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:32:08.059310 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-3a7c5395-c571-45a8-b2a6-ba8cc73b92d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:32:08.148239 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1042/2086] 10.222.0.18 () {58 vars in 1009 bytes} [Wed Oct 12 02:32:08 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 02:32:08.177725 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b99382-1dac-4f54-9884-ad16f985ccd5 None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:32:08.177725 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-f7b99382-1dac-4f54-9884-ad16f985ccd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:32:08.271465 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b99382-1dac-4f54-9884-ad16f985ccd5 None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:32:08.279210 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821742b3-491a-4785-80eb-0c01f52fcbc7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af9bd50c42cc437dbdd5a431d8adbb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'beb6def6fcad45959e56425bb8bff4d1', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:32:08.280001 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821742b3-491a-4785-80eb-0c01f52fcbc7 service swift] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:32:08.280358 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821742b3-491a-4785-80eb-0c01f52fcbc7 service swift] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:32:08.280731 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821742b3-491a-4785-80eb-0c01f52fcbc7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:32:08.294672 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821742b3-491a-4785-80eb-0c01f52fcbc7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:32:08.297001 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821742b3-491a-4785-80eb-0c01f52fcbc7 service swift] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:32:08.307480 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1045/2087] 10.222.0.18 () {60 vars in 1384 bytes} [Wed Oct 12 02:32:08 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 12 02:32:12.031589 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7c5395-c571-45a8-b2a6-ba8cc73b92d0 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:32:12.105660 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7c5395-c571-45a8-b2a6-ba8cc73b92d0 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:32:12.110668 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ffc6cc-aba3-4c78-b409-2d190f1e5604 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:32:12.111301 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ffc6cc-aba3-4c78-b409-2d190f1e5604 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:32:12.111579 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ffc6cc-aba3-4c78-b409-2d190f1e5604 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:32:12.111852 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ffc6cc-aba3-4c78-b409-2d190f1e5604 admin admin] PATH_INFO: `/v3/users/219d81f5e46d4c9e85627e506ce2b2f2` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:32:12.113000 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ffc6cc-aba3-4c78-b409-2d190f1e5604 admin admin] RBAC: Authorizing `identity:delete_user(user_id=219d81f5e46d4c9e85627e506ce2b2f2)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:32:12.114914 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ffc6cc-aba3-4c78-b409-2d190f1e5604 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:32:12.164399 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-d8ffc6cc-aba3-4c78-b409-2d190f1e5604 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '219d81f5e46d4c9e85627e506ce2b2f2'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:32:12.172377 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-d8ffc6cc-aba3-4c78-b409-2d190f1e5604 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '219d81f5e46d4c9e85627e506ce2b2f2'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:32:12.174717 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:32:12.207444 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-d8ffc6cc-aba3-4c78-b409-2d190f1e5604 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '219d81f5e46d4c9e85627e506ce2b2f2'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:32:12.245419 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-d8ffc6cc-aba3-4c78-b409-2d190f1e5604 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '219d81f5e46d4c9e85627e506ce2b2f2'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:32:12.247328 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-d8ffc6cc-aba3-4c78-b409-2d190f1e5604 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '219d81f5e46d4c9e85627e506ce2b2f2'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:32:12.262387 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1043/2088] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Oct 12 02:32:12 2022] DELETE /identity/v3/users/219d81f5e46d4c9e85627e506ce2b2f2 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 02:32:12.267190 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d50a70-2d77-4e6b-9967-dba0cbd8142e None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:32:12.267750 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d50a70-2d77-4e6b-9967-dba0cbd8142e None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:32:12.267750 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d50a70-2d77-4e6b-9967-dba0cbd8142e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:32:12.288017 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-f3d50a70-2d77-4e6b-9967-dba0cbd8142e None None] MFA Rules not processed for user `a326a5bb7364479382f528a592371656`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:32:12.289404 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-f3d50a70-2d77-4e6b-9967-dba0cbd8142e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:32:12.367628 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1046/2089] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 02:32:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 02:32:12.377582 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ffc6cc-aba3-4c78-b409-2d190f1e5604 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:32:12.379041 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-d8ffc6cc-aba3-4c78-b409-2d190f1e5604 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:32:12.460709 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ffc6cc-aba3-4c78-b409-2d190f1e5604 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:32:12.465209 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3796f04a-af2a-49d4-a099-e6297831ebf2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5223b5cab3114e9b9a13c582f8ef8386', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'beb6def6fcad45959e56425bb8bff4d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:32:12.465829 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3796f04a-af2a-49d4-a099-e6297831ebf2 service neutron] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:32:12.466774 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3796f04a-af2a-49d4-a099-e6297831ebf2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:32:12.467059 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3796f04a-af2a-49d4-a099-e6297831ebf2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:32:12.484009 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3796f04a-af2a-49d4-a099-e6297831ebf2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:32:12.486353 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3796f04a-af2a-49d4-a099-e6297831ebf2 service neutron] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:32:12.501515 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1044/2090] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 02:32:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 02:32:12.908386 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d50a70-2d77-4e6b-9967-dba0cbd8142e None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:32:12.909874 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-f3d50a70-2d77-4e6b-9967-dba0cbd8142e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:32:12.950997 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d50a70-2d77-4e6b-9967-dba0cbd8142e None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:32:12.956319 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fca85a4-40cd-4724-b7bb-3b04d3ceff91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:32:12.957050 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fca85a4-40cd-4724-b7bb-3b04d3ceff91 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:32:12.957440 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fca85a4-40cd-4724-b7bb-3b04d3ceff91 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:32:12.958276 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fca85a4-40cd-4724-b7bb-3b04d3ceff91 admin admin] PATH_INFO: `/v3/projects/b309923a39404a45bafd95579e014ea7` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:32:12.959405 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fca85a4-40cd-4724-b7bb-3b04d3ceff91 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b309923a39404a45bafd95579e014ea7)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:32:12.961710 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fca85a4-40cd-4724-b7bb-3b04d3ceff91 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:32:13.018981 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-9fca85a4-40cd-4724-b7bb-3b04d3ceff91 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b309923a39404a45bafd95579e014ea7', 'request_id': 'req-9fca85a4-40cd-4724-b7bb-3b04d3ceff91'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:32:13.025349 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-9fca85a4-40cd-4724-b7bb-3b04d3ceff91 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b309923a39404a45bafd95579e014ea7', 'request_id': 'req-9fca85a4-40cd-4724-b7bb-3b04d3ceff91'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:32:13.026439 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:32:13.033284 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-9fca85a4-40cd-4724-b7bb-3b04d3ceff91 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b309923a39404a45bafd95579e014ea7', 'request_id': 'req-9fca85a4-40cd-4724-b7bb-3b04d3ceff91'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:32:13.045578 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-9fca85a4-40cd-4724-b7bb-3b04d3ceff91 admin admin] The token cache is being invalidate because project b309923a39404a45bafd95579e014ea7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81361) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 02:32:13.045868 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-9fca85a4-40cd-4724-b7bb-3b04d3ceff91 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:32:13.046491 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-9fca85a4-40cd-4724-b7bb-3b04d3ceff91 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:32:13.047988 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1047/2091] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Oct 12 02:32:12 2022] DELETE /identity/v3/projects/b309923a39404a45bafd95579e014ea7 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 02:32:22.493264 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=36,keystone:DELETE=2 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:32:23.042614 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=4,keystone:INSERT=1,keystone:DELETE=1 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:32:27.038003 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3231c667-058c-4471-b9af-3adad3bd32ab None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:32:27.038467 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3231c667-058c-4471-b9af-3adad3bd32ab None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:32:27.038654 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3231c667-058c-4471-b9af-3adad3bd32ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:32:27.060161 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-3231c667-058c-4471-b9af-3adad3bd32ab None None] MFA Rules not processed for user `8d0e2087e5324071926c3dc3a3cb9b1d`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:32:27.061454 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-3231c667-058c-4471-b9af-3adad3bd32ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:32:27.116562 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1045/2092] 10.222.0.18 () {58 vars in 967 bytes} [Wed Oct 12 02:32:27 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 02:32:27.129721 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fca85a4-40cd-4724-b7bb-3b04d3ceff91 admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:32:27.131128 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-9fca85a4-40cd-4724-b7bb-3b04d3ceff91 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:32:27.200645 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fca85a4-40cd-4724-b7bb-3b04d3ceff91 admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:32:27.205485 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65e70a3-01f0-42c8-96d7-b7a64218df35 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af9bd50c42cc437dbdd5a431d8adbb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'beb6def6fcad45959e56425bb8bff4d1', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:32:27.206078 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65e70a3-01f0-42c8-96d7-b7a64218df35 service swift] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:32:27.206353 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65e70a3-01f0-42c8-96d7-b7a64218df35 service swift] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:32:27.206621 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65e70a3-01f0-42c8-96d7-b7a64218df35 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:32:27.214879 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65e70a3-01f0-42c8-96d7-b7a64218df35 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:32:27.216416 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65e70a3-01f0-42c8-96d7-b7a64218df35 service swift] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:32:27.224272 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1048/2093] 10.222.0.18 () {60 vars in 1384 bytes} [Wed Oct 12 02:32:27 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 12 02:32:37.041664 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fadb50-7e34-40c3-ba1d-49224d972d54 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:32:37.042164 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fadb50-7e34-40c3-ba1d-49224d972d54 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:32:37.042264 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fadb50-7e34-40c3-ba1d-49224d972d54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:32:37.063532 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-23fadb50-7e34-40c3-ba1d-49224d972d54 None None] MFA Rules not processed for user `8d0e2087e5324071926c3dc3a3cb9b1d`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:32:37.065547 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-23fadb50-7e34-40c3-ba1d-49224d972d54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:32:37.074084 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1046/2094] 10.222.0.18 () {58 vars in 1009 bytes} [Wed Oct 12 02:32:37 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 02:32:37.087354 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65e70a3-01f0-42c8-96d7-b7a64218df35 service swift] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:32:37.098818 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65e70a3-01f0-42c8-96d7-b7a64218df35 service swift] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:32:37.104335 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb01e75-bc73-4260-9bcf-0887f0243295 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af9bd50c42cc437dbdd5a431d8adbb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'beb6def6fcad45959e56425bb8bff4d1', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:32:37.105047 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb01e75-bc73-4260-9bcf-0887f0243295 service swift] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:32:37.105390 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb01e75-bc73-4260-9bcf-0887f0243295 service swift] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:32:37.105751 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb01e75-bc73-4260-9bcf-0887f0243295 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:32:37.114759 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb01e75-bc73-4260-9bcf-0887f0243295 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:32:37.116434 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb01e75-bc73-4260-9bcf-0887f0243295 service swift] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:32:37.124972 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1049/2095] 10.222.0.18 () {60 vars in 1384 bytes} [Wed Oct 12 02:32:37 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 12 02:32:47.056796 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=28 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:32:47.121447 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=38 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:32:52.743525 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c55dbb7-f69b-45d5-94be-e041d53476b1 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:32:52.744072 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c55dbb7-f69b-45d5-94be-e041d53476b1 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:32:52.744171 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c55dbb7-f69b-45d5-94be-e041d53476b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:32:52.763947 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-3c55dbb7-f69b-45d5-94be-e041d53476b1 None None] MFA Rules not processed for user `8d0e2087e5324071926c3dc3a3cb9b1d`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:32:52.765158 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-3c55dbb7-f69b-45d5-94be-e041d53476b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:32:52.772063 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1047/2096] 10.222.0.18 () {58 vars in 967 bytes} [Wed Oct 12 02:32:52 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 02:32:52.785576 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb01e75-bc73-4260-9bcf-0887f0243295 service swift] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:32:52.796222 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb01e75-bc73-4260-9bcf-0887f0243295 service swift] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:32:52.801105 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22043cab-3536-400f-829e-7eee77e30fea service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af9bd50c42cc437dbdd5a431d8adbb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'beb6def6fcad45959e56425bb8bff4d1', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:32:52.801687 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22043cab-3536-400f-829e-7eee77e30fea service swift] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:32:52.801966 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22043cab-3536-400f-829e-7eee77e30fea service swift] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:32:52.802234 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22043cab-3536-400f-829e-7eee77e30fea service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:32:52.810581 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22043cab-3536-400f-829e-7eee77e30fea service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:32:52.812135 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22043cab-3536-400f-829e-7eee77e30fea service swift] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:32:52.820337 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1050/2097] 10.222.0.18 () {60 vars in 1384 bytes} [Wed Oct 12 02:32:52 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 12 02:32:54.784955 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c55dbb7-f69b-45d5-94be-e041d53476b1 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:32:54.786465 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-3c55dbb7-f69b-45d5-94be-e041d53476b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:32:54.852420 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c55dbb7-f69b-45d5-94be-e041d53476b1 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:32:54.857587 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53ba2cb-207e-4ec2-8d4f-99cbdddbc7f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:32:54.858213 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53ba2cb-207e-4ec2-8d4f-99cbdddbc7f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:32:54.858486 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53ba2cb-207e-4ec2-8d4f-99cbdddbc7f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:32:54.858754 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53ba2cb-207e-4ec2-8d4f-99cbdddbc7f9 admin admin] PATH_INFO: `/v3/users/583c1dce3dcb4dfb92a8af9d9e5adf9a` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:32:54.859900 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53ba2cb-207e-4ec2-8d4f-99cbdddbc7f9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=583c1dce3dcb4dfb92a8af9d9e5adf9a)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:32:54.861868 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53ba2cb-207e-4ec2-8d4f-99cbdddbc7f9 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:32:54.907815 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-b53ba2cb-207e-4ec2-8d4f-99cbdddbc7f9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '583c1dce3dcb4dfb92a8af9d9e5adf9a'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:32:54.915372 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-b53ba2cb-207e-4ec2-8d4f-99cbdddbc7f9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '583c1dce3dcb4dfb92a8af9d9e5adf9a'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:32:54.927482 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-b53ba2cb-207e-4ec2-8d4f-99cbdddbc7f9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '583c1dce3dcb4dfb92a8af9d9e5adf9a'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:32:54.935022 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-b53ba2cb-207e-4ec2-8d4f-99cbdddbc7f9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '583c1dce3dcb4dfb92a8af9d9e5adf9a'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:32:54.935651 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-b53ba2cb-207e-4ec2-8d4f-99cbdddbc7f9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '583c1dce3dcb4dfb92a8af9d9e5adf9a'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:32:54.941492 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1048/2098] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Oct 12 02:32:54 2022] DELETE /identity/v3/users/583c1dce3dcb4dfb92a8af9d9e5adf9a => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 02:32:55.113124 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22043cab-3536-400f-829e-7eee77e30fea service swift] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:32:55.125499 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22043cab-3536-400f-829e-7eee77e30fea service swift] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:32:55.194126 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db72f418-becc-4cdb-927b-686a3c98a0cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:32:55.194785 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db72f418-becc-4cdb-927b-686a3c98a0cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:32:55.194935 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db72f418-becc-4cdb-927b-686a3c98a0cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:32:55.195205 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db72f418-becc-4cdb-927b-686a3c98a0cb admin admin] PATH_INFO: `/v3/projects/6fc52397af5e43f088b80ace86b9d736` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:32:55.196322 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db72f418-becc-4cdb-927b-686a3c98a0cb admin admin] RBAC: Authorizing `identity:delete_project(project_id=6fc52397af5e43f088b80ace86b9d736)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:32:55.198256 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db72f418-becc-4cdb-927b-686a3c98a0cb admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:32:55.248242 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-db72f418-becc-4cdb-927b-686a3c98a0cb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6fc52397af5e43f088b80ace86b9d736', 'request_id': 'req-db72f418-becc-4cdb-927b-686a3c98a0cb'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:32:55.254148 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-db72f418-becc-4cdb-927b-686a3c98a0cb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6fc52397af5e43f088b80ace86b9d736', 'request_id': 'req-db72f418-becc-4cdb-927b-686a3c98a0cb'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:32:55.262117 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-db72f418-becc-4cdb-927b-686a3c98a0cb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6fc52397af5e43f088b80ace86b9d736', 'request_id': 'req-db72f418-becc-4cdb-927b-686a3c98a0cb'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:32:55.276495 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-db72f418-becc-4cdb-927b-686a3c98a0cb admin admin] The token cache is being invalidate because project 6fc52397af5e43f088b80ace86b9d736 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81361) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 02:32:55.276800 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-db72f418-becc-4cdb-927b-686a3c98a0cb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:32:55.277427 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-db72f418-becc-4cdb-927b-686a3c98a0cb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:32:55.279448 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1051/2099] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Oct 12 02:32:55 2022] DELETE /identity/v3/projects/6fc52397af5e43f088b80ace86b9d736 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 02:32:55.288173 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467ea380-9767-4a88-8227-4e4e0c940168 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:32:55.288547 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467ea380-9767-4a88-8227-4e4e0c940168 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:32:55.288825 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467ea380-9767-4a88-8227-4e4e0c940168 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:32:55.308605 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-467ea380-9767-4a88-8227-4e4e0c940168 None None] MFA Rules not processed for user `a326a5bb7364479382f528a592371656`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:32:55.309757 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-467ea380-9767-4a88-8227-4e4e0c940168 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:32:55.369556 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1049/2100] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 02:32:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 02:32:55.377098 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fa4312-8b14-48a8-a035-5701daf89e94 None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:32:55.377388 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fa4312-8b14-48a8-a035-5701daf89e94 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:32:55.377661 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fa4312-8b14-48a8-a035-5701daf89e94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:32:55.397856 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-41fa4312-8b14-48a8-a035-5701daf89e94 None None] MFA Rules not processed for user `a326a5bb7364479382f528a592371656`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:32:55.399063 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-41fa4312-8b14-48a8-a035-5701daf89e94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:32:55.407156 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1052/2101] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 02:32:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 02:32:55.411504 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467ea380-9767-4a88-8227-4e4e0c940168 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:32:55.422767 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467ea380-9767-4a88-8227-4e4e0c940168 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:32:55.427321 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c64bd39-31da-4807-acf4-d565cf6bb831 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:32:55.427913 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c64bd39-31da-4807-acf4-d565cf6bb831 admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:32:55.428740 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c64bd39-31da-4807-acf4-d565cf6bb831 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:32:55.429095 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c64bd39-31da-4807-acf4-d565cf6bb831 admin admin] PATH_INFO: `/v3/domains` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:32:55.429911 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c64bd39-31da-4807-acf4-d565cf6bb831 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 02:32:55.430233 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c64bd39-31da-4807-acf4-d565cf6bb831 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:32:55.431814 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c64bd39-31da-4807-acf4-d565cf6bb831 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:32:55.440191 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:32:55.444453 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1050/2102] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Oct 12 02:32:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 02:32:55.449061 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fa4312-8b14-48a8-a035-5701daf89e94 None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:32:55.458346 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fa4312-8b14-48a8-a035-5701daf89e94 None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:32:55.463070 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6059f30-0ec0-48a8-a38f-93330b4d849a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:32:55.463653 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6059f30-0ec0-48a8-a38f-93330b4d849a admin admin] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:32:55.463927 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6059f30-0ec0-48a8-a38f-93330b4d849a admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:32:55.464197 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6059f30-0ec0-48a8-a38f-93330b4d849a admin admin] PATH_INFO: `/v3/projects` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:32:55.464861 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6059f30-0ec0-48a8-a38f-93330b4d849a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:32:55.466745 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6059f30-0ec0-48a8-a38f-93330b4d849a admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:32:55.493679 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1053/2103] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Oct 12 02:32:55 2022] POST /identity/v3/projects => generated 391 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 02:32:55.497788 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c64bd39-31da-4807-acf4-d565cf6bb831 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:32:55.508772 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c64bd39-31da-4807-acf4-d565cf6bb831 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:32:55.564409 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed1e73a-a366-4e4c-8712-fc1841dac694 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:32:55.564999 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed1e73a-a366-4e4c-8712-fc1841dac694 admin admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:32:55.565265 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed1e73a-a366-4e4c-8712-fc1841dac694 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:32:55.565606 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed1e73a-a366-4e4c-8712-fc1841dac694 admin admin] PATH_INFO: `/v3/users` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:32:55.566257 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed1e73a-a366-4e4c-8712-fc1841dac694 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:32:55.568187 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed1e73a-a366-4e4c-8712-fc1841dac694 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:32:55.589301 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1051/2104] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Oct 12 02:32:55 2022] POST /identity/v3/users => generated 296 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 02:32:55.593607 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6059f30-0ec0-48a8-a38f-93330b4d849a admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:32:55.604116 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6059f30-0ec0-48a8-a38f-93330b4d849a admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:32:55.609156 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4b3abb-a790-4e5e-b399-e67b68359af7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:32:55.609748 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4b3abb-a790-4e5e-b399-e67b68359af7 admin admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:32:55.610072 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4b3abb-a790-4e5e-b399-e67b68359af7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:32:55.610341 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4b3abb-a790-4e5e-b399-e67b68359af7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:32:55.610975 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4b3abb-a790-4e5e-b399-e67b68359af7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:32:55.612590 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4b3abb-a790-4e5e-b399-e67b68359af7 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:32:55.625678 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1054/2105] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Oct 12 02:32:55 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 12 02:32:55.626858 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed1e73a-a366-4e4c-8712-fc1841dac694 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:32:55.637705 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed1e73a-a366-4e4c-8712-fc1841dac694 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:32:55.642244 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5aad6c0-38dd-4b7d-bb11-456628287a11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:32:55.642869 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5aad6c0-38dd-4b7d-bb11-456628287a11 admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:32:55.643171 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5aad6c0-38dd-4b7d-bb11-456628287a11 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:32:55.643448 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5aad6c0-38dd-4b7d-bb11-456628287a11 admin admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:32:55.644113 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5aad6c0-38dd-4b7d-bb11-456628287a11 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:32:55.645792 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5aad6c0-38dd-4b7d-bb11-456628287a11 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:32:55.656894 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1052/2106] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Oct 12 02:32:55 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 02:32:55.660816 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4b3abb-a790-4e5e-b399-e67b68359af7 admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:32:55.671916 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4b3abb-a790-4e5e-b399-e67b68359af7 admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:32:55.676528 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6952e3a1-51f6-49f9-90d7-3815e8e836ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:32:55.677182 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6952e3a1-51f6-49f9-90d7-3815e8e836ea admin admin] REQUEST_METHOD: `PUT` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:32:55.677465 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6952e3a1-51f6-49f9-90d7-3815e8e836ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:32:55.677740 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6952e3a1-51f6-49f9-90d7-3815e8e836ea admin admin] PATH_INFO: `/v3/projects/d818487c9c0b479e806cc179074542d4/users/a662894f260f4626a6deb5f71265475c/roles/3d75c4d7f1a849b9a771504d1583ab28` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:32:55.695077 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6952e3a1-51f6-49f9-90d7-3815e8e836ea admin admin] RBAC: Authorizing `identity:create_grant(project_id=d818487c9c0b479e806cc179074542d4, user_id=a662894f260f4626a6deb5f71265475c, role_id=3d75c4d7f1a849b9a771504d1583ab28)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:32:55.697824 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6952e3a1-51f6-49f9-90d7-3815e8e836ea admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:32:55.711557 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1055/2107] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Oct 12 02:32:55 2022] PUT /identity/v3/projects/d818487c9c0b479e806cc179074542d4/users/a662894f260f4626a6deb5f71265475c/roles/3d75c4d7f1a849b9a771504d1583ab28 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 02:32:55.722528 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a9406e-0086-4255-b718-182c0f55f7ca None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:32:55.722814 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a9406e-0086-4255-b718-182c0f55f7ca None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:32:55.723085 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a9406e-0086-4255-b718-182c0f55f7ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:32:55.757736 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-95a9406e-0086-4255-b718-182c0f55f7ca None None] MFA Rules not processed for user `a662894f260f4626a6deb5f71265475c`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:32:55.759019 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-95a9406e-0086-4255-b718-182c0f55f7ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:32:55.841662 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1053/2108] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 02:32:55 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 02:32:55.853454 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6952e3a1-51f6-49f9-90d7-3815e8e836ea admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:32:55.855299 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-6952e3a1-51f6-49f9-90d7-3815e8e836ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:32:55.871842 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:32:55.919639 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6952e3a1-51f6-49f9-90d7-3815e8e836ea admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:32:55.923265 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a02c99-a490-41cf-b647-51e142fb30d9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ba688e0c4d44d13898539ee886f95fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'beb6def6fcad45959e56425bb8bff4d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:32:55.923853 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a02c99-a490-41cf-b647-51e142fb30d9 service cinder] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:32:55.924125 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a02c99-a490-41cf-b647-51e142fb30d9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:32:55.924391 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a02c99-a490-41cf-b647-51e142fb30d9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:32:55.933267 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a02c99-a490-41cf-b647-51e142fb30d9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:32:55.934696 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a02c99-a490-41cf-b647-51e142fb30d9 service cinder] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:32:55.944599 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1056/2109] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 02:32:55 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 02:33:05.838446 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=66,keystone:INSERT=3 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:33:05.939691 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=20 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:33:05.997142 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a9406e-0086-4255-b718-182c0f55f7ca None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:33:06.058059 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a9406e-0086-4255-b718-182c0f55f7ca None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:33:06.062450 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee2c2f5-7817-4670-b514-3dbdba7de188 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:33:06.063072 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee2c2f5-7817-4670-b514-3dbdba7de188 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:33:06.063346 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee2c2f5-7817-4670-b514-3dbdba7de188 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:33:06.063615 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee2c2f5-7817-4670-b514-3dbdba7de188 admin admin] PATH_INFO: `/v3/users/a662894f260f4626a6deb5f71265475c` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:33:06.064762 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee2c2f5-7817-4670-b514-3dbdba7de188 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a662894f260f4626a6deb5f71265475c)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:33:06.066653 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee2c2f5-7817-4670-b514-3dbdba7de188 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:33:06.112323 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-eee2c2f5-7817-4670-b514-3dbdba7de188 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a662894f260f4626a6deb5f71265475c'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:33:06.120699 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-eee2c2f5-7817-4670-b514-3dbdba7de188 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a662894f260f4626a6deb5f71265475c'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:33:06.133677 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-eee2c2f5-7817-4670-b514-3dbdba7de188 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a662894f260f4626a6deb5f71265475c'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:33:06.140588 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-eee2c2f5-7817-4670-b514-3dbdba7de188 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a662894f260f4626a6deb5f71265475c'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:33:06.141221 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-eee2c2f5-7817-4670-b514-3dbdba7de188 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a662894f260f4626a6deb5f71265475c'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:33:06.147040 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1054/2110] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Oct 12 02:33:05 2022] DELETE /identity/v3/users/a662894f260f4626a6deb5f71265475c => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 02:33:06.151457 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d06bcf-949c-4ad5-97b9-874bf9a56930 None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:33:06.151743 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d06bcf-949c-4ad5-97b9-874bf9a56930 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:33:06.152014 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d06bcf-949c-4ad5-97b9-874bf9a56930 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:33:06.170387 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-b3d06bcf-949c-4ad5-97b9-874bf9a56930 None None] MFA Rules not processed for user `a326a5bb7364479382f528a592371656`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:33:06.171603 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-b3d06bcf-949c-4ad5-97b9-874bf9a56930 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:33:06.228376 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1057/2111] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 02:33:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 02:33:06.238169 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee2c2f5-7817-4670-b514-3dbdba7de188 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:33:06.239599 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-eee2c2f5-7817-4670-b514-3dbdba7de188 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:33:06.297286 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee2c2f5-7817-4670-b514-3dbdba7de188 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:33:06.300905 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4df7b8-c918-411d-a4f3-b60892c86e2c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5223b5cab3114e9b9a13c582f8ef8386', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'beb6def6fcad45959e56425bb8bff4d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:33:06.301508 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4df7b8-c918-411d-a4f3-b60892c86e2c service neutron] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:33:06.301814 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4df7b8-c918-411d-a4f3-b60892c86e2c service neutron] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:33:06.302089 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4df7b8-c918-411d-a4f3-b60892c86e2c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:33:06.311276 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4df7b8-c918-411d-a4f3-b60892c86e2c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:33:06.312718 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4df7b8-c918-411d-a4f3-b60892c86e2c service neutron] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:33:06.322741 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1055/2112] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 02:33:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 02:33:06.586468 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d06bcf-949c-4ad5-97b9-874bf9a56930 None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:33:06.587917 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-b3d06bcf-949c-4ad5-97b9-874bf9a56930 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:33:06.599570 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d06bcf-949c-4ad5-97b9-874bf9a56930 None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:33:06.604159 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3caee1a-f081-4406-a355-1d9a6c5de35b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:33:06.604810 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3caee1a-f081-4406-a355-1d9a6c5de35b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:33:06.605087 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3caee1a-f081-4406-a355-1d9a6c5de35b admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:33:06.605349 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3caee1a-f081-4406-a355-1d9a6c5de35b admin admin] PATH_INFO: `/v3/projects/d818487c9c0b479e806cc179074542d4` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:33:06.606481 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3caee1a-f081-4406-a355-1d9a6c5de35b admin admin] RBAC: Authorizing `identity:delete_project(project_id=d818487c9c0b479e806cc179074542d4)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:33:06.608662 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3caee1a-f081-4406-a355-1d9a6c5de35b admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:33:06.655371 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-b3caee1a-f081-4406-a355-1d9a6c5de35b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd818487c9c0b479e806cc179074542d4', 'request_id': 'req-b3caee1a-f081-4406-a355-1d9a6c5de35b'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:33:06.661243 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-b3caee1a-f081-4406-a355-1d9a6c5de35b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd818487c9c0b479e806cc179074542d4', 'request_id': 'req-b3caee1a-f081-4406-a355-1d9a6c5de35b'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:33:06.667531 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-b3caee1a-f081-4406-a355-1d9a6c5de35b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd818487c9c0b479e806cc179074542d4', 'request_id': 'req-b3caee1a-f081-4406-a355-1d9a6c5de35b'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:33:06.680393 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-b3caee1a-f081-4406-a355-1d9a6c5de35b admin admin] The token cache is being invalidate because project d818487c9c0b479e806cc179074542d4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81361) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 02:33:06.680714 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-b3caee1a-f081-4406-a355-1d9a6c5de35b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:33:06.681343 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-b3caee1a-f081-4406-a355-1d9a6c5de35b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:33:06.682815 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1058/2113] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Oct 12 02:33:06 2022] DELETE /identity/v3/projects/d818487c9c0b479e806cc179074542d4 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 02:33:15.197752 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4df7b8-c918-411d-a4f3-b60892c86e2c service neutron] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:33:15.199230 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-4d4df7b8-c918-411d-a4f3-b60892c86e2c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:33:15.232037 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:33:15.304917 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4df7b8-c918-411d-a4f3-b60892c86e2c service neutron] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:33:15.368676 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b72adbd-dc5b-4c7b-aed7-ac5cbd2b3c10 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a58b9e0467c040638c3d43e3ac9c0495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'beb6def6fcad45959e56425bb8bff4d1', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:33:15.369296 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b72adbd-dc5b-4c7b-aed7-ac5cbd2b3c10 service placement] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:33:15.369584 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b72adbd-dc5b-4c7b-aed7-ac5cbd2b3c10 service placement] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:33:15.369856 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b72adbd-dc5b-4c7b-aed7-ac5cbd2b3c10 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:33:15.371778 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-0b72adbd-dc5b-4c7b-aed7-ac5cbd2b3c10 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:33:15.384438 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b72adbd-dc5b-4c7b-aed7-ac5cbd2b3c10 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:33:15.386116 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b72adbd-dc5b-4c7b-aed7-ac5cbd2b3c10 service placement] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:33:15.397375 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1056/2114] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 02:33:15 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 02:33:16.677117 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=54,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:33:18.844031 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356548a6-3105-45c8-a471-5cfc22102507 None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:33:18.844646 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356548a6-3105-45c8-a471-5cfc22102507 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:33:18.844646 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356548a6-3105-45c8-a471-5cfc22102507 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:33:18.863675 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-356548a6-3105-45c8-a471-5cfc22102507 None None] MFA Rules not processed for user `e5a8c753a1c54dddaac24b5faaaf197a`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:33:18.864943 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-356548a6-3105-45c8-a471-5cfc22102507 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:33:18.918390 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1059/2115] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 02:33:18 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 02:33:20.865454 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee24e7d7-2c96-405f-b082-5ae02105130a None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:33:20.866003 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee24e7d7-2c96-405f-b082-5ae02105130a None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:33:20.866003 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee24e7d7-2c96-405f-b082-5ae02105130a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:33:20.885854 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-ee24e7d7-2c96-405f-b082-5ae02105130a None None] MFA Rules not processed for user `961c8dd429784f79ae70fe961c9e4dcb`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:33:20.887036 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-ee24e7d7-2c96-405f-b082-5ae02105130a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:33:20.941244 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1057/2116] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 02:33:20 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 02:33:28.911347 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=25 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:33:30.934437 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=73 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:33:33.924835 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499d6c29-a480-439b-912d-4b6d1f279a86 None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:33:33.925383 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499d6c29-a480-439b-912d-4b6d1f279a86 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:33:33.925480 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499d6c29-a480-439b-912d-4b6d1f279a86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:33:33.944656 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-499d6c29-a480-439b-912d-4b6d1f279a86 None None] MFA Rules not processed for user `4f91d4dca41d45ff8b6e96c3594e851b`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:33:33.946332 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-499d6c29-a480-439b-912d-4b6d1f279a86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:33:34.003856 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1060/2117] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 02:33:33 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 02:33:43.997535 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=25 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:33:48.809187 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71b47b8-6403-49a1-a3f8-bd55a4c477f6 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:33:48.809625 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71b47b8-6403-49a1-a3f8-bd55a4c477f6 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:33:48.809771 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71b47b8-6403-49a1-a3f8-bd55a4c477f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:33:48.831007 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-d71b47b8-6403-49a1-a3f8-bd55a4c477f6 None None] MFA Rules not processed for user `8d0e2087e5324071926c3dc3a3cb9b1d`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:33:48.832178 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-d71b47b8-6403-49a1-a3f8-bd55a4c477f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:33:48.895953 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1058/2118] 10.222.0.18 () {58 vars in 967 bytes} [Wed Oct 12 02:33:48 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 02:33:48.919141 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499d6c29-a480-439b-912d-4b6d1f279a86 None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:33:48.920591 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-499d6c29-a480-439b-912d-4b6d1f279a86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:33:48.993334 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499d6c29-a480-439b-912d-4b6d1f279a86 None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:33:48.998721 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca5347f-a811-4f2f-a37e-1fb545e0eded service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af9bd50c42cc437dbdd5a431d8adbb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'beb6def6fcad45959e56425bb8bff4d1', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:33:48.999416 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca5347f-a811-4f2f-a37e-1fb545e0eded service swift] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:33:48.999692 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca5347f-a811-4f2f-a37e-1fb545e0eded service swift] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:33:48.999966 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca5347f-a811-4f2f-a37e-1fb545e0eded service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:33:49.009650 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca5347f-a811-4f2f-a37e-1fb545e0eded service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:33:49.011260 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca5347f-a811-4f2f-a37e-1fb545e0eded service swift] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:33:49.019399 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1061/2119] 10.222.0.18 () {60 vars in 1384 bytes} [Wed Oct 12 02:33:48 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 12 02:33:55.552456 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71b47b8-6403-49a1-a3f8-bd55a4c477f6 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:33:55.554681 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-d71b47b8-6403-49a1-a3f8-bd55a4c477f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:33:55.624079 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71b47b8-6403-49a1-a3f8-bd55a4c477f6 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:33:55.628821 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404aed9b-fc14-4217-bdb5-4e88c1f6610d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:33:55.629462 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404aed9b-fc14-4217-bdb5-4e88c1f6610d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:33:55.629742 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404aed9b-fc14-4217-bdb5-4e88c1f6610d admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:33:55.630017 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404aed9b-fc14-4217-bdb5-4e88c1f6610d admin admin] PATH_INFO: `/v3/users/7a9ab860b4294375bf1bc1758e345644` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:33:55.631184 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404aed9b-fc14-4217-bdb5-4e88c1f6610d admin admin] RBAC: Authorizing `identity:delete_user(user_id=7a9ab860b4294375bf1bc1758e345644)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:33:55.633392 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404aed9b-fc14-4217-bdb5-4e88c1f6610d admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:33:55.683098 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-404aed9b-fc14-4217-bdb5-4e88c1f6610d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7a9ab860b4294375bf1bc1758e345644'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:33:55.690778 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-404aed9b-fc14-4217-bdb5-4e88c1f6610d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7a9ab860b4294375bf1bc1758e345644'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:33:55.704130 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-404aed9b-fc14-4217-bdb5-4e88c1f6610d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7a9ab860b4294375bf1bc1758e345644'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:33:55.711727 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-404aed9b-fc14-4217-bdb5-4e88c1f6610d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7a9ab860b4294375bf1bc1758e345644'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:33:55.712445 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-404aed9b-fc14-4217-bdb5-4e88c1f6610d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7a9ab860b4294375bf1bc1758e345644'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:33:55.718525 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1059/2120] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Oct 12 02:33:55 2022] DELETE /identity/v3/users/7a9ab860b4294375bf1bc1758e345644 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 02:33:55.908115 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca5347f-a811-4f2f-a37e-1fb545e0eded service swift] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:33:55.922957 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca5347f-a811-4f2f-a37e-1fb545e0eded service swift] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:33:55.981094 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d8d197-d4de-4484-aaba-62e59d72e6d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:33:55.981747 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d8d197-d4de-4484-aaba-62e59d72e6d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:33:55.982051 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d8d197-d4de-4484-aaba-62e59d72e6d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:33:55.982320 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d8d197-d4de-4484-aaba-62e59d72e6d7 admin admin] PATH_INFO: `/v3/projects/cdb53abae8714f59829f6d90874d25ea` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:33:55.983417 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d8d197-d4de-4484-aaba-62e59d72e6d7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cdb53abae8714f59829f6d90874d25ea)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:33:55.985379 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d8d197-d4de-4484-aaba-62e59d72e6d7 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:33:56.032131 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-08d8d197-d4de-4484-aaba-62e59d72e6d7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cdb53abae8714f59829f6d90874d25ea', 'request_id': 'req-08d8d197-d4de-4484-aaba-62e59d72e6d7'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:33:56.037462 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-08d8d197-d4de-4484-aaba-62e59d72e6d7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cdb53abae8714f59829f6d90874d25ea', 'request_id': 'req-08d8d197-d4de-4484-aaba-62e59d72e6d7'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:33:56.044445 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-08d8d197-d4de-4484-aaba-62e59d72e6d7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cdb53abae8714f59829f6d90874d25ea', 'request_id': 'req-08d8d197-d4de-4484-aaba-62e59d72e6d7'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:33:56.056861 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-08d8d197-d4de-4484-aaba-62e59d72e6d7 admin admin] The token cache is being invalidate because project cdb53abae8714f59829f6d90874d25ea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81361) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 02:33:56.057150 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-08d8d197-d4de-4484-aaba-62e59d72e6d7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:33:56.057769 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-08d8d197-d4de-4484-aaba-62e59d72e6d7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:33:56.059245 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1062/2121] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Oct 12 02:33:55 2022] DELETE /identity/v3/projects/cdb53abae8714f59829f6d90874d25ea => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 02:33:56.063466 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404aed9b-fc14-4217-bdb5-4e88c1f6610d admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:33:56.064994 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-404aed9b-fc14-4217-bdb5-4e88c1f6610d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:33:56.078576 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404aed9b-fc14-4217-bdb5-4e88c1f6610d admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:33:56.098937 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:33:56.138391 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff481abd-d078-4ae2-a0a2-917d845f6ff9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:33:56.139016 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff481abd-d078-4ae2-a0a2-917d845f6ff9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:33:56.139288 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff481abd-d078-4ae2-a0a2-917d845f6ff9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:33:56.139555 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff481abd-d078-4ae2-a0a2-917d845f6ff9 admin admin] PATH_INFO: `/v3/users/3e1c3acb0e4141278265235d6ffa5b32` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:33:56.140680 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff481abd-d078-4ae2-a0a2-917d845f6ff9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3e1c3acb0e4141278265235d6ffa5b32)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:33:56.142580 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff481abd-d078-4ae2-a0a2-917d845f6ff9 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:33:56.187764 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-ff481abd-d078-4ae2-a0a2-917d845f6ff9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3e1c3acb0e4141278265235d6ffa5b32'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:33:56.194676 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-ff481abd-d078-4ae2-a0a2-917d845f6ff9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3e1c3acb0e4141278265235d6ffa5b32'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:33:56.206404 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-ff481abd-d078-4ae2-a0a2-917d845f6ff9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3e1c3acb0e4141278265235d6ffa5b32'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:33:56.213695 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-ff481abd-d078-4ae2-a0a2-917d845f6ff9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3e1c3acb0e4141278265235d6ffa5b32'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:33:56.214332 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-ff481abd-d078-4ae2-a0a2-917d845f6ff9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3e1c3acb0e4141278265235d6ffa5b32'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:33:56.221187 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1060/2122] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Oct 12 02:33:56 2022] DELETE /identity/v3/users/3e1c3acb0e4141278265235d6ffa5b32 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 02:33:56.392117 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d8d197-d4de-4484-aaba-62e59d72e6d7 admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:33:56.393643 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-08d8d197-d4de-4484-aaba-62e59d72e6d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:33:56.406966 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d8d197-d4de-4484-aaba-62e59d72e6d7 admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:33:56.424641 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:33:56.467779 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81dbbaf-e46e-4bfd-9bb3-331855cd0f8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:33:56.468552 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81dbbaf-e46e-4bfd-9bb3-331855cd0f8a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:33:56.468841 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81dbbaf-e46e-4bfd-9bb3-331855cd0f8a admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:33:56.469113 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81dbbaf-e46e-4bfd-9bb3-331855cd0f8a admin admin] PATH_INFO: `/v3/projects/b755104089d6459984db510b138b37e0` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:33:56.470247 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81dbbaf-e46e-4bfd-9bb3-331855cd0f8a admin admin] RBAC: Authorizing `identity:delete_project(project_id=b755104089d6459984db510b138b37e0)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:33:56.472179 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81dbbaf-e46e-4bfd-9bb3-331855cd0f8a admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:33:56.517831 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-e81dbbaf-e46e-4bfd-9bb3-331855cd0f8a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b755104089d6459984db510b138b37e0', 'request_id': 'req-e81dbbaf-e46e-4bfd-9bb3-331855cd0f8a'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:33:56.523877 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-e81dbbaf-e46e-4bfd-9bb3-331855cd0f8a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b755104089d6459984db510b138b37e0', 'request_id': 'req-e81dbbaf-e46e-4bfd-9bb3-331855cd0f8a'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:33:56.530155 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-e81dbbaf-e46e-4bfd-9bb3-331855cd0f8a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b755104089d6459984db510b138b37e0', 'request_id': 'req-e81dbbaf-e46e-4bfd-9bb3-331855cd0f8a'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:33:56.543352 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-e81dbbaf-e46e-4bfd-9bb3-331855cd0f8a admin admin] The token cache is being invalidate because project b755104089d6459984db510b138b37e0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81361) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 02:33:56.543641 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-e81dbbaf-e46e-4bfd-9bb3-331855cd0f8a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:33:56.544273 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-e81dbbaf-e46e-4bfd-9bb3-331855cd0f8a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:33:56.545808 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1063/2123] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Oct 12 02:33:56 2022] DELETE /identity/v3/projects/b755104089d6459984db510b138b37e0 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 02:34:06.216700 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=42,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:34:06.540067 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=42,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:34:21.852274 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff481abd-d078-4ae2-a0a2-917d845f6ff9 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:34:21.853742 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-ff481abd-d078-4ae2-a0a2-917d845f6ff9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:34:21.868161 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff481abd-d078-4ae2-a0a2-917d845f6ff9 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:34:21.945629 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c8417f-9bc1-4f17-a99c-ea077e3eb540 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:34:21.946396 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c8417f-9bc1-4f17-a99c-ea077e3eb540 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:34:21.946868 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c8417f-9bc1-4f17-a99c-ea077e3eb540 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:34:21.947458 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c8417f-9bc1-4f17-a99c-ea077e3eb540 admin admin] PATH_INFO: `/v3/users/e5a8c753a1c54dddaac24b5faaaf197a` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:34:21.949138 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c8417f-9bc1-4f17-a99c-ea077e3eb540 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e5a8c753a1c54dddaac24b5faaaf197a)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:34:21.951453 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c8417f-9bc1-4f17-a99c-ea077e3eb540 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:34:22.003338 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-d7c8417f-9bc1-4f17-a99c-ea077e3eb540 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e5a8c753a1c54dddaac24b5faaaf197a'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:34:22.011631 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-d7c8417f-9bc1-4f17-a99c-ea077e3eb540 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e5a8c753a1c54dddaac24b5faaaf197a'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:34:22.026828 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-d7c8417f-9bc1-4f17-a99c-ea077e3eb540 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e5a8c753a1c54dddaac24b5faaaf197a'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:34:22.034030 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-d7c8417f-9bc1-4f17-a99c-ea077e3eb540 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e5a8c753a1c54dddaac24b5faaaf197a'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:34:22.034759 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-d7c8417f-9bc1-4f17-a99c-ea077e3eb540 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e5a8c753a1c54dddaac24b5faaaf197a'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:34:22.041541 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1061/2124] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Oct 12 02:34:21 2022] DELETE /identity/v3/users/e5a8c753a1c54dddaac24b5faaaf197a => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 02:34:22.224211 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81dbbaf-e46e-4bfd-9bb3-331855cd0f8a admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:34:22.225719 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-e81dbbaf-e46e-4bfd-9bb3-331855cd0f8a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:34:22.240890 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81dbbaf-e46e-4bfd-9bb3-331855cd0f8a admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:34:22.298036 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff86c883-e893-41e3-bd08-c6073a9d2171 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:34:22.298734 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff86c883-e893-41e3-bd08-c6073a9d2171 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:34:22.299050 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff86c883-e893-41e3-bd08-c6073a9d2171 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:34:22.299343 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff86c883-e893-41e3-bd08-c6073a9d2171 admin admin] PATH_INFO: `/v3/projects/72777ca3c2f04605b9eaf0ae7dbdfb2d` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:34:22.300452 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff86c883-e893-41e3-bd08-c6073a9d2171 admin admin] RBAC: Authorizing `identity:delete_project(project_id=72777ca3c2f04605b9eaf0ae7dbdfb2d)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:34:22.302431 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff86c883-e893-41e3-bd08-c6073a9d2171 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:34:22.348687 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-ff86c883-e893-41e3-bd08-c6073a9d2171 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '72777ca3c2f04605b9eaf0ae7dbdfb2d', 'request_id': 'req-ff86c883-e893-41e3-bd08-c6073a9d2171'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:34:22.355238 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-ff86c883-e893-41e3-bd08-c6073a9d2171 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '72777ca3c2f04605b9eaf0ae7dbdfb2d', 'request_id': 'req-ff86c883-e893-41e3-bd08-c6073a9d2171'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:34:22.361580 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-ff86c883-e893-41e3-bd08-c6073a9d2171 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '72777ca3c2f04605b9eaf0ae7dbdfb2d', 'request_id': 'req-ff86c883-e893-41e3-bd08-c6073a9d2171'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:34:22.374262 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-ff86c883-e893-41e3-bd08-c6073a9d2171 admin admin] The token cache is being invalidate because project 72777ca3c2f04605b9eaf0ae7dbdfb2d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81361) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 02:34:22.374553 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-ff86c883-e893-41e3-bd08-c6073a9d2171 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:34:22.375191 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-ff86c883-e893-41e3-bd08-c6073a9d2171 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:34:22.376778 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1064/2125] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Oct 12 02:34:22 2022] DELETE /identity/v3/projects/72777ca3c2f04605b9eaf0ae7dbdfb2d => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 02:34:22.381975 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b91f8f-61b2-45fd-bcc0-12ae8e3dfd3f None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:34:22.382253 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b91f8f-61b2-45fd-bcc0-12ae8e3dfd3f None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:34:22.382528 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b91f8f-61b2-45fd-bcc0-12ae8e3dfd3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:34:22.402514 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-79b91f8f-61b2-45fd-bcc0-12ae8e3dfd3f None None] MFA Rules not processed for user `a326a5bb7364479382f528a592371656`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:34:22.403725 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-79b91f8f-61b2-45fd-bcc0-12ae8e3dfd3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:34:22.462042 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1062/2126] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 02:34:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 02:34:22.469848 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05742b4b-a75c-42ae-8d02-5614028d2545 None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:34:22.470135 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05742b4b-a75c-42ae-8d02-5614028d2545 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:34:22.470413 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05742b4b-a75c-42ae-8d02-5614028d2545 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:34:22.489910 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-05742b4b-a75c-42ae-8d02-5614028d2545 None None] MFA Rules not processed for user `a326a5bb7364479382f528a592371656`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:34:22.491812 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-05742b4b-a75c-42ae-8d02-5614028d2545 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:34:22.499634 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1065/2127] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 02:34:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 02:34:22.503659 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b91f8f-61b2-45fd-bcc0-12ae8e3dfd3f None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:34:22.513755 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b91f8f-61b2-45fd-bcc0-12ae8e3dfd3f None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:34:22.518341 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3d0070-ea0d-43f8-ab1d-be8b0d82c59c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:34:22.518933 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3d0070-ea0d-43f8-ab1d-be8b0d82c59c admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:34:22.519211 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3d0070-ea0d-43f8-ab1d-be8b0d82c59c admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:34:22.519479 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3d0070-ea0d-43f8-ab1d-be8b0d82c59c admin admin] PATH_INFO: `/v3/domains` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:34:22.520119 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3d0070-ea0d-43f8-ab1d-be8b0d82c59c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 02:34:22.520424 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3d0070-ea0d-43f8-ab1d-be8b0d82c59c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:34:22.522079 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3d0070-ea0d-43f8-ab1d-be8b0d82c59c admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:34:22.533592 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1063/2128] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Oct 12 02:34:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 02:34:22.538007 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05742b4b-a75c-42ae-8d02-5614028d2545 None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:34:22.547108 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05742b4b-a75c-42ae-8d02-5614028d2545 None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:34:22.551814 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7896e370-2f3d-4b56-a76f-be581571b1f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:34:22.552405 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7896e370-2f3d-4b56-a76f-be581571b1f9 admin admin] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:34:22.552711 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7896e370-2f3d-4b56-a76f-be581571b1f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:34:22.553602 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7896e370-2f3d-4b56-a76f-be581571b1f9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:34:22.554298 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7896e370-2f3d-4b56-a76f-be581571b1f9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:34:22.556285 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7896e370-2f3d-4b56-a76f-be581571b1f9 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:34:22.583100 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1066/2129] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Oct 12 02:34:22 2022] POST /identity/v3/projects => generated 375 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 02:34:22.587731 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3d0070-ea0d-43f8-ab1d-be8b0d82c59c admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:34:22.597746 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3d0070-ea0d-43f8-ab1d-be8b0d82c59c admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:34:22.602550 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:34:22.658050 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fca516-504c-48c5-b9de-64889ab75205 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:34:22.658583 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fca516-504c-48c5-b9de-64889ab75205 admin admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:34:22.658863 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fca516-504c-48c5-b9de-64889ab75205 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:34:22.659137 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fca516-504c-48c5-b9de-64889ab75205 admin admin] PATH_INFO: `/v3/users` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:34:22.659763 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19fca516-504c-48c5-b9de-64889ab75205 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:34:22.661704 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19fca516-504c-48c5-b9de-64889ab75205 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:34:22.682920 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1064/2130] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Oct 12 02:34:22 2022] POST /identity/v3/users => generated 288 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 02:34:22.687096 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7896e370-2f3d-4b56-a76f-be581571b1f9 admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:34:22.698197 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7896e370-2f3d-4b56-a76f-be581571b1f9 admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:34:22.703110 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67d2bc2-8985-4f24-b322-81cc231be9a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:34:22.703692 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67d2bc2-8985-4f24-b322-81cc231be9a3 admin admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:34:22.703973 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67d2bc2-8985-4f24-b322-81cc231be9a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:34:22.704246 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67d2bc2-8985-4f24-b322-81cc231be9a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:34:22.704923 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67d2bc2-8985-4f24-b322-81cc231be9a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:34:22.706550 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67d2bc2-8985-4f24-b322-81cc231be9a3 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:34:22.717009 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1067/2131] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Oct 12 02:34:22 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 02:34:22.721084 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fca516-504c-48c5-b9de-64889ab75205 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:34:22.731117 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fca516-504c-48c5-b9de-64889ab75205 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:34:22.735614 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccd6dfb-e01d-4156-ab1b-b84be0d014a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:34:22.736199 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccd6dfb-e01d-4156-ab1b-b84be0d014a9 admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:34:22.736487 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccd6dfb-e01d-4156-ab1b-b84be0d014a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:34:22.736776 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccd6dfb-e01d-4156-ab1b-b84be0d014a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:34:22.737433 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fccd6dfb-e01d-4156-ab1b-b84be0d014a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:34:22.738994 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fccd6dfb-e01d-4156-ab1b-b84be0d014a9 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:34:22.749500 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1065/2132] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Oct 12 02:34:22 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 02:34:22.753602 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67d2bc2-8985-4f24-b322-81cc231be9a3 admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:34:22.764166 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67d2bc2-8985-4f24-b322-81cc231be9a3 admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:34:22.768783 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61de7fb5-c83c-460a-8e57-757d0f86ec15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:34:22.769445 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61de7fb5-c83c-460a-8e57-757d0f86ec15 admin admin] REQUEST_METHOD: `PUT` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:34:22.769718 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61de7fb5-c83c-460a-8e57-757d0f86ec15 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:34:22.769986 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61de7fb5-c83c-460a-8e57-757d0f86ec15 admin admin] PATH_INFO: `/v3/projects/03703c7089e64d58bdd80df690d03c10/users/08d224fedeb349ddb8ecbb682f635d19/roles/3d75c4d7f1a849b9a771504d1583ab28` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:34:22.785017 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61de7fb5-c83c-460a-8e57-757d0f86ec15 admin admin] RBAC: Authorizing `identity:create_grant(project_id=03703c7089e64d58bdd80df690d03c10, user_id=08d224fedeb349ddb8ecbb682f635d19, role_id=3d75c4d7f1a849b9a771504d1583ab28)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:34:22.787811 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61de7fb5-c83c-460a-8e57-757d0f86ec15 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:34:22.800349 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1068/2133] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Oct 12 02:34:22 2022] PUT /identity/v3/projects/03703c7089e64d58bdd80df690d03c10/users/08d224fedeb349ddb8ecbb682f635d19/roles/3d75c4d7f1a849b9a771504d1583ab28 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 02:34:22.812126 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf78d96-acfc-45a1-8ee9-d95a02aa2fc8 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:34:22.812440 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf78d96-acfc-45a1-8ee9-d95a02aa2fc8 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:34:22.812745 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf78d96-acfc-45a1-8ee9-d95a02aa2fc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:34:22.841155 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-cbf78d96-acfc-45a1-8ee9-d95a02aa2fc8 None None] MFA Rules not processed for user `08d224fedeb349ddb8ecbb682f635d19`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:34:22.842359 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-cbf78d96-acfc-45a1-8ee9-d95a02aa2fc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:34:22.905821 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1066/2134] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 02:34:22 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 02:34:22.917233 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61de7fb5-c83c-460a-8e57-757d0f86ec15 admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:34:22.918908 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-61de7fb5-c83c-460a-8e57-757d0f86ec15 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:34:22.949901 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:34:22.993668 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61de7fb5-c83c-460a-8e57-757d0f86ec15 admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:34:22.999121 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4874bc63-b3cd-4dad-b8cb-0bcd72e66ef9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fca96c111b45b795fb757f77908ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'beb6def6fcad45959e56425bb8bff4d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:34:22.999715 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4874bc63-b3cd-4dad-b8cb-0bcd72e66ef9 service nova] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:34:22.999991 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4874bc63-b3cd-4dad-b8cb-0bcd72e66ef9 service nova] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:34:23.000261 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4874bc63-b3cd-4dad-b8cb-0bcd72e66ef9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:34:23.008428 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4874bc63-b3cd-4dad-b8cb-0bcd72e66ef9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:34:23.010025 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4874bc63-b3cd-4dad-b8cb-0bcd72e66ef9 service nova] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:34:23.018711 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1069/2135] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 02:34:22 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 02:34:23.228864 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf78d96-acfc-45a1-8ee9-d95a02aa2fc8 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:34:23.292539 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf78d96-acfc-45a1-8ee9-d95a02aa2fc8 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:34:23.297304 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a2dc34-b5f7-4d9b-9155-99c6e5f4083c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:34:23.297942 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a2dc34-b5f7-4d9b-9155-99c6e5f4083c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:34:23.298218 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a2dc34-b5f7-4d9b-9155-99c6e5f4083c admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:34:23.298514 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a2dc34-b5f7-4d9b-9155-99c6e5f4083c admin admin] PATH_INFO: `/v3/users/08d224fedeb349ddb8ecbb682f635d19` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:34:23.299627 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a2dc34-b5f7-4d9b-9155-99c6e5f4083c admin admin] RBAC: Authorizing `identity:delete_user(user_id=08d224fedeb349ddb8ecbb682f635d19)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:34:23.301566 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a2dc34-b5f7-4d9b-9155-99c6e5f4083c admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:34:23.320961 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:34:23.354496 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-65a2dc34-b5f7-4d9b-9155-99c6e5f4083c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '08d224fedeb349ddb8ecbb682f635d19'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:34:23.362449 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-65a2dc34-b5f7-4d9b-9155-99c6e5f4083c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '08d224fedeb349ddb8ecbb682f635d19'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:34:23.375290 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-65a2dc34-b5f7-4d9b-9155-99c6e5f4083c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '08d224fedeb349ddb8ecbb682f635d19'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:34:23.382549 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-65a2dc34-b5f7-4d9b-9155-99c6e5f4083c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '08d224fedeb349ddb8ecbb682f635d19'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:34:23.383318 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-65a2dc34-b5f7-4d9b-9155-99c6e5f4083c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '08d224fedeb349ddb8ecbb682f635d19'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:34:23.389543 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1067/2136] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Oct 12 02:34:23 2022] DELETE /identity/v3/users/08d224fedeb349ddb8ecbb682f635d19 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 02:34:23.394019 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bbdbbf-26a6-47f5-a2f5-51f8012f3cee None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:34:23.394496 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bbdbbf-26a6-47f5-a2f5-51f8012f3cee None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:34:23.394632 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bbdbbf-26a6-47f5-a2f5-51f8012f3cee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:34:23.414434 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-a2bbdbbf-26a6-47f5-a2f5-51f8012f3cee None None] MFA Rules not processed for user `a326a5bb7364479382f528a592371656`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:34:23.415620 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-a2bbdbbf-26a6-47f5-a2f5-51f8012f3cee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:34:23.474081 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1070/2137] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 02:34:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 02:34:23.484373 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a2dc34-b5f7-4d9b-9155-99c6e5f4083c admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:34:23.485813 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-65a2dc34-b5f7-4d9b-9155-99c6e5f4083c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:34:23.543988 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a2dc34-b5f7-4d9b-9155-99c6e5f4083c admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:34:23.547625 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b6beaa-5b42-4275-b87e-d164497c7589 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5223b5cab3114e9b9a13c582f8ef8386', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'beb6def6fcad45959e56425bb8bff4d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:34:23.548266 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b6beaa-5b42-4275-b87e-d164497c7589 service neutron] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:34:23.548581 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b6beaa-5b42-4275-b87e-d164497c7589 service neutron] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:34:23.549431 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b6beaa-5b42-4275-b87e-d164497c7589 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:34:23.559591 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b6beaa-5b42-4275-b87e-d164497c7589 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:34:23.561054 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b6beaa-5b42-4275-b87e-d164497c7589 service neutron] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:34:23.570625 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1068/2138] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 02:34:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 02:34:23.833110 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bbdbbf-26a6-47f5-a2f5-51f8012f3cee None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:34:23.835065 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-a2bbdbbf-26a6-47f5-a2f5-51f8012f3cee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:34:23.847980 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bbdbbf-26a6-47f5-a2f5-51f8012f3cee None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:34:23.853409 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788d8e00-e823-4658-a585-d7e7e95ae4e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:34:23.854040 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788d8e00-e823-4658-a585-d7e7e95ae4e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:34:23.854317 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788d8e00-e823-4658-a585-d7e7e95ae4e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:34:23.854586 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788d8e00-e823-4658-a585-d7e7e95ae4e8 admin admin] PATH_INFO: `/v3/projects/03703c7089e64d58bdd80df690d03c10` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:34:23.856783 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788d8e00-e823-4658-a585-d7e7e95ae4e8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=03703c7089e64d58bdd80df690d03c10)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:34:23.858692 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788d8e00-e823-4658-a585-d7e7e95ae4e8 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:34:23.905779 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-788d8e00-e823-4658-a585-d7e7e95ae4e8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '03703c7089e64d58bdd80df690d03c10', 'request_id': 'req-788d8e00-e823-4658-a585-d7e7e95ae4e8'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:34:23.911256 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-788d8e00-e823-4658-a585-d7e7e95ae4e8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '03703c7089e64d58bdd80df690d03c10', 'request_id': 'req-788d8e00-e823-4658-a585-d7e7e95ae4e8'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:34:23.918241 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-788d8e00-e823-4658-a585-d7e7e95ae4e8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '03703c7089e64d58bdd80df690d03c10', 'request_id': 'req-788d8e00-e823-4658-a585-d7e7e95ae4e8'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:34:23.930542 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-788d8e00-e823-4658-a585-d7e7e95ae4e8 admin admin] The token cache is being invalidate because project 03703c7089e64d58bdd80df690d03c10 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81361) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 02:34:23.930830 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-788d8e00-e823-4658-a585-d7e7e95ae4e8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:34:23.931442 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-788d8e00-e823-4658-a585-d7e7e95ae4e8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:34:23.933009 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1071/2139] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Oct 12 02:34:23 2022] DELETE /identity/v3/projects/03703c7089e64d58bdd80df690d03c10 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 02:34:23.937905 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766417e8-80cc-4d7c-9048-0f7954d779b1 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:34:23.938402 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766417e8-80cc-4d7c-9048-0f7954d779b1 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:34:23.938529 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766417e8-80cc-4d7c-9048-0f7954d779b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:34:23.958017 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-766417e8-80cc-4d7c-9048-0f7954d779b1 None None] MFA Rules not processed for user `a326a5bb7364479382f528a592371656`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:34:23.959765 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-766417e8-80cc-4d7c-9048-0f7954d779b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:34:24.018866 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1069/2140] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 02:34:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 02:34:24.027635 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee29b2f-23e6-4850-becf-db48d831f16a None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:34:24.027924 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee29b2f-23e6-4850-becf-db48d831f16a None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:34:24.028199 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee29b2f-23e6-4850-becf-db48d831f16a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:34:24.048427 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-2ee29b2f-23e6-4850-becf-db48d831f16a None None] MFA Rules not processed for user `a326a5bb7364479382f528a592371656`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:34:24.049672 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-2ee29b2f-23e6-4850-becf-db48d831f16a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:34:24.057613 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1072/2141] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 02:34:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 02:34:24.061749 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766417e8-80cc-4d7c-9048-0f7954d779b1 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:34:24.071236 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766417e8-80cc-4d7c-9048-0f7954d779b1 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:34:24.075878 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d170ab59-8059-4712-8aa0-c2264137dd8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:34:24.076506 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d170ab59-8059-4712-8aa0-c2264137dd8f admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:34:24.076791 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d170ab59-8059-4712-8aa0-c2264137dd8f admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:34:24.077064 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d170ab59-8059-4712-8aa0-c2264137dd8f admin admin] PATH_INFO: `/v3/domains` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:34:24.077716 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d170ab59-8059-4712-8aa0-c2264137dd8f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 02:34:24.078018 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d170ab59-8059-4712-8aa0-c2264137dd8f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:34:24.079586 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d170ab59-8059-4712-8aa0-c2264137dd8f admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:34:24.092241 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1070/2142] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Oct 12 02:34:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 02:34:24.096649 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee29b2f-23e6-4850-becf-db48d831f16a None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:34:24.106929 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee29b2f-23e6-4850-becf-db48d831f16a None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:34:24.111939 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e361ec-ada8-4268-b294-230dcfc3215d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:34:24.112581 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e361ec-ada8-4268-b294-230dcfc3215d admin admin] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:34:24.112859 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e361ec-ada8-4268-b294-230dcfc3215d admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:34:24.113128 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e361ec-ada8-4268-b294-230dcfc3215d admin admin] PATH_INFO: `/v3/projects` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:34:24.113770 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e361ec-ada8-4268-b294-230dcfc3215d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:34:24.115874 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e361ec-ada8-4268-b294-230dcfc3215d admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:34:24.145807 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1073/2143] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Oct 12 02:34:24 2022] POST /identity/v3/projects => generated 367 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 02:34:24.150883 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d170ab59-8059-4712-8aa0-c2264137dd8f admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:34:24.160637 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d170ab59-8059-4712-8aa0-c2264137dd8f admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:34:24.180768 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:34:24.220177 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9c8b5c-b440-41bf-8348-cdf1e54446d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:34:24.221637 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9c8b5c-b440-41bf-8348-cdf1e54446d2 admin admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:34:24.221978 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9c8b5c-b440-41bf-8348-cdf1e54446d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:34:24.222299 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9c8b5c-b440-41bf-8348-cdf1e54446d2 admin admin] PATH_INFO: `/v3/users` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:34:24.222965 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9c8b5c-b440-41bf-8348-cdf1e54446d2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:34:24.225044 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9c8b5c-b440-41bf-8348-cdf1e54446d2 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:34:24.251957 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1071/2144] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Oct 12 02:34:24 2022] POST /identity/v3/users => generated 284 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 02:34:24.253610 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e361ec-ada8-4268-b294-230dcfc3215d admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:34:24.266292 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e361ec-ada8-4268-b294-230dcfc3215d admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:34:24.271471 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ec302b-aae0-42c2-a753-62736c950a2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:34:24.272233 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ec302b-aae0-42c2-a753-62736c950a2c admin admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:34:24.272535 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ec302b-aae0-42c2-a753-62736c950a2c admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:34:24.272801 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ec302b-aae0-42c2-a753-62736c950a2c admin admin] PATH_INFO: `/v3/roles` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:34:24.273466 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ec302b-aae0-42c2-a753-62736c950a2c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:34:24.275082 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ec302b-aae0-42c2-a753-62736c950a2c admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:34:24.276500 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:34:24.286716 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1074/2145] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Oct 12 02:34:24 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 02:34:24.291468 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9c8b5c-b440-41bf-8348-cdf1e54446d2 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:34:24.303423 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9c8b5c-b440-41bf-8348-cdf1e54446d2 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:34:24.308748 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37566db-0c25-4c62-8e47-208eabbef413 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:34:24.309371 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37566db-0c25-4c62-8e47-208eabbef413 admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:34:24.309631 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37566db-0c25-4c62-8e47-208eabbef413 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:34:24.309900 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37566db-0c25-4c62-8e47-208eabbef413 admin admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:34:24.310539 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37566db-0c25-4c62-8e47-208eabbef413 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:34:24.312179 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37566db-0c25-4c62-8e47-208eabbef413 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:34:24.323617 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1072/2146] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Oct 12 02:34:24 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 02:34:24.327992 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ec302b-aae0-42c2-a753-62736c950a2c admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:34:24.339264 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ec302b-aae0-42c2-a753-62736c950a2c admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:34:24.344281 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3b22cd-67aa-4063-8e8e-7fa60c1205b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:34:24.344989 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3b22cd-67aa-4063-8e8e-7fa60c1205b4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:34:24.345252 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3b22cd-67aa-4063-8e8e-7fa60c1205b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:34:24.345540 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3b22cd-67aa-4063-8e8e-7fa60c1205b4 admin admin] PATH_INFO: `/v3/projects/42f68423b98e48b0b680288e36e90c3a/users/5b07791b734a45819024f9e020154226/roles/3d75c4d7f1a849b9a771504d1583ab28` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:34:24.363678 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3b22cd-67aa-4063-8e8e-7fa60c1205b4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=42f68423b98e48b0b680288e36e90c3a, user_id=5b07791b734a45819024f9e020154226, role_id=3d75c4d7f1a849b9a771504d1583ab28)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:34:24.367789 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3b22cd-67aa-4063-8e8e-7fa60c1205b4 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:34:24.388527 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1075/2147] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Oct 12 02:34:24 2022] PUT /identity/v3/projects/42f68423b98e48b0b680288e36e90c3a/users/5b07791b734a45819024f9e020154226/roles/3d75c4d7f1a849b9a771504d1583ab28 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 02:34:24.393947 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807b702a-7f93-4ff7-9914-63a312ca393b None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:34:24.394326 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807b702a-7f93-4ff7-9914-63a312ca393b None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:34:24.394714 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807b702a-7f93-4ff7-9914-63a312ca393b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:34:24.429704 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-807b702a-7f93-4ff7-9914-63a312ca393b None None] MFA Rules not processed for user `5b07791b734a45819024f9e020154226`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:34:24.430963 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-807b702a-7f93-4ff7-9914-63a312ca393b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:34:24.497386 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1073/2148] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 02:34:24 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 02:34:24.502340 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3b22cd-67aa-4063-8e8e-7fa60c1205b4 admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:34:24.574316 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3b22cd-67aa-4063-8e8e-7fa60c1205b4 admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:34:24.579059 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d3cd6c-245e-454b-a588-aadf017356be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:34:24.579744 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d3cd6c-245e-454b-a588-aadf017356be admin admin] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:34:24.580025 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d3cd6c-245e-454b-a588-aadf017356be admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:34:24.580297 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d3cd6c-245e-454b-a588-aadf017356be admin admin] PATH_INFO: `/v3/projects` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:34:24.581035 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d3cd6c-245e-454b-a588-aadf017356be admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:34:24.582853 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d3cd6c-245e-454b-a588-aadf017356be admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:34:24.610452 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1076/2149] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Oct 12 02:34:24 2022] POST /identity/v3/projects => generated 367 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 02:34:24.614439 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807b702a-7f93-4ff7-9914-63a312ca393b None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:34:24.625163 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807b702a-7f93-4ff7-9914-63a312ca393b None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:34:24.680759 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03375a3-739c-4e29-9924-5556507fe100 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:34:24.681366 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03375a3-739c-4e29-9924-5556507fe100 admin admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:34:24.681644 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03375a3-739c-4e29-9924-5556507fe100 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:34:24.681916 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03375a3-739c-4e29-9924-5556507fe100 admin admin] PATH_INFO: `/v3/users` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:34:24.682549 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03375a3-739c-4e29-9924-5556507fe100 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:34:24.684453 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03375a3-739c-4e29-9924-5556507fe100 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:34:24.705029 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1074/2150] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Oct 12 02:34:24 2022] POST /identity/v3/users => generated 290 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 02:34:24.709779 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d3cd6c-245e-454b-a588-aadf017356be admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:34:24.720258 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d3cd6c-245e-454b-a588-aadf017356be admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:34:24.725778 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5df36d-c487-4b7d-b5cc-4c09c7040231 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:34:24.726369 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5df36d-c487-4b7d-b5cc-4c09c7040231 admin admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:34:24.726650 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5df36d-c487-4b7d-b5cc-4c09c7040231 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:34:24.726920 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5df36d-c487-4b7d-b5cc-4c09c7040231 admin admin] PATH_INFO: `/v3/roles` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:34:24.727559 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5df36d-c487-4b7d-b5cc-4c09c7040231 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:34:24.729209 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5df36d-c487-4b7d-b5cc-4c09c7040231 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:34:24.740309 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1077/2151] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Oct 12 02:34:24 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 02:34:24.744735 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03375a3-739c-4e29-9924-5556507fe100 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:34:24.754999 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03375a3-739c-4e29-9924-5556507fe100 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:34:24.760012 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526fb4a5-90e8-4bd0-8377-237762b044aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:34:24.760716 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526fb4a5-90e8-4bd0-8377-237762b044aa admin admin] REQUEST_METHOD: `PUT` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:34:24.761026 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526fb4a5-90e8-4bd0-8377-237762b044aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:34:24.761304 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526fb4a5-90e8-4bd0-8377-237762b044aa admin admin] PATH_INFO: `/v3/projects/1dba978cbfe544be8c5248c231f1a261/users/27ffb4aa3fa04f21ba545e93f4fd5575/roles/39b1e8108dff402383def3c559f48189` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:34:24.776992 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526fb4a5-90e8-4bd0-8377-237762b044aa admin admin] RBAC: Authorizing `identity:create_grant(project_id=1dba978cbfe544be8c5248c231f1a261, user_id=27ffb4aa3fa04f21ba545e93f4fd5575, role_id=39b1e8108dff402383def3c559f48189)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:34:24.779842 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526fb4a5-90e8-4bd0-8377-237762b044aa admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:34:24.787947 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:34:24.794048 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1075/2152] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Oct 12 02:34:24 2022] PUT /identity/v3/projects/1dba978cbfe544be8c5248c231f1a261/users/27ffb4aa3fa04f21ba545e93f4fd5575/roles/39b1e8108dff402383def3c559f48189 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 02:34:24.797949 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5df36d-c487-4b7d-b5cc-4c09c7040231 admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:34:24.807944 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5df36d-c487-4b7d-b5cc-4c09c7040231 admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:34:24.862761 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6851ea-2bab-4a3a-9f15-124bd067b5cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:34:24.863353 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6851ea-2bab-4a3a-9f15-124bd067b5cc admin admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:34:24.863648 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6851ea-2bab-4a3a-9f15-124bd067b5cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:34:24.863898 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6851ea-2bab-4a3a-9f15-124bd067b5cc admin admin] PATH_INFO: `/v3/roles` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:34:24.864579 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6851ea-2bab-4a3a-9f15-124bd067b5cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:34:24.866245 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6851ea-2bab-4a3a-9f15-124bd067b5cc admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:34:24.875651 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1078/2153] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Oct 12 02:34:24 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 02:34:24.879774 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526fb4a5-90e8-4bd0-8377-237762b044aa admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:34:24.890633 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526fb4a5-90e8-4bd0-8377-237762b044aa admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:34:24.895272 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9faed21-9788-4717-a934-79347de9fc5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:34:24.895948 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9faed21-9788-4717-a934-79347de9fc5b admin admin] REQUEST_METHOD: `PUT` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:34:24.896228 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9faed21-9788-4717-a934-79347de9fc5b admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:34:24.897256 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9faed21-9788-4717-a934-79347de9fc5b admin admin] PATH_INFO: `/v3/projects/1dba978cbfe544be8c5248c231f1a261/users/27ffb4aa3fa04f21ba545e93f4fd5575/roles/39b1e8108dff402383def3c559f48189` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:34:24.899318 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9faed21-9788-4717-a934-79347de9fc5b admin admin] RBAC: Authorizing `identity:create_grant(project_id=1dba978cbfe544be8c5248c231f1a261, user_id=27ffb4aa3fa04f21ba545e93f4fd5575, role_id=39b1e8108dff402383def3c559f48189)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:34:24.902023 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9faed21-9788-4717-a934-79347de9fc5b admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:34:24.912106 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1076/2154] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Oct 12 02:34:24 2022] PUT /identity/v3/projects/1dba978cbfe544be8c5248c231f1a261/users/27ffb4aa3fa04f21ba545e93f4fd5575/roles/39b1e8108dff402383def3c559f48189 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 02:34:24.923572 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c65ae4-79f0-42ff-8cc2-71d16055e177 None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:34:24.923860 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c65ae4-79f0-42ff-8cc2-71d16055e177 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:34:24.924133 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c65ae4-79f0-42ff-8cc2-71d16055e177 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:34:24.952376 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-68c65ae4-79f0-42ff-8cc2-71d16055e177 None None] MFA Rules not processed for user `27ffb4aa3fa04f21ba545e93f4fd5575`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:34:24.953625 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-68c65ae4-79f0-42ff-8cc2-71d16055e177 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:34:24.983443 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:34:25.022508 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1079/2155] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 02:34:24 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 02:34:25.033649 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9faed21-9788-4717-a934-79347de9fc5b admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:34:25.035346 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-a9faed21-9788-4717-a934-79347de9fc5b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:34:25.092088 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9faed21-9788-4717-a934-79347de9fc5b admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:34:25.095697 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5e791d-b25b-419b-baca-2e6f38eb2eb7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ba688e0c4d44d13898539ee886f95fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'beb6def6fcad45959e56425bb8bff4d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:34:25.096285 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5e791d-b25b-419b-baca-2e6f38eb2eb7 service cinder] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:34:25.096586 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5e791d-b25b-419b-baca-2e6f38eb2eb7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:34:25.096855 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5e791d-b25b-419b-baca-2e6f38eb2eb7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:34:25.107514 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5e791d-b25b-419b-baca-2e6f38eb2eb7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:34:25.108963 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5e791d-b25b-419b-baca-2e6f38eb2eb7 service cinder] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:34:25.118339 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1077/2156] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 02:34:25 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 02:34:26.503279 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c65ae4-79f0-42ff-8cc2-71d16055e177 None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:34:26.566746 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c65ae4-79f0-42ff-8cc2-71d16055e177 None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:34:26.571645 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a2fba9-1843-4289-801f-997baeb32cd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:34:26.572261 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a2fba9-1843-4289-801f-997baeb32cd3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:34:26.572567 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a2fba9-1843-4289-801f-997baeb32cd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:34:26.572871 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a2fba9-1843-4289-801f-997baeb32cd3 admin admin] PATH_INFO: `/v3/users/5b07791b734a45819024f9e020154226` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:34:26.574224 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a2fba9-1843-4289-801f-997baeb32cd3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5b07791b734a45819024f9e020154226)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:34:26.576917 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a2fba9-1843-4289-801f-997baeb32cd3 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:34:26.626116 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-c8a2fba9-1843-4289-801f-997baeb32cd3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5b07791b734a45819024f9e020154226'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:34:26.634497 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-c8a2fba9-1843-4289-801f-997baeb32cd3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5b07791b734a45819024f9e020154226'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:34:26.647149 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-c8a2fba9-1843-4289-801f-997baeb32cd3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5b07791b734a45819024f9e020154226'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:34:26.654019 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-c8a2fba9-1843-4289-801f-997baeb32cd3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5b07791b734a45819024f9e020154226'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:34:26.654653 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-c8a2fba9-1843-4289-801f-997baeb32cd3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5b07791b734a45819024f9e020154226'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:34:26.660378 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1080/2157] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Oct 12 02:34:26 2022] DELETE /identity/v3/users/5b07791b734a45819024f9e020154226 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 02:34:26.664936 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a3b10e-c3b6-47f5-9477-c3780144e917 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:34:26.665416 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a3b10e-c3b6-47f5-9477-c3780144e917 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:34:26.665506 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a3b10e-c3b6-47f5-9477-c3780144e917 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:34:26.685291 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-d4a3b10e-c3b6-47f5-9477-c3780144e917 None None] MFA Rules not processed for user `a326a5bb7364479382f528a592371656`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:34:26.686636 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-d4a3b10e-c3b6-47f5-9477-c3780144e917 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:34:26.745766 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1078/2158] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 02:34:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 02:34:26.755466 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a2fba9-1843-4289-801f-997baeb32cd3 admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:34:26.758002 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-c8a2fba9-1843-4289-801f-997baeb32cd3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:34:26.810360 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:34:26.816663 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a2fba9-1843-4289-801f-997baeb32cd3 admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:34:26.821665 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dead7d5-06fd-436e-983b-feaa618b421c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5223b5cab3114e9b9a13c582f8ef8386', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'beb6def6fcad45959e56425bb8bff4d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:34:26.822266 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dead7d5-06fd-436e-983b-feaa618b421c service neutron] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:34:26.822749 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dead7d5-06fd-436e-983b-feaa618b421c service neutron] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:34:26.823015 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dead7d5-06fd-436e-983b-feaa618b421c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:34:26.832265 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dead7d5-06fd-436e-983b-feaa618b421c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:34:26.833729 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dead7d5-06fd-436e-983b-feaa618b421c service neutron] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:34:26.843953 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1081/2159] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 02:34:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 02:34:27.134660 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a3b10e-c3b6-47f5-9477-c3780144e917 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:34:27.136362 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-d4a3b10e-c3b6-47f5-9477-c3780144e917 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:34:27.148261 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a3b10e-c3b6-47f5-9477-c3780144e917 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:34:27.155839 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8681e3fb-edc6-4f8e-830d-f22972254784 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:34:27.157159 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8681e3fb-edc6-4f8e-830d-f22972254784 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:34:27.157600 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8681e3fb-edc6-4f8e-830d-f22972254784 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:34:27.157876 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8681e3fb-edc6-4f8e-830d-f22972254784 admin admin] PATH_INFO: `/v3/projects/42f68423b98e48b0b680288e36e90c3a` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:34:27.159174 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8681e3fb-edc6-4f8e-830d-f22972254784 admin admin] RBAC: Authorizing `identity:delete_project(project_id=42f68423b98e48b0b680288e36e90c3a)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:34:27.160972 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8681e3fb-edc6-4f8e-830d-f22972254784 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:34:27.207653 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-8681e3fb-edc6-4f8e-830d-f22972254784 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '42f68423b98e48b0b680288e36e90c3a', 'request_id': 'req-8681e3fb-edc6-4f8e-830d-f22972254784'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:34:27.213174 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-8681e3fb-edc6-4f8e-830d-f22972254784 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '42f68423b98e48b0b680288e36e90c3a', 'request_id': 'req-8681e3fb-edc6-4f8e-830d-f22972254784'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:34:27.219403 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-8681e3fb-edc6-4f8e-830d-f22972254784 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '42f68423b98e48b0b680288e36e90c3a', 'request_id': 'req-8681e3fb-edc6-4f8e-830d-f22972254784'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:34:27.234858 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-8681e3fb-edc6-4f8e-830d-f22972254784 admin admin] The token cache is being invalidate because project 42f68423b98e48b0b680288e36e90c3a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81362) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 02:34:27.235142 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-8681e3fb-edc6-4f8e-830d-f22972254784 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:34:27.235760 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-8681e3fb-edc6-4f8e-830d-f22972254784 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:34:27.237302 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1079/2160] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Oct 12 02:34:27 2022] DELETE /identity/v3/projects/42f68423b98e48b0b680288e36e90c3a => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 02:34:27.242006 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dead7d5-06fd-436e-983b-feaa618b421c service neutron] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:34:27.251609 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dead7d5-06fd-436e-983b-feaa618b421c service neutron] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:34:27.306852 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e115557-d1d5-41c1-b408-a7bc209ba983 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:34:27.307512 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e115557-d1d5-41c1-b408-a7bc209ba983 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:34:27.307779 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e115557-d1d5-41c1-b408-a7bc209ba983 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:34:27.308054 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e115557-d1d5-41c1-b408-a7bc209ba983 admin admin] PATH_INFO: `/v3/users/27ffb4aa3fa04f21ba545e93f4fd5575` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:34:27.309220 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e115557-d1d5-41c1-b408-a7bc209ba983 admin admin] RBAC: Authorizing `identity:delete_user(user_id=27ffb4aa3fa04f21ba545e93f4fd5575)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:34:27.311184 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e115557-d1d5-41c1-b408-a7bc209ba983 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:34:27.355428 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-0e115557-d1d5-41c1-b408-a7bc209ba983 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '27ffb4aa3fa04f21ba545e93f4fd5575'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:34:27.362311 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-0e115557-d1d5-41c1-b408-a7bc209ba983 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '27ffb4aa3fa04f21ba545e93f4fd5575'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:34:27.376050 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-0e115557-d1d5-41c1-b408-a7bc209ba983 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '27ffb4aa3fa04f21ba545e93f4fd5575'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:34:27.382990 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-0e115557-d1d5-41c1-b408-a7bc209ba983 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '27ffb4aa3fa04f21ba545e93f4fd5575'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:34:27.383667 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-0e115557-d1d5-41c1-b408-a7bc209ba983 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '27ffb4aa3fa04f21ba545e93f4fd5575'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:34:27.389419 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1082/2161] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Oct 12 02:34:27 2022] DELETE /identity/v3/users/27ffb4aa3fa04f21ba545e93f4fd5575 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 02:34:27.650983 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8681e3fb-edc6-4f8e-830d-f22972254784 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:34:27.652400 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-8681e3fb-edc6-4f8e-830d-f22972254784 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:34:27.667215 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8681e3fb-edc6-4f8e-830d-f22972254784 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:34:27.676192 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:34:27.727369 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3ebae2-b6fa-4cc8-bb34-4be214fa903d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:34:27.727996 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3ebae2-b6fa-4cc8-bb34-4be214fa903d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:34:27.728273 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3ebae2-b6fa-4cc8-bb34-4be214fa903d admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:34:27.728577 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3ebae2-b6fa-4cc8-bb34-4be214fa903d admin admin] PATH_INFO: `/v3/projects/1dba978cbfe544be8c5248c231f1a261` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:34:27.729915 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3ebae2-b6fa-4cc8-bb34-4be214fa903d admin admin] RBAC: Authorizing `identity:delete_project(project_id=1dba978cbfe544be8c5248c231f1a261)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:34:27.731845 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3ebae2-b6fa-4cc8-bb34-4be214fa903d admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:34:27.777311 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-6f3ebae2-b6fa-4cc8-bb34-4be214fa903d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1dba978cbfe544be8c5248c231f1a261', 'request_id': 'req-6f3ebae2-b6fa-4cc8-bb34-4be214fa903d'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:34:27.782817 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-6f3ebae2-b6fa-4cc8-bb34-4be214fa903d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1dba978cbfe544be8c5248c231f1a261', 'request_id': 'req-6f3ebae2-b6fa-4cc8-bb34-4be214fa903d'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:34:27.789626 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-6f3ebae2-b6fa-4cc8-bb34-4be214fa903d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1dba978cbfe544be8c5248c231f1a261', 'request_id': 'req-6f3ebae2-b6fa-4cc8-bb34-4be214fa903d'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:34:27.802407 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-6f3ebae2-b6fa-4cc8-bb34-4be214fa903d admin admin] The token cache is being invalidate because project 1dba978cbfe544be8c5248c231f1a261 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81362) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 02:34:27.803061 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-6f3ebae2-b6fa-4cc8-bb34-4be214fa903d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:34:27.803859 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-6f3ebae2-b6fa-4cc8-bb34-4be214fa903d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:34:27.805373 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1080/2162] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Oct 12 02:34:27 2022] DELETE /identity/v3/projects/1dba978cbfe544be8c5248c231f1a261 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 02:34:27.810570 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85be0997-5c23-4a81-8092-451d6b0d411d None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:34:27.811072 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85be0997-5c23-4a81-8092-451d6b0d411d None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:34:27.811168 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85be0997-5c23-4a81-8092-451d6b0d411d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:34:27.831870 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-85be0997-5c23-4a81-8092-451d6b0d411d None None] MFA Rules not processed for user `a326a5bb7364479382f528a592371656`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:34:27.833084 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-85be0997-5c23-4a81-8092-451d6b0d411d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:34:27.890953 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1083/2163] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 02:34:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 02:34:27.899284 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6427771-3e5e-42e8-9cd9-16bf5ffcd35d None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:34:27.899492 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6427771-3e5e-42e8-9cd9-16bf5ffcd35d None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:34:27.899765 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6427771-3e5e-42e8-9cd9-16bf5ffcd35d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:34:27.919528 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-d6427771-3e5e-42e8-9cd9-16bf5ffcd35d None None] MFA Rules not processed for user `a326a5bb7364479382f528a592371656`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:34:27.920760 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-d6427771-3e5e-42e8-9cd9-16bf5ffcd35d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:34:27.928849 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1081/2164] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 02:34:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 02:34:27.932964 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85be0997-5c23-4a81-8092-451d6b0d411d None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:34:27.942386 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85be0997-5c23-4a81-8092-451d6b0d411d None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:34:27.947992 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66544aa9-6f9c-4503-9639-1a1637a83242 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:34:27.948654 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66544aa9-6f9c-4503-9639-1a1637a83242 admin admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:34:27.948921 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66544aa9-6f9c-4503-9639-1a1637a83242 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:34:27.949194 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66544aa9-6f9c-4503-9639-1a1637a83242 admin admin] PATH_INFO: `/v3/domains` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:34:27.949846 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66544aa9-6f9c-4503-9639-1a1637a83242 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 02:34:27.950151 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66544aa9-6f9c-4503-9639-1a1637a83242 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:34:27.951760 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66544aa9-6f9c-4503-9639-1a1637a83242 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:34:27.954529 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:34:27.969750 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1084/2165] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Oct 12 02:34:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 02:34:27.970527 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6427771-3e5e-42e8-9cd9-16bf5ffcd35d None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:34:27.979657 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6427771-3e5e-42e8-9cd9-16bf5ffcd35d None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:34:27.984647 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e1cb5c-3399-45f7-b7be-6c3c9e8fbe6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:34:27.985243 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e1cb5c-3399-45f7-b7be-6c3c9e8fbe6f admin admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:34:27.985519 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e1cb5c-3399-45f7-b7be-6c3c9e8fbe6f admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:34:27.985790 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e1cb5c-3399-45f7-b7be-6c3c9e8fbe6f admin admin] PATH_INFO: `/v3/projects` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:34:27.986473 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e1cb5c-3399-45f7-b7be-6c3c9e8fbe6f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:34:27.988322 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e1cb5c-3399-45f7-b7be-6c3c9e8fbe6f admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:34:28.016775 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1082/2166] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Oct 12 02:34:27 2022] POST /identity/v3/projects => generated 387 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 02:34:28.022004 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66544aa9-6f9c-4503-9639-1a1637a83242 admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:34:28.032360 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66544aa9-6f9c-4503-9639-1a1637a83242 admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:34:28.095377 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22128f2-8e62-46ab-965c-eb740176fede admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:34:28.096111 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22128f2-8e62-46ab-965c-eb740176fede admin admin] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:34:28.096388 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22128f2-8e62-46ab-965c-eb740176fede admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:34:28.096703 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22128f2-8e62-46ab-965c-eb740176fede admin admin] PATH_INFO: `/v3/users` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:34:28.097333 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22128f2-8e62-46ab-965c-eb740176fede admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:34:28.099266 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22128f2-8e62-46ab-965c-eb740176fede admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:34:28.124181 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1085/2167] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Oct 12 02:34:28 2022] POST /identity/v3/users => generated 294 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 02:34:28.128174 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e1cb5c-3399-45f7-b7be-6c3c9e8fbe6f admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:34:28.140624 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e1cb5c-3399-45f7-b7be-6c3c9e8fbe6f admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:34:28.148162 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbb98c4-f2c9-4204-a738-0f0515b70458 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:34:28.148810 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbb98c4-f2c9-4204-a738-0f0515b70458 admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:34:28.149227 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbb98c4-f2c9-4204-a738-0f0515b70458 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:34:28.149560 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbb98c4-f2c9-4204-a738-0f0515b70458 admin admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:34:28.150151 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fbb98c4-f2c9-4204-a738-0f0515b70458 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:34:28.151746 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fbb98c4-f2c9-4204-a738-0f0515b70458 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:34:28.162720 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1083/2168] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Oct 12 02:34:28 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 02:34:28.166736 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22128f2-8e62-46ab-965c-eb740176fede admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:34:28.179232 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22128f2-8e62-46ab-965c-eb740176fede admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:34:28.185623 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f571a9-84a6-4cfa-afb9-3dbaca28005f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:34:28.186313 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f571a9-84a6-4cfa-afb9-3dbaca28005f admin admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:34:28.186659 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f571a9-84a6-4cfa-afb9-3dbaca28005f admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:34:28.187042 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f571a9-84a6-4cfa-afb9-3dbaca28005f admin admin] PATH_INFO: `/v3/roles` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:34:28.187860 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f571a9-84a6-4cfa-afb9-3dbaca28005f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:34:28.189926 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f571a9-84a6-4cfa-afb9-3dbaca28005f admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:34:28.203945 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1086/2169] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Oct 12 02:34:28 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 02:34:28.207907 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbb98c4-f2c9-4204-a738-0f0515b70458 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:34:28.218863 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbb98c4-f2c9-4204-a738-0f0515b70458 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:34:28.227844 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5a3474-a20f-4e7f-881e-88cfda90267a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:34:28.228826 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5a3474-a20f-4e7f-881e-88cfda90267a admin admin] REQUEST_METHOD: `PUT` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:34:28.229191 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5a3474-a20f-4e7f-881e-88cfda90267a admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:34:28.229481 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5a3474-a20f-4e7f-881e-88cfda90267a admin admin] PATH_INFO: `/v3/projects/4e631f5058f648a8ac9c54ae11d7c7f5/users/7df93f623aac4e7bac7fd3e08ef66862/roles/3d75c4d7f1a849b9a771504d1583ab28` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:34:28.248571 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5a3474-a20f-4e7f-881e-88cfda90267a admin admin] RBAC: Authorizing `identity:create_grant(project_id=4e631f5058f648a8ac9c54ae11d7c7f5, user_id=7df93f623aac4e7bac7fd3e08ef66862, role_id=3d75c4d7f1a849b9a771504d1583ab28)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:34:28.251221 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5a3474-a20f-4e7f-881e-88cfda90267a admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:34:28.268515 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1084/2170] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Oct 12 02:34:28 2022] PUT /identity/v3/projects/4e631f5058f648a8ac9c54ae11d7c7f5/users/7df93f623aac4e7bac7fd3e08ef66862/roles/3d75c4d7f1a849b9a771504d1583ab28 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 02:34:28.278125 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c78cf8-5a88-4c09-b0f6-f03370eadc34 None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:34:28.278387 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c78cf8-5a88-4c09-b0f6-f03370eadc34 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:34:28.278660 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c78cf8-5a88-4c09-b0f6-f03370eadc34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:34:28.306716 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-41c78cf8-5a88-4c09-b0f6-f03370eadc34 None None] MFA Rules not processed for user `7df93f623aac4e7bac7fd3e08ef66862`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:34:28.307934 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-41c78cf8-5a88-4c09-b0f6-f03370eadc34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:34:28.376425 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1087/2171] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 02:34:28 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 02:34:28.381979 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5a3474-a20f-4e7f-881e-88cfda90267a admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:34:28.433440 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:34:28.458789 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5a3474-a20f-4e7f-881e-88cfda90267a admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:34:28.463719 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c9e89e-7b53-462d-9116-6f843810f25e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:34:28.464291 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c9e89e-7b53-462d-9116-6f843810f25e admin admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:34:28.464602 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c9e89e-7b53-462d-9116-6f843810f25e admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:34:28.464873 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c9e89e-7b53-462d-9116-6f843810f25e admin admin] PATH_INFO: `/v3/projects` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:34:28.465523 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c9e89e-7b53-462d-9116-6f843810f25e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:34:28.467520 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c9e89e-7b53-462d-9116-6f843810f25e admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:34:28.503419 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1085/2172] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Oct 12 02:34:28 2022] POST /identity/v3/projects => generated 385 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 02:34:28.504723 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c78cf8-5a88-4c09-b0f6-f03370eadc34 None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:34:28.515949 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c78cf8-5a88-4c09-b0f6-f03370eadc34 None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:34:28.575963 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9acd68c-22bc-4a3f-84cd-3894da02c186 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:34:28.576652 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9acd68c-22bc-4a3f-84cd-3894da02c186 admin admin] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:34:28.576934 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9acd68c-22bc-4a3f-84cd-3894da02c186 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:34:28.577206 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9acd68c-22bc-4a3f-84cd-3894da02c186 admin admin] PATH_INFO: `/v3/users` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:34:28.577828 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9acd68c-22bc-4a3f-84cd-3894da02c186 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:34:28.579743 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9acd68c-22bc-4a3f-84cd-3894da02c186 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:34:28.590252 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:34:28.602137 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1088/2173] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Oct 12 02:34:28 2022] POST /identity/v3/users => generated 299 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 02:34:28.606659 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c9e89e-7b53-462d-9116-6f843810f25e admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:34:28.617668 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c9e89e-7b53-462d-9116-6f843810f25e admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:34:28.622295 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3192e945-6aa4-4635-97b8-370628098fa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:34:28.622891 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3192e945-6aa4-4635-97b8-370628098fa6 admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:34:28.623166 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3192e945-6aa4-4635-97b8-370628098fa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:34:28.623434 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3192e945-6aa4-4635-97b8-370628098fa6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:34:28.624094 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3192e945-6aa4-4635-97b8-370628098fa6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:34:28.625697 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3192e945-6aa4-4635-97b8-370628098fa6 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:34:28.636863 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1086/2174] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Oct 12 02:34:28 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 02:34:28.641049 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9acd68c-22bc-4a3f-84cd-3894da02c186 admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:34:28.651705 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9acd68c-22bc-4a3f-84cd-3894da02c186 admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:34:28.656323 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48279759-2789-4eeb-91d0-b57721f4d3cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:34:28.656997 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48279759-2789-4eeb-91d0-b57721f4d3cc admin admin] REQUEST_METHOD: `PUT` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:34:28.657328 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48279759-2789-4eeb-91d0-b57721f4d3cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:34:28.657551 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48279759-2789-4eeb-91d0-b57721f4d3cc admin admin] PATH_INFO: `/v3/projects/fd98d6e6306a4e5dbb0579abfff13003/users/8eba3bd1f0924cefa7c8e17915a5871e/roles/39b1e8108dff402383def3c559f48189` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:34:28.672227 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48279759-2789-4eeb-91d0-b57721f4d3cc admin admin] RBAC: Authorizing `identity:create_grant(project_id=fd98d6e6306a4e5dbb0579abfff13003, user_id=8eba3bd1f0924cefa7c8e17915a5871e, role_id=39b1e8108dff402383def3c559f48189)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:34:28.674935 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48279759-2789-4eeb-91d0-b57721f4d3cc admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:34:28.687914 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1089/2175] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Oct 12 02:34:28 2022] PUT /identity/v3/projects/fd98d6e6306a4e5dbb0579abfff13003/users/8eba3bd1f0924cefa7c8e17915a5871e/roles/39b1e8108dff402383def3c559f48189 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 02:34:28.691844 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3192e945-6aa4-4635-97b8-370628098fa6 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:34:28.702489 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3192e945-6aa4-4635-97b8-370628098fa6 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:34:28.758144 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1a995f-47aa-4d2e-8478-6ef592dacc31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:34:28.758750 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1a995f-47aa-4d2e-8478-6ef592dacc31 admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:34:28.759032 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1a995f-47aa-4d2e-8478-6ef592dacc31 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:34:28.759307 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1a995f-47aa-4d2e-8478-6ef592dacc31 admin admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:34:28.759971 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1a995f-47aa-4d2e-8478-6ef592dacc31 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:34:28.761598 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1a995f-47aa-4d2e-8478-6ef592dacc31 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:34:28.771915 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1087/2176] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Oct 12 02:34:28 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 02:34:28.775958 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48279759-2789-4eeb-91d0-b57721f4d3cc admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:34:28.786121 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48279759-2789-4eeb-91d0-b57721f4d3cc admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:34:28.790827 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bc256c-5c0d-46c8-b8e0-be64a58c3e71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:34:28.791519 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bc256c-5c0d-46c8-b8e0-be64a58c3e71 admin admin] REQUEST_METHOD: `PUT` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:34:28.791769 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bc256c-5c0d-46c8-b8e0-be64a58c3e71 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:34:28.792078 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bc256c-5c0d-46c8-b8e0-be64a58c3e71 admin admin] PATH_INFO: `/v3/projects/fd98d6e6306a4e5dbb0579abfff13003/users/8eba3bd1f0924cefa7c8e17915a5871e/roles/39b1e8108dff402383def3c559f48189` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:34:28.794229 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3bc256c-5c0d-46c8-b8e0-be64a58c3e71 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fd98d6e6306a4e5dbb0579abfff13003, user_id=8eba3bd1f0924cefa7c8e17915a5871e, role_id=39b1e8108dff402383def3c559f48189)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:34:28.796994 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3bc256c-5c0d-46c8-b8e0-be64a58c3e71 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:34:28.807198 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1090/2177] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Oct 12 02:34:28 2022] PUT /identity/v3/projects/fd98d6e6306a4e5dbb0579abfff13003/users/8eba3bd1f0924cefa7c8e17915a5871e/roles/39b1e8108dff402383def3c559f48189 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 02:34:28.817515 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6558cfd3-6e6a-41c9-93cf-6bd03f842ff4 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:34:28.817806 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6558cfd3-6e6a-41c9-93cf-6bd03f842ff4 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:34:28.818605 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6558cfd3-6e6a-41c9-93cf-6bd03f842ff4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:34:28.847289 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-6558cfd3-6e6a-41c9-93cf-6bd03f842ff4 None None] MFA Rules not processed for user `8eba3bd1f0924cefa7c8e17915a5871e`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:34:28.848508 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-6558cfd3-6e6a-41c9-93cf-6bd03f842ff4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:34:28.921759 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1088/2178] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 02:34:28 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 02:34:28.933682 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bc256c-5c0d-46c8-b8e0-be64a58c3e71 admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:34:28.935531 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-a3bc256c-5c0d-46c8-b8e0-be64a58c3e71 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:34:28.992911 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bc256c-5c0d-46c8-b8e0-be64a58c3e71 admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:34:28.996523 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f27d1e5-916b-49ed-a0a2-70027bc605d5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ba688e0c4d44d13898539ee886f95fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'beb6def6fcad45959e56425bb8bff4d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:34:28.997115 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f27d1e5-916b-49ed-a0a2-70027bc605d5 service cinder] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:34:28.997389 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f27d1e5-916b-49ed-a0a2-70027bc605d5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:34:28.997658 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f27d1e5-916b-49ed-a0a2-70027bc605d5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:34:29.007230 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f27d1e5-916b-49ed-a0a2-70027bc605d5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:34:29.008681 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f27d1e5-916b-49ed-a0a2-70027bc605d5 service cinder] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:34:29.017977 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1091/2179] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 02:34:28 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 02:34:29.046025 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6558cfd3-6e6a-41c9-93cf-6bd03f842ff4 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:34:29.080115 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:34:29.111205 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6558cfd3-6e6a-41c9-93cf-6bd03f842ff4 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:34:29.119951 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856ca170-f331-4d8c-8ec0-9e4778e534ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:34:29.120822 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856ca170-f331-4d8c-8ec0-9e4778e534ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:34:29.121085 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856ca170-f331-4d8c-8ec0-9e4778e534ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:34:29.121367 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856ca170-f331-4d8c-8ec0-9e4778e534ff admin admin] PATH_INFO: `/v3/users/7df93f623aac4e7bac7fd3e08ef66862` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:34:29.122855 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856ca170-f331-4d8c-8ec0-9e4778e534ff admin admin] RBAC: Authorizing `identity:delete_user(user_id=7df93f623aac4e7bac7fd3e08ef66862)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:34:29.125157 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856ca170-f331-4d8c-8ec0-9e4778e534ff admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:34:29.178621 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-856ca170-f331-4d8c-8ec0-9e4778e534ff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7df93f623aac4e7bac7fd3e08ef66862'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:34:29.186237 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-856ca170-f331-4d8c-8ec0-9e4778e534ff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7df93f623aac4e7bac7fd3e08ef66862'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:34:29.199627 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-856ca170-f331-4d8c-8ec0-9e4778e534ff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7df93f623aac4e7bac7fd3e08ef66862'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:34:29.207095 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-856ca170-f331-4d8c-8ec0-9e4778e534ff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7df93f623aac4e7bac7fd3e08ef66862'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:34:29.207803 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-856ca170-f331-4d8c-8ec0-9e4778e534ff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7df93f623aac4e7bac7fd3e08ef66862'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:34:29.214776 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1089/2180] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Oct 12 02:34:29 2022] DELETE /identity/v3/users/7df93f623aac4e7bac7fd3e08ef66862 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 02:34:29.219195 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bdb4ad-977d-4e6c-8978-50a4874144e7 None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:34:29.220132 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bdb4ad-977d-4e6c-8978-50a4874144e7 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:34:29.220132 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bdb4ad-977d-4e6c-8978-50a4874144e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:34:29.241886 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-16bdb4ad-977d-4e6c-8978-50a4874144e7 None None] MFA Rules not processed for user `a326a5bb7364479382f528a592371656`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:34:29.243100 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-16bdb4ad-977d-4e6c-8978-50a4874144e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:34:29.312350 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1092/2181] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 02:34:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 02:34:29.323965 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856ca170-f331-4d8c-8ec0-9e4778e534ff admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:34:29.325527 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-856ca170-f331-4d8c-8ec0-9e4778e534ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:34:29.411145 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856ca170-f331-4d8c-8ec0-9e4778e534ff admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:34:29.416398 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e338dd-fb38-46c6-b415-27d3c3ca4488 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5223b5cab3114e9b9a13c582f8ef8386', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'beb6def6fcad45959e56425bb8bff4d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:34:29.417290 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e338dd-fb38-46c6-b415-27d3c3ca4488 service neutron] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:34:29.417616 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e338dd-fb38-46c6-b415-27d3c3ca4488 service neutron] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:34:29.417895 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e338dd-fb38-46c6-b415-27d3c3ca4488 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:34:29.429780 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e338dd-fb38-46c6-b415-27d3c3ca4488 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:34:29.431385 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e338dd-fb38-46c6-b415-27d3c3ca4488 service neutron] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:34:29.445791 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1090/2182] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 02:34:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 12 02:34:29.528079 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba323aa8-db9c-4b81-b21c-742bd931790c None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:34:29.528670 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba323aa8-db9c-4b81-b21c-742bd931790c None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:34:29.529330 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba323aa8-db9c-4b81-b21c-742bd931790c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:34:29.556049 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-ba323aa8-db9c-4b81-b21c-742bd931790c None None] MFA Rules not processed for user `8d0e2087e5324071926c3dc3a3cb9b1d`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:34:29.557369 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-ba323aa8-db9c-4b81-b21c-742bd931790c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:34:29.638404 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1093/2183] 10.222.0.18 () {58 vars in 1009 bytes} [Wed Oct 12 02:34:29 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 02:34:29.652073 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e338dd-fb38-46c6-b415-27d3c3ca4488 service neutron] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:34:29.656754 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-f0e338dd-fb38-46c6-b415-27d3c3ca4488 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:34:29.662067 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba323aa8-db9c-4b81-b21c-742bd931790c None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:34:29.664307 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-ba323aa8-db9c-4b81-b21c-742bd931790c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:34:29.678045 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:34:29.733379 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:34:29.754532 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e338dd-fb38-46c6-b415-27d3c3ca4488 service neutron] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:34:29.761596 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba323aa8-db9c-4b81-b21c-742bd931790c None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:34:29.762036 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457c8048-c911-4b04-bc74-bd04e6e4ddf1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af9bd50c42cc437dbdd5a431d8adbb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'beb6def6fcad45959e56425bb8bff4d1', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:34:29.762730 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457c8048-c911-4b04-bc74-bd04e6e4ddf1 service swift] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:34:29.763080 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457c8048-c911-4b04-bc74-bd04e6e4ddf1 service swift] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:34:29.763430 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457c8048-c911-4b04-bc74-bd04e6e4ddf1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:34:29.765730 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266444fb-ff9b-4716-9476-2368c3b171ca service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ba688e0c4d44d13898539ee886f95fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'beb6def6fcad45959e56425bb8bff4d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:34:29.766382 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266444fb-ff9b-4716-9476-2368c3b171ca service cinder] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:34:29.767065 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266444fb-ff9b-4716-9476-2368c3b171ca service cinder] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:34:29.767306 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266444fb-ff9b-4716-9476-2368c3b171ca service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:34:29.773527 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-266444fb-ff9b-4716-9476-2368c3b171ca service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:34:29.776009 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457c8048-c911-4b04-bc74-bd04e6e4ddf1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:34:29.778372 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457c8048-c911-4b04-bc74-bd04e6e4ddf1 service swift] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:34:29.790110 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1091/2184] 10.222.0.18 () {60 vars in 1384 bytes} [Wed Oct 12 02:34:29 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 12 02:34:29.791155 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457c8048-c911-4b04-bc74-bd04e6e4ddf1 service swift] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:34:29.793067 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-457c8048-c911-4b04-bc74-bd04e6e4ddf1 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:34:29.813270 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457c8048-c911-4b04-bc74-bd04e6e4ddf1 service swift] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:34:29.819926 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e09d9c-b4b3-400a-9931-52d0a5ea70ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:34:29.821174 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e09d9c-b4b3-400a-9931-52d0a5ea70ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:34:29.821174 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e09d9c-b4b3-400a-9931-52d0a5ea70ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:34:29.821487 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e09d9c-b4b3-400a-9931-52d0a5ea70ad admin admin] PATH_INFO: `/v3/projects/4e631f5058f648a8ac9c54ae11d7c7f5` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:34:29.823063 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e09d9c-b4b3-400a-9931-52d0a5ea70ad admin admin] RBAC: Authorizing `identity:delete_project(project_id=4e631f5058f648a8ac9c54ae11d7c7f5)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:34:29.825541 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e09d9c-b4b3-400a-9931-52d0a5ea70ad admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:34:29.910901 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-30e09d9c-b4b3-400a-9931-52d0a5ea70ad admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4e631f5058f648a8ac9c54ae11d7c7f5', 'request_id': 'req-30e09d9c-b4b3-400a-9931-52d0a5ea70ad'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:34:29.919009 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-30e09d9c-b4b3-400a-9931-52d0a5ea70ad admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4e631f5058f648a8ac9c54ae11d7c7f5', 'request_id': 'req-30e09d9c-b4b3-400a-9931-52d0a5ea70ad'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:34:29.919240 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266444fb-ff9b-4716-9476-2368c3b171ca service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:34:29.921198 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266444fb-ff9b-4716-9476-2368c3b171ca service cinder] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:34:29.927034 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-30e09d9c-b4b3-400a-9931-52d0a5ea70ad admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4e631f5058f648a8ac9c54ae11d7c7f5', 'request_id': 'req-30e09d9c-b4b3-400a-9931-52d0a5ea70ad'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:34:29.939749 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1094/2185] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 02:34:29 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 278 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 12 02:34:29.944386 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-30e09d9c-b4b3-400a-9931-52d0a5ea70ad admin admin] The token cache is being invalidate because project 4e631f5058f648a8ac9c54ae11d7c7f5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81362) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 02:34:29.944976 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-30e09d9c-b4b3-400a-9931-52d0a5ea70ad admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:34:29.945853 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-30e09d9c-b4b3-400a-9931-52d0a5ea70ad admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:34:29.948719 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1092/2186] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Oct 12 02:34:29 2022] DELETE /identity/v3/projects/4e631f5058f648a8ac9c54ae11d7c7f5 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 02:34:29.952552 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266444fb-ff9b-4716-9476-2368c3b171ca service cinder] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:34:29.965759 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266444fb-ff9b-4716-9476-2368c3b171ca service cinder] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:34:30.043800 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15deee9-0b67-4adb-b786-26a59a0ffd51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:34:30.044656 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15deee9-0b67-4adb-b786-26a59a0ffd51 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:34:30.045006 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15deee9-0b67-4adb-b786-26a59a0ffd51 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:34:30.045350 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15deee9-0b67-4adb-b786-26a59a0ffd51 admin admin] PATH_INFO: `/v3/users/8eba3bd1f0924cefa7c8e17915a5871e` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:34:30.046583 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15deee9-0b67-4adb-b786-26a59a0ffd51 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8eba3bd1f0924cefa7c8e17915a5871e)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:34:30.048624 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15deee9-0b67-4adb-b786-26a59a0ffd51 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:34:30.110941 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-f15deee9-0b67-4adb-b786-26a59a0ffd51 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8eba3bd1f0924cefa7c8e17915a5871e'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:34:30.113210 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:34:30.124858 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-f15deee9-0b67-4adb-b786-26a59a0ffd51 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8eba3bd1f0924cefa7c8e17915a5871e'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:34:30.153765 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-f15deee9-0b67-4adb-b786-26a59a0ffd51 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8eba3bd1f0924cefa7c8e17915a5871e'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:34:30.161421 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-f15deee9-0b67-4adb-b786-26a59a0ffd51 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8eba3bd1f0924cefa7c8e17915a5871e'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:34:30.162223 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-f15deee9-0b67-4adb-b786-26a59a0ffd51 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8eba3bd1f0924cefa7c8e17915a5871e'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:34:30.171300 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1095/2187] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Oct 12 02:34:29 2022] DELETE /identity/v3/users/8eba3bd1f0924cefa7c8e17915a5871e => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 02:34:30.569683 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e09d9c-b4b3-400a-9931-52d0a5ea70ad admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:34:30.571727 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-30e09d9c-b4b3-400a-9931-52d0a5ea70ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:34:30.596511 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e09d9c-b4b3-400a-9931-52d0a5ea70ad admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:34:30.696356 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c00ae4-fedb-42d8-8be9-f8024f5a8ef4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:34:30.697730 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c00ae4-fedb-42d8-8be9-f8024f5a8ef4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:34:30.698074 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c00ae4-fedb-42d8-8be9-f8024f5a8ef4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:34:30.698498 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c00ae4-fedb-42d8-8be9-f8024f5a8ef4 admin admin] PATH_INFO: `/v3/projects/fd98d6e6306a4e5dbb0579abfff13003` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:34:30.704131 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c00ae4-fedb-42d8-8be9-f8024f5a8ef4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fd98d6e6306a4e5dbb0579abfff13003)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:34:30.706508 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c00ae4-fedb-42d8-8be9-f8024f5a8ef4 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:34:30.784717 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-16c00ae4-fedb-42d8-8be9-f8024f5a8ef4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fd98d6e6306a4e5dbb0579abfff13003', 'request_id': 'req-16c00ae4-fedb-42d8-8be9-f8024f5a8ef4'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:34:30.794696 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-16c00ae4-fedb-42d8-8be9-f8024f5a8ef4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fd98d6e6306a4e5dbb0579abfff13003', 'request_id': 'req-16c00ae4-fedb-42d8-8be9-f8024f5a8ef4'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:34:30.801763 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-16c00ae4-fedb-42d8-8be9-f8024f5a8ef4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fd98d6e6306a4e5dbb0579abfff13003', 'request_id': 'req-16c00ae4-fedb-42d8-8be9-f8024f5a8ef4'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:34:30.813142 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:34:30.824005 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-16c00ae4-fedb-42d8-8be9-f8024f5a8ef4 admin admin] The token cache is being invalidate because project fd98d6e6306a4e5dbb0579abfff13003 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81362) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 02:34:30.825078 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-16c00ae4-fedb-42d8-8be9-f8024f5a8ef4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:34:30.827057 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-16c00ae4-fedb-42d8-8be9-f8024f5a8ef4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:34:30.829697 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1093/2188] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Oct 12 02:34:30 2022] DELETE /identity/v3/projects/fd98d6e6306a4e5dbb0579abfff13003 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 02:34:30.837147 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dd7baf-99de-47e7-9e88-8ce76abf877a None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:34:30.837495 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dd7baf-99de-47e7-9e88-8ce76abf877a None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:34:30.837815 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dd7baf-99de-47e7-9e88-8ce76abf877a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:34:30.862598 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-71dd7baf-99de-47e7-9e88-8ce76abf877a None None] MFA Rules not processed for user `a326a5bb7364479382f528a592371656`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:34:30.863894 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-71dd7baf-99de-47e7-9e88-8ce76abf877a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:34:30.940841 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1096/2189] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 02:34:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 02:34:30.946288 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a35907a-7cb6-417b-a2f6-8e6d6e7f2d6c None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:34:30.946669 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a35907a-7cb6-417b-a2f6-8e6d6e7f2d6c None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:34:30.947059 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a35907a-7cb6-417b-a2f6-8e6d6e7f2d6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:34:30.970762 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-8a35907a-7cb6-417b-a2f6-8e6d6e7f2d6c None None] MFA Rules not processed for user `a326a5bb7364479382f528a592371656`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:34:30.972094 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-8a35907a-7cb6-417b-a2f6-8e6d6e7f2d6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:34:30.980954 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1094/2190] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 02:34:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 02:34:30.985747 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71dd7baf-99de-47e7-9e88-8ce76abf877a None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:34:30.996587 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71dd7baf-99de-47e7-9e88-8ce76abf877a None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:34:31.001257 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec077c6a-8bdf-4296-af72-0a9251f02297 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:34:31.001961 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec077c6a-8bdf-4296-af72-0a9251f02297 admin admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:34:31.002329 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec077c6a-8bdf-4296-af72-0a9251f02297 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:34:31.002659 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec077c6a-8bdf-4296-af72-0a9251f02297 admin admin] PATH_INFO: `/v3/domains` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:34:31.003418 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec077c6a-8bdf-4296-af72-0a9251f02297 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 02:34:31.003778 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec077c6a-8bdf-4296-af72-0a9251f02297 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:34:31.007160 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec077c6a-8bdf-4296-af72-0a9251f02297 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:34:31.019384 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1097/2191] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Oct 12 02:34:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 02:34:31.024578 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a35907a-7cb6-417b-a2f6-8e6d6e7f2d6c None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:34:31.036880 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a35907a-7cb6-417b-a2f6-8e6d6e7f2d6c None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:34:31.042046 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320e9cd8-08d9-432b-8891-9a4ce31ed913 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:34:31.042843 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320e9cd8-08d9-432b-8891-9a4ce31ed913 admin admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:34:31.043310 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320e9cd8-08d9-432b-8891-9a4ce31ed913 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:34:31.043750 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320e9cd8-08d9-432b-8891-9a4ce31ed913 admin admin] PATH_INFO: `/v3/projects` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:34:31.044555 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320e9cd8-08d9-432b-8891-9a4ce31ed913 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:34:31.049127 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320e9cd8-08d9-432b-8891-9a4ce31ed913 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:34:31.104224 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1095/2192] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Oct 12 02:34:31 2022] POST /identity/v3/projects => generated 377 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 02:34:31.105466 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec077c6a-8bdf-4296-af72-0a9251f02297 admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:34:31.120065 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec077c6a-8bdf-4296-af72-0a9251f02297 admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:34:31.187207 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea12ee4f-dcf6-45ad-a15e-11f2b8ec5b53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:34:31.188021 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea12ee4f-dcf6-45ad-a15e-11f2b8ec5b53 admin admin] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:34:31.188371 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea12ee4f-dcf6-45ad-a15e-11f2b8ec5b53 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:34:31.188678 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea12ee4f-dcf6-45ad-a15e-11f2b8ec5b53 admin admin] PATH_INFO: `/v3/users` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:34:31.189354 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea12ee4f-dcf6-45ad-a15e-11f2b8ec5b53 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:34:31.191277 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea12ee4f-dcf6-45ad-a15e-11f2b8ec5b53 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:34:31.217930 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1098/2193] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Oct 12 02:34:31 2022] POST /identity/v3/users => generated 289 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 02:34:31.222139 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320e9cd8-08d9-432b-8891-9a4ce31ed913 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:34:31.239016 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320e9cd8-08d9-432b-8891-9a4ce31ed913 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:34:31.244930 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18238cec-9bad-48e0-815e-19f6c3a110fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:34:31.245795 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18238cec-9bad-48e0-815e-19f6c3a110fa admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:34:31.246271 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18238cec-9bad-48e0-815e-19f6c3a110fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:34:31.246752 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18238cec-9bad-48e0-815e-19f6c3a110fa admin admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:34:31.247908 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18238cec-9bad-48e0-815e-19f6c3a110fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:34:31.250968 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18238cec-9bad-48e0-815e-19f6c3a110fa admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:34:31.267076 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1096/2194] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Oct 12 02:34:31 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 02:34:31.267829 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea12ee4f-dcf6-45ad-a15e-11f2b8ec5b53 admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:34:31.278544 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea12ee4f-dcf6-45ad-a15e-11f2b8ec5b53 admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:34:31.284916 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1646794f-7448-49bb-93ac-bb5560d7ab35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:34:31.285529 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1646794f-7448-49bb-93ac-bb5560d7ab35 admin admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:34:31.285831 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1646794f-7448-49bb-93ac-bb5560d7ab35 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:34:31.286249 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1646794f-7448-49bb-93ac-bb5560d7ab35 admin admin] PATH_INFO: `/v3/roles` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:34:31.286951 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1646794f-7448-49bb-93ac-bb5560d7ab35 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:34:31.288626 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1646794f-7448-49bb-93ac-bb5560d7ab35 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:34:31.301042 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1099/2195] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Oct 12 02:34:31 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 12 02:34:31.306868 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18238cec-9bad-48e0-815e-19f6c3a110fa admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:34:31.319476 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18238cec-9bad-48e0-815e-19f6c3a110fa admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:34:31.326858 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f50cbe0-06a6-4894-bdcd-abf9316f5aef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:34:31.327675 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f50cbe0-06a6-4894-bdcd-abf9316f5aef admin admin] REQUEST_METHOD: `PUT` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:34:31.328122 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f50cbe0-06a6-4894-bdcd-abf9316f5aef admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:34:31.328528 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f50cbe0-06a6-4894-bdcd-abf9316f5aef admin admin] PATH_INFO: `/v3/projects/a2d132c31ed64750bc53e2d05e8598d4/users/f9e80525e2fd4060987a7145dad25966/roles/3d75c4d7f1a849b9a771504d1583ab28` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:34:31.351514 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f50cbe0-06a6-4894-bdcd-abf9316f5aef admin admin] RBAC: Authorizing `identity:create_grant(project_id=a2d132c31ed64750bc53e2d05e8598d4, user_id=f9e80525e2fd4060987a7145dad25966, role_id=3d75c4d7f1a849b9a771504d1583ab28)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:34:31.354840 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f50cbe0-06a6-4894-bdcd-abf9316f5aef admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:34:31.395089 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1097/2196] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Oct 12 02:34:31 2022] PUT /identity/v3/projects/a2d132c31ed64750bc53e2d05e8598d4/users/f9e80525e2fd4060987a7145dad25966/roles/3d75c4d7f1a849b9a771504d1583ab28 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 02:34:31.407894 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6637ec-f89a-4d09-9383-5fc4959b6802 None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:34:31.408364 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6637ec-f89a-4d09-9383-5fc4959b6802 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:34:31.408851 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6637ec-f89a-4d09-9383-5fc4959b6802 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:34:31.450693 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-db6637ec-f89a-4d09-9383-5fc4959b6802 None None] MFA Rules not processed for user `f9e80525e2fd4060987a7145dad25966`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:34:31.454247 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-db6637ec-f89a-4d09-9383-5fc4959b6802 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:34:31.481070 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:INSERT=4,keystone:DELETE=3,keystone:SELECT=93 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:34:31.544147 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1100/2197] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 02:34:31 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 02:34:31.548510 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f50cbe0-06a6-4894-bdcd-abf9316f5aef admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:34:31.640121 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f50cbe0-06a6-4894-bdcd-abf9316f5aef admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:34:31.645890 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0052cec-5799-4c55-b246-c997205aa1d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:34:31.646501 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0052cec-5799-4c55-b246-c997205aa1d8 admin admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:34:31.650876 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0052cec-5799-4c55-b246-c997205aa1d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:34:31.650876 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0052cec-5799-4c55-b246-c997205aa1d8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:34:31.650876 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0052cec-5799-4c55-b246-c997205aa1d8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:34:31.650876 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0052cec-5799-4c55-b246-c997205aa1d8 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:34:31.682062 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1098/2198] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Oct 12 02:34:31 2022] POST /identity/v3/projects => generated 379 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 02:34:31.685823 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6637ec-f89a-4d09-9383-5fc4959b6802 None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:34:31.701424 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6637ec-f89a-4d09-9383-5fc4959b6802 None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:34:31.807144 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cd234d-d23d-4b58-9e81-862fac1367d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:34:31.808557 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cd234d-d23d-4b58-9e81-862fac1367d6 admin admin] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:34:31.809097 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cd234d-d23d-4b58-9e81-862fac1367d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:34:31.809479 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cd234d-d23d-4b58-9e81-862fac1367d6 admin admin] PATH_INFO: `/v3/users` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:34:31.810121 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96cd234d-d23d-4b58-9e81-862fac1367d6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:34:31.812810 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96cd234d-d23d-4b58-9e81-862fac1367d6 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:34:31.846793 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1101/2199] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Oct 12 02:34:31 2022] POST /identity/v3/users => generated 296 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 02:34:31.847497 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0052cec-5799-4c55-b246-c997205aa1d8 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:34:31.862025 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cd234d-d23d-4b58-9e81-862fac1367d6 admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:34:31.864239 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-96cd234d-d23d-4b58-9e81-862fac1367d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:34:31.864527 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0052cec-5799-4c55-b246-c997205aa1d8 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:34:31.872382 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4d50c3-b702-40e5-9ee4-fefc5adccb7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:34:31.873044 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4d50c3-b702-40e5-9ee4-fefc5adccb7e admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:34:31.873330 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4d50c3-b702-40e5-9ee4-fefc5adccb7e admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:34:31.873608 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4d50c3-b702-40e5-9ee4-fefc5adccb7e admin admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:34:31.874266 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4d50c3-b702-40e5-9ee4-fefc5adccb7e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:34:31.875946 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4d50c3-b702-40e5-9ee4-fefc5adccb7e admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:34:31.892861 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1099/2200] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Oct 12 02:34:31 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 12 02:34:31.896296 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4d50c3-b702-40e5-9ee4-fefc5adccb7e admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:34:31.906934 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4d50c3-b702-40e5-9ee4-fefc5adccb7e admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:34:31.914494 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c772bda-aa20-4dcc-9393-caebe9a9a9d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:34:31.915270 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c772bda-aa20-4dcc-9393-caebe9a9a9d7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:34:31.915656 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c772bda-aa20-4dcc-9393-caebe9a9a9d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:34:31.916000 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c772bda-aa20-4dcc-9393-caebe9a9a9d7 admin admin] PATH_INFO: `/v3/projects/641942d138534566b219f2302cb5739b/users/200aaa2be58543ff8d216bce784bf759/roles/39b1e8108dff402383def3c559f48189` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:34:31.938583 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c772bda-aa20-4dcc-9393-caebe9a9a9d7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=641942d138534566b219f2302cb5739b, user_id=200aaa2be58543ff8d216bce784bf759, role_id=39b1e8108dff402383def3c559f48189)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:34:31.942388 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c772bda-aa20-4dcc-9393-caebe9a9a9d7 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:34:31.958719 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cd234d-d23d-4b58-9e81-862fac1367d6 admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:34:31.967358 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1100/2201] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Oct 12 02:34:31 2022] PUT /identity/v3/projects/641942d138534566b219f2302cb5739b/users/200aaa2be58543ff8d216bce784bf759/roles/39b1e8108dff402383def3c559f48189 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 02:34:31.971360 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c772bda-aa20-4dcc-9393-caebe9a9a9d7 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:34:32.027534 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e19575-02e9-4333-a26f-8e82d340d0f0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5223b5cab3114e9b9a13c582f8ef8386', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'beb6def6fcad45959e56425bb8bff4d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:34:32.028277 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:34:32.028455 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e19575-02e9-4333-a26f-8e82d340d0f0 service neutron] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:34:32.028779 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e19575-02e9-4333-a26f-8e82d340d0f0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:34:32.029048 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e19575-02e9-4333-a26f-8e82d340d0f0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:34:32.031212 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-32e19575-02e9-4333-a26f-8e82d340d0f0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:34:32.054736 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c772bda-aa20-4dcc-9393-caebe9a9a9d7 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:34:32.060042 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:34:32.061025 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bed47cd-3391-467b-ae6a-27d2efcbf1dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:34:32.061465 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bed47cd-3391-467b-ae6a-27d2efcbf1dc admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:34:32.061789 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bed47cd-3391-467b-ae6a-27d2efcbf1dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:34:32.062002 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bed47cd-3391-467b-ae6a-27d2efcbf1dc admin admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:34:32.062685 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bed47cd-3391-467b-ae6a-27d2efcbf1dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:34:32.070007 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bed47cd-3391-467b-ae6a-27d2efcbf1dc admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:34:32.082139 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1101/2202] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Oct 12 02:34:31 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 02:34:32.086057 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bed47cd-3391-467b-ae6a-27d2efcbf1dc admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:34:32.101091 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bed47cd-3391-467b-ae6a-27d2efcbf1dc admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:34:32.107982 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a49498-c748-4877-8f7d-71165333906a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:34:32.108688 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a49498-c748-4877-8f7d-71165333906a admin admin] REQUEST_METHOD: `PUT` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:34:32.108977 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a49498-c748-4877-8f7d-71165333906a admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:34:32.109252 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a49498-c748-4877-8f7d-71165333906a admin admin] PATH_INFO: `/v3/projects/641942d138534566b219f2302cb5739b/users/200aaa2be58543ff8d216bce784bf759/roles/39b1e8108dff402383def3c559f48189` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:34:32.111269 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a49498-c748-4877-8f7d-71165333906a admin admin] RBAC: Authorizing `identity:create_grant(project_id=641942d138534566b219f2302cb5739b, user_id=200aaa2be58543ff8d216bce784bf759, role_id=39b1e8108dff402383def3c559f48189)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:34:32.116529 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a49498-c748-4877-8f7d-71165333906a admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:34:32.128695 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1102/2203] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Oct 12 02:34:32 2022] PUT /identity/v3/projects/641942d138534566b219f2302cb5739b/users/200aaa2be58543ff8d216bce784bf759/roles/39b1e8108dff402383def3c559f48189 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 02:34:32.137587 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e19575-02e9-4333-a26f-8e82d340d0f0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:34:32.139105 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e19575-02e9-4333-a26f-8e82d340d0f0 service neutron] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:34:32.139588 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fff787-5dae-49d5-9d01-86008b27981a None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:34:32.140031 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fff787-5dae-49d5-9d01-86008b27981a None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:34:32.140458 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fff787-5dae-49d5-9d01-86008b27981a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:34:32.157214 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1102/2204] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 02:34:31 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 02:34:32.180067 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-11fff787-5dae-49d5-9d01-86008b27981a None None] MFA Rules not processed for user `200aaa2be58543ff8d216bce784bf759`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:34:32.181610 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-11fff787-5dae-49d5-9d01-86008b27981a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:34:32.308193 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1103/2205] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 02:34:32 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 02:34:32.320369 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e19575-02e9-4333-a26f-8e82d340d0f0 service neutron] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:34:32.322164 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-32e19575-02e9-4333-a26f-8e82d340d0f0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:34:32.394408 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e19575-02e9-4333-a26f-8e82d340d0f0 service neutron] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:34:32.450360 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310c78e1-f700-426e-9f4e-4c1fa8950053 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ba688e0c4d44d13898539ee886f95fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'beb6def6fcad45959e56425bb8bff4d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:34:32.450962 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310c78e1-f700-426e-9f4e-4c1fa8950053 service cinder] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:34:32.451237 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310c78e1-f700-426e-9f4e-4c1fa8950053 service cinder] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:34:32.451502 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310c78e1-f700-426e-9f4e-4c1fa8950053 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:34:32.519784 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310c78e1-f700-426e-9f4e-4c1fa8950053 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:34:32.521982 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310c78e1-f700-426e-9f4e-4c1fa8950053 service cinder] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:34:32.552620 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1103/2206] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 02:34:32 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 02:34:34.071688 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fff787-5dae-49d5-9d01-86008b27981a None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:34:34.083702 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fff787-5dae-49d5-9d01-86008b27981a None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:34:34.088755 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61bae84-2be9-4be7-8405-eb01a1f3681e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ba688e0c4d44d13898539ee886f95fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'beb6def6fcad45959e56425bb8bff4d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:34:34.089393 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61bae84-2be9-4be7-8405-eb01a1f3681e service cinder] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:34:34.089695 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61bae84-2be9-4be7-8405-eb01a1f3681e service cinder] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:34:34.089968 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61bae84-2be9-4be7-8405-eb01a1f3681e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:34:34.099707 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61bae84-2be9-4be7-8405-eb01a1f3681e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:34:34.101332 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61bae84-2be9-4be7-8405-eb01a1f3681e service cinder] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:34:34.118139 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1104/2207] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 02:34:34 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 02:34:38.257255 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310c78e1-f700-426e-9f4e-4c1fa8950053 service cinder] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:34:38.285919 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:34:38.319474 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61bae84-2be9-4be7-8405-eb01a1f3681e service cinder] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:34:38.321205 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-b61bae84-2be9-4be7-8405-eb01a1f3681e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:34:38.351636 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310c78e1-f700-426e-9f4e-4c1fa8950053 service cinder] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:34:38.359527 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42237fc-7d60-4c5a-bcc5-5f4c08d5961a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:34:38.360302 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42237fc-7d60-4c5a-bcc5-5f4c08d5961a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:34:38.360611 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42237fc-7d60-4c5a-bcc5-5f4c08d5961a admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:34:38.360887 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42237fc-7d60-4c5a-bcc5-5f4c08d5961a admin admin] PATH_INFO: `/v3/users/f9e80525e2fd4060987a7145dad25966` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:34:38.362022 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42237fc-7d60-4c5a-bcc5-5f4c08d5961a admin admin] RBAC: Authorizing `identity:delete_user(user_id=f9e80525e2fd4060987a7145dad25966)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:34:38.364274 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42237fc-7d60-4c5a-bcc5-5f4c08d5961a admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:34:38.427629 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-b42237fc-7d60-4c5a-bcc5-5f4c08d5961a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f9e80525e2fd4060987a7145dad25966'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:34:38.438078 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61bae84-2be9-4be7-8405-eb01a1f3681e service cinder] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:34:38.439986 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-b42237fc-7d60-4c5a-bcc5-5f4c08d5961a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f9e80525e2fd4060987a7145dad25966'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:34:38.446535 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bf48ad-b4b3-44de-9750-12b7941d97e5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fca96c111b45b795fb757f77908ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'beb6def6fcad45959e56425bb8bff4d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:34:38.447291 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bf48ad-b4b3-44de-9750-12b7941d97e5 service nova] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:34:38.447723 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bf48ad-b4b3-44de-9750-12b7941d97e5 service nova] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:34:38.448135 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bf48ad-b4b3-44de-9750-12b7941d97e5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:34:38.450046 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-60bf48ad-b4b3-44de-9750-12b7941d97e5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:34:38.467452 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-b42237fc-7d60-4c5a-bcc5-5f4c08d5961a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f9e80525e2fd4060987a7145dad25966'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:34:38.490570 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-b42237fc-7d60-4c5a-bcc5-5f4c08d5961a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f9e80525e2fd4060987a7145dad25966'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:34:38.491365 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-b42237fc-7d60-4c5a-bcc5-5f4c08d5961a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f9e80525e2fd4060987a7145dad25966'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:34:38.495914 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:34:38.506436 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1104/2208] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Oct 12 02:34:38 2022] DELETE /identity/v3/users/f9e80525e2fd4060987a7145dad25966 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 02:34:38.508943 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02141bf7-4cdf-4db8-b508-14f294481200 None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:34:38.509398 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02141bf7-4cdf-4db8-b508-14f294481200 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:34:38.513154 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02141bf7-4cdf-4db8-b508-14f294481200 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:34:38.545886 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60bf48ad-b4b3-44de-9750-12b7941d97e5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:34:38.547501 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60bf48ad-b4b3-44de-9750-12b7941d97e5 service nova] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:34:38.552823 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-02141bf7-4cdf-4db8-b508-14f294481200 None None] MFA Rules not processed for user `a326a5bb7364479382f528a592371656`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:34:38.555404 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-02141bf7-4cdf-4db8-b508-14f294481200 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:34:38.562284 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1105/2209] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 02:34:38 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 243 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 12 02:34:38.663114 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1105/2210] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 02:34:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 02:34:38.680793 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bf48ad-b4b3-44de-9750-12b7941d97e5 service nova] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:34:38.780752 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bf48ad-b4b3-44de-9750-12b7941d97e5 service nova] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:34:38.868882 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e71e15-b879-4faa-8c62-f0fa1d86c74c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5223b5cab3114e9b9a13c582f8ef8386', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'beb6def6fcad45959e56425bb8bff4d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:34:38.870062 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e71e15-b879-4faa-8c62-f0fa1d86c74c service neutron] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:34:38.871317 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e71e15-b879-4faa-8c62-f0fa1d86c74c service neutron] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:34:38.872061 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e71e15-b879-4faa-8c62-f0fa1d86c74c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:34:38.883051 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e71e15-b879-4faa-8c62-f0fa1d86c74c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:34:38.884627 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e71e15-b879-4faa-8c62-f0fa1d86c74c service neutron] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:34:38.900410 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1106/2211] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 02:34:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 02:34:39.298299 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02141bf7-4cdf-4db8-b508-14f294481200 None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:34:39.300456 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-02141bf7-4cdf-4db8-b508-14f294481200 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:34:39.324737 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02141bf7-4cdf-4db8-b508-14f294481200 None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:34:39.330749 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4784cb7-f8b6-48e3-ac4f-5362ed8ceb65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:34:39.331911 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4784cb7-f8b6-48e3-ac4f-5362ed8ceb65 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:34:39.331911 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4784cb7-f8b6-48e3-ac4f-5362ed8ceb65 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:34:39.332070 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4784cb7-f8b6-48e3-ac4f-5362ed8ceb65 admin admin] PATH_INFO: `/v3/projects/a2d132c31ed64750bc53e2d05e8598d4` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:34:39.334697 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4784cb7-f8b6-48e3-ac4f-5362ed8ceb65 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a2d132c31ed64750bc53e2d05e8598d4)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:34:39.336794 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4784cb7-f8b6-48e3-ac4f-5362ed8ceb65 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:34:39.396318 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:34:39.419076 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-e4784cb7-f8b6-48e3-ac4f-5362ed8ceb65 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a2d132c31ed64750bc53e2d05e8598d4', 'request_id': 'req-e4784cb7-f8b6-48e3-ac4f-5362ed8ceb65'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:34:39.426624 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-e4784cb7-f8b6-48e3-ac4f-5362ed8ceb65 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a2d132c31ed64750bc53e2d05e8598d4', 'request_id': 'req-e4784cb7-f8b6-48e3-ac4f-5362ed8ceb65'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:34:39.437161 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-e4784cb7-f8b6-48e3-ac4f-5362ed8ceb65 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a2d132c31ed64750bc53e2d05e8598d4', 'request_id': 'req-e4784cb7-f8b6-48e3-ac4f-5362ed8ceb65'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:34:39.460263 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-e4784cb7-f8b6-48e3-ac4f-5362ed8ceb65 admin admin] The token cache is being invalidate because project a2d132c31ed64750bc53e2d05e8598d4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81361) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 02:34:39.460639 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-e4784cb7-f8b6-48e3-ac4f-5362ed8ceb65 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:34:39.461560 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-e4784cb7-f8b6-48e3-ac4f-5362ed8ceb65 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:34:39.463872 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1106/2212] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Oct 12 02:34:39 2022] DELETE /identity/v3/projects/a2d132c31ed64750bc53e2d05e8598d4 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 02:34:39.467726 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e71e15-b879-4faa-8c62-f0fa1d86c74c service neutron] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:34:39.482346 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e71e15-b879-4faa-8c62-f0fa1d86c74c service neutron] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:34:39.572305 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951af85e-982f-4839-970a-0973f96ce88b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:34:39.572790 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951af85e-982f-4839-970a-0973f96ce88b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:34:39.573299 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951af85e-982f-4839-970a-0973f96ce88b admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:34:39.573814 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951af85e-982f-4839-970a-0973f96ce88b admin admin] PATH_INFO: `/v3/users/200aaa2be58543ff8d216bce784bf759` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:34:39.575205 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951af85e-982f-4839-970a-0973f96ce88b admin admin] RBAC: Authorizing `identity:delete_user(user_id=200aaa2be58543ff8d216bce784bf759)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:34:39.577307 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951af85e-982f-4839-970a-0973f96ce88b admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:34:39.638868 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:34:39.654723 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-951af85e-982f-4839-970a-0973f96ce88b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '200aaa2be58543ff8d216bce784bf759'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:34:39.666152 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-951af85e-982f-4839-970a-0973f96ce88b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '200aaa2be58543ff8d216bce784bf759'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:34:39.690696 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-951af85e-982f-4839-970a-0973f96ce88b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '200aaa2be58543ff8d216bce784bf759'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:34:39.701042 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-951af85e-982f-4839-970a-0973f96ce88b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '200aaa2be58543ff8d216bce784bf759'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:34:39.701796 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-951af85e-982f-4839-970a-0973f96ce88b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '200aaa2be58543ff8d216bce784bf759'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:34:39.711726 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1107/2213] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Oct 12 02:34:39 2022] DELETE /identity/v3/users/200aaa2be58543ff8d216bce784bf759 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 02:34:40.350873 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4784cb7-f8b6-48e3-ac4f-5362ed8ceb65 admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:34:40.353076 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-e4784cb7-f8b6-48e3-ac4f-5362ed8ceb65 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:34:40.387082 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4784cb7-f8b6-48e3-ac4f-5362ed8ceb65 admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:34:40.499367 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40eca61b-b76c-459c-a9ce-761b7acdb752 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:34:40.499959 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40eca61b-b76c-459c-a9ce-761b7acdb752 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:34:40.500235 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40eca61b-b76c-459c-a9ce-761b7acdb752 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:34:40.500529 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40eca61b-b76c-459c-a9ce-761b7acdb752 admin admin] PATH_INFO: `/v3/projects/641942d138534566b219f2302cb5739b` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:34:40.501688 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40eca61b-b76c-459c-a9ce-761b7acdb752 admin admin] RBAC: Authorizing `identity:delete_project(project_id=641942d138534566b219f2302cb5739b)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:34:40.504392 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40eca61b-b76c-459c-a9ce-761b7acdb752 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:34:40.567562 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-40eca61b-b76c-459c-a9ce-761b7acdb752 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '641942d138534566b219f2302cb5739b', 'request_id': 'req-40eca61b-b76c-459c-a9ce-761b7acdb752'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:34:40.573159 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-40eca61b-b76c-459c-a9ce-761b7acdb752 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '641942d138534566b219f2302cb5739b', 'request_id': 'req-40eca61b-b76c-459c-a9ce-761b7acdb752'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:34:40.579623 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-40eca61b-b76c-459c-a9ce-761b7acdb752 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '641942d138534566b219f2302cb5739b', 'request_id': 'req-40eca61b-b76c-459c-a9ce-761b7acdb752'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:34:40.593578 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-40eca61b-b76c-459c-a9ce-761b7acdb752 admin admin] The token cache is being invalidate because project 641942d138534566b219f2302cb5739b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81361) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 02:34:40.593868 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-40eca61b-b76c-459c-a9ce-761b7acdb752 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:34:40.594521 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-40eca61b-b76c-459c-a9ce-761b7acdb752 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:34:40.596099 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1107/2214] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Oct 12 02:34:40 2022] DELETE /identity/v3/projects/641942d138534566b219f2302cb5739b => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 02:34:40.601961 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f08e6a-0cde-4fb4-bed1-511ee41f5da4 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:34:40.602459 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f08e6a-0cde-4fb4-bed1-511ee41f5da4 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:34:40.602579 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f08e6a-0cde-4fb4-bed1-511ee41f5da4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:34:40.622218 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-92f08e6a-0cde-4fb4-bed1-511ee41f5da4 None None] MFA Rules not processed for user `a326a5bb7364479382f528a592371656`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:34:40.623432 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-92f08e6a-0cde-4fb4-bed1-511ee41f5da4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:34:40.685095 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1108/2215] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 02:34:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 02:34:40.693487 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c5ebf1-3a5d-490d-9e2a-d48244a14347 None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:34:40.693839 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c5ebf1-3a5d-490d-9e2a-d48244a14347 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:34:40.694115 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c5ebf1-3a5d-490d-9e2a-d48244a14347 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:34:40.714264 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-40c5ebf1-3a5d-490d-9e2a-d48244a14347 None None] MFA Rules not processed for user `a326a5bb7364479382f528a592371656`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:34:40.715483 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-40c5ebf1-3a5d-490d-9e2a-d48244a14347 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:34:40.723425 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1108/2216] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 02:34:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 02:34:40.727477 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f08e6a-0cde-4fb4-bed1-511ee41f5da4 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:34:40.737152 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f08e6a-0cde-4fb4-bed1-511ee41f5da4 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:34:40.741768 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c67458d-7d55-47a7-8360-d6676b8cc8d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:34:40.742364 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c67458d-7d55-47a7-8360-d6676b8cc8d0 admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:34:40.742639 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c67458d-7d55-47a7-8360-d6676b8cc8d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:34:40.742903 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c67458d-7d55-47a7-8360-d6676b8cc8d0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:34:40.743544 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c67458d-7d55-47a7-8360-d6676b8cc8d0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 02:34:40.743837 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c67458d-7d55-47a7-8360-d6676b8cc8d0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:34:40.745443 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c67458d-7d55-47a7-8360-d6676b8cc8d0 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:34:40.758482 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1109/2217] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Oct 12 02:34:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 02:34:40.762453 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c5ebf1-3a5d-490d-9e2a-d48244a14347 None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:34:40.772260 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c5ebf1-3a5d-490d-9e2a-d48244a14347 None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:34:40.777029 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4793bf23-2327-4b89-a76c-fa5a8c8970bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:34:40.777623 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4793bf23-2327-4b89-a76c-fa5a8c8970bc admin admin] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:34:40.777896 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4793bf23-2327-4b89-a76c-fa5a8c8970bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:34:40.778163 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4793bf23-2327-4b89-a76c-fa5a8c8970bc admin admin] PATH_INFO: `/v3/projects` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:34:40.778785 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4793bf23-2327-4b89-a76c-fa5a8c8970bc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:34:40.780715 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4793bf23-2327-4b89-a76c-fa5a8c8970bc admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:34:40.811953 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1109/2218] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Oct 12 02:34:40 2022] POST /identity/v3/projects => generated 409 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 02:34:40.815867 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c67458d-7d55-47a7-8360-d6676b8cc8d0 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:34:40.827602 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c67458d-7d55-47a7-8360-d6676b8cc8d0 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:34:40.893574 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b81e3a-df1e-4029-9531-689e68205e35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:34:40.894192 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b81e3a-df1e-4029-9531-689e68205e35 admin admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:34:40.894530 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b81e3a-df1e-4029-9531-689e68205e35 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:34:40.894804 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b81e3a-df1e-4029-9531-689e68205e35 admin admin] PATH_INFO: `/v3/users` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:34:40.896260 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b81e3a-df1e-4029-9531-689e68205e35 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:34:40.897995 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b81e3a-df1e-4029-9531-689e68205e35 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:34:40.922382 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1110/2219] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Oct 12 02:34:40 2022] POST /identity/v3/users => generated 305 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 02:34:40.923656 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4793bf23-2327-4b89-a76c-fa5a8c8970bc admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:34:40.934567 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4793bf23-2327-4b89-a76c-fa5a8c8970bc admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:34:40.939257 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc4798c-84b5-47d7-8c27-0246b2b306e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:34:40.939846 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc4798c-84b5-47d7-8c27-0246b2b306e2 admin admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:34:40.940117 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc4798c-84b5-47d7-8c27-0246b2b306e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:34:40.940387 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc4798c-84b5-47d7-8c27-0246b2b306e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:34:40.941049 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc4798c-84b5-47d7-8c27-0246b2b306e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:34:40.943612 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc4798c-84b5-47d7-8c27-0246b2b306e2 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:34:40.953762 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1110/2220] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Oct 12 02:34:40 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 02:34:40.957708 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b81e3a-df1e-4029-9531-689e68205e35 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:34:40.969210 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b81e3a-df1e-4029-9531-689e68205e35 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:34:40.973827 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4c66a0-aa4d-4e5b-9000-022dd299a85e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:34:40.974430 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4c66a0-aa4d-4e5b-9000-022dd299a85e admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:34:40.974710 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4c66a0-aa4d-4e5b-9000-022dd299a85e admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:34:40.974980 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4c66a0-aa4d-4e5b-9000-022dd299a85e admin admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:34:40.975613 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4c66a0-aa4d-4e5b-9000-022dd299a85e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:34:40.977238 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4c66a0-aa4d-4e5b-9000-022dd299a85e admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:34:40.988647 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1111/2221] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Oct 12 02:34:40 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 02:34:40.993653 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc4798c-84b5-47d7-8c27-0246b2b306e2 admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:34:41.003703 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc4798c-84b5-47d7-8c27-0246b2b306e2 admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:34:41.009636 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47cad98-e940-4e79-b6d3-939b779dc28a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:34:41.010240 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47cad98-e940-4e79-b6d3-939b779dc28a admin admin] REQUEST_METHOD: `PUT` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:34:41.010520 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47cad98-e940-4e79-b6d3-939b779dc28a admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:34:41.010797 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47cad98-e940-4e79-b6d3-939b779dc28a admin admin] PATH_INFO: `/v3/projects/8573062ee37f49cf9826138777c0a727/users/6a4564f0b257442988c970007e87af28/roles/3d75c4d7f1a849b9a771504d1583ab28` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:34:41.019729 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:34:41.027793 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47cad98-e940-4e79-b6d3-939b779dc28a admin admin] RBAC: Authorizing `identity:create_grant(project_id=8573062ee37f49cf9826138777c0a727, user_id=6a4564f0b257442988c970007e87af28, role_id=3d75c4d7f1a849b9a771504d1583ab28)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:34:41.032322 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47cad98-e940-4e79-b6d3-939b779dc28a admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:34:41.059577 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1111/2222] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Oct 12 02:34:40 2022] PUT /identity/v3/projects/8573062ee37f49cf9826138777c0a727/users/6a4564f0b257442988c970007e87af28/roles/3d75c4d7f1a849b9a771504d1583ab28 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 02:34:41.072421 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647305e3-a355-4feb-bc41-9bd1900016db None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:34:41.072789 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647305e3-a355-4feb-bc41-9bd1900016db None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:34:41.073408 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647305e3-a355-4feb-bc41-9bd1900016db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:34:41.106979 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-647305e3-a355-4feb-bc41-9bd1900016db None None] MFA Rules not processed for user `6a4564f0b257442988c970007e87af28`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:34:41.108207 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-647305e3-a355-4feb-bc41-9bd1900016db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:34:41.118944 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:34:41.182134 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1112/2223] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 02:34:41 2022] POST /identity/v3/auth/tokens => generated 3286 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 02:34:41.186721 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47cad98-e940-4e79-b6d3-939b779dc28a admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:34:41.278335 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47cad98-e940-4e79-b6d3-939b779dc28a admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:34:41.283739 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258589f7-48de-4a46-946a-c69b9279740a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:34:41.284360 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258589f7-48de-4a46-946a-c69b9279740a admin admin] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:34:41.284681 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258589f7-48de-4a46-946a-c69b9279740a admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:34:41.285005 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258589f7-48de-4a46-946a-c69b9279740a admin admin] PATH_INFO: `/v3/projects` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:34:41.285704 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258589f7-48de-4a46-946a-c69b9279740a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:34:41.288397 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258589f7-48de-4a46-946a-c69b9279740a admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:34:41.324954 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1112/2224] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Oct 12 02:34:41 2022] POST /identity/v3/projects => generated 409 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 02:34:41.326639 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647305e3-a355-4feb-bc41-9bd1900016db None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:34:41.340182 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647305e3-a355-4feb-bc41-9bd1900016db None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:34:41.404462 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96510d02-85a6-40a1-b570-7a9886106c75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:34:41.405150 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96510d02-85a6-40a1-b570-7a9886106c75 admin admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:34:41.405428 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96510d02-85a6-40a1-b570-7a9886106c75 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:34:41.405695 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96510d02-85a6-40a1-b570-7a9886106c75 admin admin] PATH_INFO: `/v3/users` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:34:41.406328 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96510d02-85a6-40a1-b570-7a9886106c75 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:34:41.408513 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96510d02-85a6-40a1-b570-7a9886106c75 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:34:41.435227 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1113/2225] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Oct 12 02:34:41 2022] POST /identity/v3/users => generated 311 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 02:34:41.439028 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258589f7-48de-4a46-946a-c69b9279740a admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:34:41.451384 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258589f7-48de-4a46-946a-c69b9279740a admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:34:41.456458 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b789281e-aa95-45d2-9db2-b2b91e50ffe6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:34:41.457172 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b789281e-aa95-45d2-9db2-b2b91e50ffe6 admin admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:34:41.457505 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b789281e-aa95-45d2-9db2-b2b91e50ffe6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:34:41.458009 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b789281e-aa95-45d2-9db2-b2b91e50ffe6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:34:41.458731 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b789281e-aa95-45d2-9db2-b2b91e50ffe6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:34:41.460396 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b789281e-aa95-45d2-9db2-b2b91e50ffe6 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:34:41.471922 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1113/2226] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Oct 12 02:34:41 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 12 02:34:41.477437 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96510d02-85a6-40a1-b570-7a9886106c75 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:34:41.488375 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96510d02-85a6-40a1-b570-7a9886106c75 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:34:41.495115 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3fcb52-c91b-4f6e-a767-9f5fd54eddd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:34:41.495759 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3fcb52-c91b-4f6e-a767-9f5fd54eddd5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:34:41.496038 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3fcb52-c91b-4f6e-a767-9f5fd54eddd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:34:41.496311 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3fcb52-c91b-4f6e-a767-9f5fd54eddd5 admin admin] PATH_INFO: `/v3/projects/47015b1d3d984dcc8bb2bc2e6edf3e2b/users/21d98d98fe8d4f8399a38c5e3d837cf9/roles/39b1e8108dff402383def3c559f48189` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:34:41.512352 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3fcb52-c91b-4f6e-a767-9f5fd54eddd5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=47015b1d3d984dcc8bb2bc2e6edf3e2b, user_id=21d98d98fe8d4f8399a38c5e3d837cf9, role_id=39b1e8108dff402383def3c559f48189)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:34:41.515032 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3fcb52-c91b-4f6e-a767-9f5fd54eddd5 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:34:41.533072 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1114/2227] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Oct 12 02:34:41 2022] PUT /identity/v3/projects/47015b1d3d984dcc8bb2bc2e6edf3e2b/users/21d98d98fe8d4f8399a38c5e3d837cf9/roles/39b1e8108dff402383def3c559f48189 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 02:34:41.537530 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b789281e-aa95-45d2-9db2-b2b91e50ffe6 admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:34:41.547613 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b789281e-aa95-45d2-9db2-b2b91e50ffe6 admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:34:41.616379 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8058fb98-ee1d-4c35-b44d-719e7c0402cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:34:41.617197 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8058fb98-ee1d-4c35-b44d-719e7c0402cc admin admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:34:41.617578 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8058fb98-ee1d-4c35-b44d-719e7c0402cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:34:41.617956 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8058fb98-ee1d-4c35-b44d-719e7c0402cc admin admin] PATH_INFO: `/v3/roles` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:34:41.618975 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8058fb98-ee1d-4c35-b44d-719e7c0402cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:34:41.620887 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8058fb98-ee1d-4c35-b44d-719e7c0402cc admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:34:41.632995 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1114/2228] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Oct 12 02:34:41 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 02:34:41.637794 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3fcb52-c91b-4f6e-a767-9f5fd54eddd5 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:34:41.650014 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3fcb52-c91b-4f6e-a767-9f5fd54eddd5 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:34:41.654974 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed2e91c-2b1a-4df9-9689-7302a53fe451 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:34:41.656011 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed2e91c-2b1a-4df9-9689-7302a53fe451 admin admin] REQUEST_METHOD: `PUT` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:34:41.656283 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed2e91c-2b1a-4df9-9689-7302a53fe451 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:34:41.656669 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed2e91c-2b1a-4df9-9689-7302a53fe451 admin admin] PATH_INFO: `/v3/projects/47015b1d3d984dcc8bb2bc2e6edf3e2b/users/21d98d98fe8d4f8399a38c5e3d837cf9/roles/39b1e8108dff402383def3c559f48189` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:34:41.658729 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed2e91c-2b1a-4df9-9689-7302a53fe451 admin admin] RBAC: Authorizing `identity:create_grant(project_id=47015b1d3d984dcc8bb2bc2e6edf3e2b, user_id=21d98d98fe8d4f8399a38c5e3d837cf9, role_id=39b1e8108dff402383def3c559f48189)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:34:41.662247 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed2e91c-2b1a-4df9-9689-7302a53fe451 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:34:41.675580 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1115/2229] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Oct 12 02:34:41 2022] PUT /identity/v3/projects/47015b1d3d984dcc8bb2bc2e6edf3e2b/users/21d98d98fe8d4f8399a38c5e3d837cf9/roles/39b1e8108dff402383def3c559f48189 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 02:34:41.686335 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc548322-ee3e-4bdd-a141-fe113a717b04 None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:34:41.686864 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc548322-ee3e-4bdd-a141-fe113a717b04 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:34:41.687214 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc548322-ee3e-4bdd-a141-fe113a717b04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:34:41.725286 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-bc548322-ee3e-4bdd-a141-fe113a717b04 None None] MFA Rules not processed for user `21d98d98fe8d4f8399a38c5e3d837cf9`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:34:41.726555 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-bc548322-ee3e-4bdd-a141-fe113a717b04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:34:41.778216 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:34:41.805700 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1115/2230] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 02:34:41 2022] POST /identity/v3/auth/tokens => generated 3353 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 02:34:41.816540 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed2e91c-2b1a-4df9-9689-7302a53fe451 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:34:41.819543 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-4ed2e91c-2b1a-4df9-9689-7302a53fe451 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:34:41.879178 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed2e91c-2b1a-4df9-9689-7302a53fe451 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:34:41.883358 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b440bab5-e11a-4417-89cf-c5c32ca49434 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ba688e0c4d44d13898539ee886f95fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'beb6def6fcad45959e56425bb8bff4d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:34:41.883962 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b440bab5-e11a-4417-89cf-c5c32ca49434 service cinder] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:34:41.884235 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b440bab5-e11a-4417-89cf-c5c32ca49434 service cinder] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:34:41.884528 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b440bab5-e11a-4417-89cf-c5c32ca49434 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:34:41.893493 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b440bab5-e11a-4417-89cf-c5c32ca49434 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:34:41.894903 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b440bab5-e11a-4417-89cf-c5c32ca49434 service cinder] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:34:41.905510 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1116/2231] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 02:34:41 2022] GET /identity/v3/auth/tokens => generated 3353 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 02:34:42.082536 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc548322-ee3e-4bdd-a141-fe113a717b04 None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:34:42.093081 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc548322-ee3e-4bdd-a141-fe113a717b04 None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:34:42.096567 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b098510-ac74-4591-8255-1d53ac784dfc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ba688e0c4d44d13898539ee886f95fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'beb6def6fcad45959e56425bb8bff4d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:34:42.097165 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b098510-ac74-4591-8255-1d53ac784dfc service cinder] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:34:42.097441 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b098510-ac74-4591-8255-1d53ac784dfc service cinder] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:34:42.097710 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b098510-ac74-4591-8255-1d53ac784dfc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:34:42.156846 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b098510-ac74-4591-8255-1d53ac784dfc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:34:42.158259 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b098510-ac74-4591-8255-1d53ac784dfc service cinder] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:34:42.167605 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1116/2232] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 02:34:42 2022] GET /identity/v3/auth/tokens => generated 3286 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 02:34:45.195173 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b440bab5-e11a-4417-89cf-c5c32ca49434 service cinder] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:34:45.196621 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-b440bab5-e11a-4417-89cf-c5c32ca49434 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:34:45.203098 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:34:45.268712 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b440bab5-e11a-4417-89cf-c5c32ca49434 service cinder] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:34:45.273786 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc664e1f-66ba-4f6b-ae0b-b8b4cb18866e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a58b9e0467c040638c3d43e3ac9c0495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'beb6def6fcad45959e56425bb8bff4d1', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:34:45.274392 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc664e1f-66ba-4f6b-ae0b-b8b4cb18866e service placement] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:34:45.274671 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc664e1f-66ba-4f6b-ae0b-b8b4cb18866e service placement] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:34:45.274943 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc664e1f-66ba-4f6b-ae0b-b8b4cb18866e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:34:45.276709 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-fc664e1f-66ba-4f6b-ae0b-b8b4cb18866e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:34:45.288662 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc664e1f-66ba-4f6b-ae0b-b8b4cb18866e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:34:45.290226 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc664e1f-66ba-4f6b-ae0b-b8b4cb18866e service placement] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:34:45.300024 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1117/2233] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 02:34:45 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 02:34:45.525263 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b098510-ac74-4591-8255-1d53ac784dfc service cinder] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:34:45.525263 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-4b098510-ac74-4591-8255-1d53ac784dfc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:34:45.542126 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b098510-ac74-4591-8255-1d53ac784dfc service cinder] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:34:45.546047 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65f8751-3a2f-43d5-9a16-56f242ab9e03 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ba688e0c4d44d13898539ee886f95fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'beb6def6fcad45959e56425bb8bff4d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:34:45.546678 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65f8751-3a2f-43d5-9a16-56f242ab9e03 service cinder] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:34:45.546971 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65f8751-3a2f-43d5-9a16-56f242ab9e03 service cinder] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:34:45.547237 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65f8751-3a2f-43d5-9a16-56f242ab9e03 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:34:45.548996 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-a65f8751-3a2f-43d5-9a16-56f242ab9e03 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:34:45.611022 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65f8751-3a2f-43d5-9a16-56f242ab9e03 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:34:45.612376 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65f8751-3a2f-43d5-9a16-56f242ab9e03 service cinder] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:34:45.621697 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1117/2234] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 02:34:45 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 02:34:46.934974 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc664e1f-66ba-4f6b-ae0b-b8b4cb18866e service placement] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:34:46.936573 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-fc664e1f-66ba-4f6b-ae0b-b8b4cb18866e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:34:46.957339 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde4e698-0474-4bf9-836c-10dbbcf2d279 None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:34:46.958398 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde4e698-0474-4bf9-836c-10dbbcf2d279 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:34:46.958398 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde4e698-0474-4bf9-836c-10dbbcf2d279 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:34:46.979148 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-cde4e698-0474-4bf9-836c-10dbbcf2d279 None None] MFA Rules not processed for user `8d0e2087e5324071926c3dc3a3cb9b1d`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:34:46.980567 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-cde4e698-0474-4bf9-836c-10dbbcf2d279 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:34:46.997284 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc664e1f-66ba-4f6b-ae0b-b8b4cb18866e service placement] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:34:47.000998 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3d1196-0587-4687-85cc-40e65c724c37 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5223b5cab3114e9b9a13c582f8ef8386', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'beb6def6fcad45959e56425bb8bff4d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:34:47.001681 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3d1196-0587-4687-85cc-40e65c724c37 service neutron] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:34:47.001963 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3d1196-0587-4687-85cc-40e65c724c37 service neutron] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:34:47.002236 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3d1196-0587-4687-85cc-40e65c724c37 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:34:47.003975 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-7b3d1196-0587-4687-85cc-40e65c724c37 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:34:47.037802 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1118/2235] 10.222.0.18 () {58 vars in 1009 bytes} [Wed Oct 12 02:34:46 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 02:34:47.051200 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde4e698-0474-4bf9-836c-10dbbcf2d279 None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:34:47.053345 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-cde4e698-0474-4bf9-836c-10dbbcf2d279 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:34:47.072611 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3d1196-0587-4687-85cc-40e65c724c37 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:34:47.075048 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3d1196-0587-4687-85cc-40e65c724c37 service neutron] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:34:47.081476 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:34:47.085500 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1118/2236] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 02:34:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 12 02:34:47.130484 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde4e698-0474-4bf9-836c-10dbbcf2d279 None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:34:47.135729 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5799c6-2a54-4119-aa88-7f40b6793782 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af9bd50c42cc437dbdd5a431d8adbb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'beb6def6fcad45959e56425bb8bff4d1', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:34:47.136344 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5799c6-2a54-4119-aa88-7f40b6793782 service swift] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:34:47.136642 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5799c6-2a54-4119-aa88-7f40b6793782 service swift] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:34:47.136920 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5799c6-2a54-4119-aa88-7f40b6793782 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:34:47.145458 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5799c6-2a54-4119-aa88-7f40b6793782 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:34:47.147056 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5799c6-2a54-4119-aa88-7f40b6793782 service swift] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:34:47.155357 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1119/2237] 10.222.0.18 () {60 vars in 1384 bytes} [Wed Oct 12 02:34:47 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 12 02:34:47.656270 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3d1196-0587-4687-85cc-40e65c724c37 service neutron] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:34:47.669798 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3d1196-0587-4687-85cc-40e65c724c37 service neutron] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:34:47.674757 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe20203-c33c-4ba9-9fa8-5d7500bd430f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:34:47.675435 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe20203-c33c-4ba9-9fa8-5d7500bd430f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:34:47.675780 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe20203-c33c-4ba9-9fa8-5d7500bd430f admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:34:47.675987 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe20203-c33c-4ba9-9fa8-5d7500bd430f admin admin] PATH_INFO: `/v3/users/6a4564f0b257442988c970007e87af28` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:34:47.678547 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe20203-c33c-4ba9-9fa8-5d7500bd430f admin admin] RBAC: Authorizing `identity:delete_user(user_id=6a4564f0b257442988c970007e87af28)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:34:47.680504 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe20203-c33c-4ba9-9fa8-5d7500bd430f admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:34:47.791336 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:34:47.812529 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-6fe20203-c33c-4ba9-9fa8-5d7500bd430f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6a4564f0b257442988c970007e87af28'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:34:47.826232 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-6fe20203-c33c-4ba9-9fa8-5d7500bd430f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6a4564f0b257442988c970007e87af28'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:34:47.853800 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-6fe20203-c33c-4ba9-9fa8-5d7500bd430f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6a4564f0b257442988c970007e87af28'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:34:47.866576 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-6fe20203-c33c-4ba9-9fa8-5d7500bd430f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6a4564f0b257442988c970007e87af28'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:34:47.869275 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-6fe20203-c33c-4ba9-9fa8-5d7500bd430f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6a4564f0b257442988c970007e87af28'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:34:47.877246 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1119/2238] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Oct 12 02:34:47 2022] DELETE /identity/v3/users/6a4564f0b257442988c970007e87af28 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 02:34:47.878868 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a26d2e8-73f8-4b69-9fcc-ca5d803d95ac None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:34:47.879149 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a26d2e8-73f8-4b69-9fcc-ca5d803d95ac None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:34:47.879413 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a26d2e8-73f8-4b69-9fcc-ca5d803d95ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:34:47.902333 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-0a26d2e8-73f8-4b69-9fcc-ca5d803d95ac None None] MFA Rules not processed for user `a326a5bb7364479382f528a592371656`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:34:47.903524 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-0a26d2e8-73f8-4b69-9fcc-ca5d803d95ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:34:47.974583 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1120/2239] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 02:34:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 02:34:47.984714 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe20203-c33c-4ba9-9fa8-5d7500bd430f admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:34:47.986730 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-6fe20203-c33c-4ba9-9fa8-5d7500bd430f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:34:48.106397 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe20203-c33c-4ba9-9fa8-5d7500bd430f admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:34:48.115386 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35281db-d22d-420a-b532-0499f5456e41 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5223b5cab3114e9b9a13c582f8ef8386', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'beb6def6fcad45959e56425bb8bff4d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:34:48.116045 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35281db-d22d-420a-b532-0499f5456e41 service neutron] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:34:48.116478 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35281db-d22d-420a-b532-0499f5456e41 service neutron] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:34:48.116895 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35281db-d22d-420a-b532-0499f5456e41 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:34:48.127933 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35281db-d22d-420a-b532-0499f5456e41 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:34:48.134132 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35281db-d22d-420a-b532-0499f5456e41 service neutron] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:34:48.149472 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1120/2240] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 02:34:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 02:34:48.568873 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a26d2e8-73f8-4b69-9fcc-ca5d803d95ac None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:34:48.570422 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-0a26d2e8-73f8-4b69-9fcc-ca5d803d95ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:34:48.588580 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a26d2e8-73f8-4b69-9fcc-ca5d803d95ac None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:34:48.602724 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35953943-127b-4f05-bd69-ac0dc15e5698 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:34:48.603407 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35953943-127b-4f05-bd69-ac0dc15e5698 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:34:48.603667 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35953943-127b-4f05-bd69-ac0dc15e5698 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:34:48.603938 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35953943-127b-4f05-bd69-ac0dc15e5698 admin admin] PATH_INFO: `/v3/projects/8573062ee37f49cf9826138777c0a727` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:34:48.605352 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35953943-127b-4f05-bd69-ac0dc15e5698 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8573062ee37f49cf9826138777c0a727)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:34:48.607278 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35953943-127b-4f05-bd69-ac0dc15e5698 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:34:48.709311 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-35953943-127b-4f05-bd69-ac0dc15e5698 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8573062ee37f49cf9826138777c0a727', 'request_id': 'req-35953943-127b-4f05-bd69-ac0dc15e5698'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:34:48.721226 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-35953943-127b-4f05-bd69-ac0dc15e5698 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8573062ee37f49cf9826138777c0a727', 'request_id': 'req-35953943-127b-4f05-bd69-ac0dc15e5698'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:34:48.732787 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-35953943-127b-4f05-bd69-ac0dc15e5698 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8573062ee37f49cf9826138777c0a727', 'request_id': 'req-35953943-127b-4f05-bd69-ac0dc15e5698'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:34:48.758160 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-35953943-127b-4f05-bd69-ac0dc15e5698 admin admin] The token cache is being invalidate because project 8573062ee37f49cf9826138777c0a727 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81361) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 02:34:48.758954 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-35953943-127b-4f05-bd69-ac0dc15e5698 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:34:48.759786 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-35953943-127b-4f05-bd69-ac0dc15e5698 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:34:48.762073 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1121/2241] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Oct 12 02:34:48 2022] DELETE /identity/v3/projects/8573062ee37f49cf9826138777c0a727 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 02:34:48.766248 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35281db-d22d-420a-b532-0499f5456e41 service neutron] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:34:48.778724 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35281db-d22d-420a-b532-0499f5456e41 service neutron] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:34:48.940846 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec3a041-b300-484c-8bb8-b90e248c9588 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:34:48.941554 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec3a041-b300-484c-8bb8-b90e248c9588 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:34:48.942053 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec3a041-b300-484c-8bb8-b90e248c9588 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:34:48.942053 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec3a041-b300-484c-8bb8-b90e248c9588 admin admin] PATH_INFO: `/v3/users/21d98d98fe8d4f8399a38c5e3d837cf9` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:34:48.946218 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec3a041-b300-484c-8bb8-b90e248c9588 admin admin] RBAC: Authorizing `identity:delete_user(user_id=21d98d98fe8d4f8399a38c5e3d837cf9)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:34:48.948163 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec3a041-b300-484c-8bb8-b90e248c9588 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:34:49.045669 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-3ec3a041-b300-484c-8bb8-b90e248c9588 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '21d98d98fe8d4f8399a38c5e3d837cf9'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:34:49.061200 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-3ec3a041-b300-484c-8bb8-b90e248c9588 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '21d98d98fe8d4f8399a38c5e3d837cf9'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:34:49.069060 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:34:49.082817 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-3ec3a041-b300-484c-8bb8-b90e248c9588 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '21d98d98fe8d4f8399a38c5e3d837cf9'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:34:49.106413 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-3ec3a041-b300-484c-8bb8-b90e248c9588 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '21d98d98fe8d4f8399a38c5e3d837cf9'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:34:49.113704 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-3ec3a041-b300-484c-8bb8-b90e248c9588 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '21d98d98fe8d4f8399a38c5e3d837cf9'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:34:49.133880 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1121/2242] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Oct 12 02:34:48 2022] DELETE /identity/v3/users/21d98d98fe8d4f8399a38c5e3d837cf9 => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 02:34:49.882943 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35953943-127b-4f05-bd69-ac0dc15e5698 admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:34:49.885356 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-35953943-127b-4f05-bd69-ac0dc15e5698 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:34:49.912230 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35953943-127b-4f05-bd69-ac0dc15e5698 admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:34:50.002755 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:34:50.074010 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c16f5f5-ac89-4454-ad72-0fa7393d85f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:34:50.074669 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c16f5f5-ac89-4454-ad72-0fa7393d85f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:34:50.074946 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c16f5f5-ac89-4454-ad72-0fa7393d85f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:34:50.075226 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c16f5f5-ac89-4454-ad72-0fa7393d85f8 admin admin] PATH_INFO: `/v3/projects/47015b1d3d984dcc8bb2bc2e6edf3e2b` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:34:50.079803 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c16f5f5-ac89-4454-ad72-0fa7393d85f8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=47015b1d3d984dcc8bb2bc2e6edf3e2b)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:34:50.085194 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c16f5f5-ac89-4454-ad72-0fa7393d85f8 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:34:50.201003 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-9c16f5f5-ac89-4454-ad72-0fa7393d85f8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '47015b1d3d984dcc8bb2bc2e6edf3e2b', 'request_id': 'req-9c16f5f5-ac89-4454-ad72-0fa7393d85f8'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:34:50.237689 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-9c16f5f5-ac89-4454-ad72-0fa7393d85f8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '47015b1d3d984dcc8bb2bc2e6edf3e2b', 'request_id': 'req-9c16f5f5-ac89-4454-ad72-0fa7393d85f8'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:34:50.268643 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-9c16f5f5-ac89-4454-ad72-0fa7393d85f8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '47015b1d3d984dcc8bb2bc2e6edf3e2b', 'request_id': 'req-9c16f5f5-ac89-4454-ad72-0fa7393d85f8'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:34:50.291494 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-9c16f5f5-ac89-4454-ad72-0fa7393d85f8 admin admin] The token cache is being invalidate because project 47015b1d3d984dcc8bb2bc2e6edf3e2b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81361) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 02:34:50.292073 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-9c16f5f5-ac89-4454-ad72-0fa7393d85f8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:34:50.293088 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-9c16f5f5-ac89-4454-ad72-0fa7393d85f8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:34:50.300397 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1122/2243] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Oct 12 02:34:49 2022] DELETE /identity/v3/projects/47015b1d3d984dcc8bb2bc2e6edf3e2b => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 02:34:50.302344 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096fdf22-619c-47b0-a159-a7370ee8103d None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:34:50.302905 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096fdf22-619c-47b0-a159-a7370ee8103d None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:34:50.303285 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096fdf22-619c-47b0-a159-a7370ee8103d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:34:50.337699 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-096fdf22-619c-47b0-a159-a7370ee8103d None None] MFA Rules not processed for user `a326a5bb7364479382f528a592371656`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:34:50.339012 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-096fdf22-619c-47b0-a159-a7370ee8103d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:34:50.512976 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1122/2244] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 02:34:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 02:34:50.522379 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de990c0-b2ea-4cf3-b9f0-efaddb3cae0c None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:34:50.522859 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de990c0-b2ea-4cf3-b9f0-efaddb3cae0c None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:34:50.523141 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de990c0-b2ea-4cf3-b9f0-efaddb3cae0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:34:50.575667 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-7de990c0-b2ea-4cf3-b9f0-efaddb3cae0c None None] MFA Rules not processed for user `a326a5bb7364479382f528a592371656`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:34:50.577325 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-7de990c0-b2ea-4cf3-b9f0-efaddb3cae0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:34:50.595286 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1123/2245] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 02:34:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 02:34:50.596697 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096fdf22-619c-47b0-a159-a7370ee8103d None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:34:50.612487 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096fdf22-619c-47b0-a159-a7370ee8103d None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:34:50.620586 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84acc181-265c-488f-8538-e6214350db0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:34:50.621224 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84acc181-265c-488f-8538-e6214350db0e admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:34:50.621498 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84acc181-265c-488f-8538-e6214350db0e admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:34:50.622345 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84acc181-265c-488f-8538-e6214350db0e admin admin] PATH_INFO: `/v3/domains` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:34:50.622583 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84acc181-265c-488f-8538-e6214350db0e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 02:34:50.623059 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84acc181-265c-488f-8538-e6214350db0e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:34:50.624870 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84acc181-265c-488f-8538-e6214350db0e admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:34:50.646490 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1123/2246] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Oct 12 02:34:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 02:34:50.650831 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de990c0-b2ea-4cf3-b9f0-efaddb3cae0c None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:34:50.663428 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de990c0-b2ea-4cf3-b9f0-efaddb3cae0c None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:34:50.670202 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf893989-6458-4421-b2c9-9390fc8046f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:34:50.670202 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf893989-6458-4421-b2c9-9390fc8046f1 admin admin] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:34:50.670501 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf893989-6458-4421-b2c9-9390fc8046f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:34:50.670845 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf893989-6458-4421-b2c9-9390fc8046f1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:34:50.671698 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf893989-6458-4421-b2c9-9390fc8046f1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:34:50.674410 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf893989-6458-4421-b2c9-9390fc8046f1 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:34:50.748203 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1124/2247] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Oct 12 02:34:50 2022] POST /identity/v3/projects => generated 385 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 02:34:50.751640 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84acc181-265c-488f-8538-e6214350db0e admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:34:50.773148 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84acc181-265c-488f-8538-e6214350db0e admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:34:50.951189 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdc627d-ff3d-4ccc-a310-cad44ebdf0d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:34:50.952105 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdc627d-ff3d-4ccc-a310-cad44ebdf0d2 admin admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:34:50.952485 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdc627d-ff3d-4ccc-a310-cad44ebdf0d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:34:50.952957 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdc627d-ff3d-4ccc-a310-cad44ebdf0d2 admin admin] PATH_INFO: `/v3/users` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:34:50.953553 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fdc627d-ff3d-4ccc-a310-cad44ebdf0d2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:34:50.955931 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fdc627d-ff3d-4ccc-a310-cad44ebdf0d2 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:34:50.991165 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1124/2248] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Oct 12 02:34:50 2022] POST /identity/v3/users => generated 293 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 02:34:50.992366 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf893989-6458-4421-b2c9-9390fc8046f1 admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:34:51.019118 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf893989-6458-4421-b2c9-9390fc8046f1 admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:34:51.025974 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34ec7a7-cbc9-4fe1-a1ca-7c7b21132c53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:34:51.026915 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34ec7a7-cbc9-4fe1-a1ca-7c7b21132c53 admin admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:34:51.027410 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34ec7a7-cbc9-4fe1-a1ca-7c7b21132c53 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:34:51.027935 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34ec7a7-cbc9-4fe1-a1ca-7c7b21132c53 admin admin] PATH_INFO: `/v3/roles` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:34:51.028825 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34ec7a7-cbc9-4fe1-a1ca-7c7b21132c53 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:34:51.030769 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34ec7a7-cbc9-4fe1-a1ca-7c7b21132c53 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:34:51.046755 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1125/2249] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Oct 12 02:34:50 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 12 02:34:51.050744 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdc627d-ff3d-4ccc-a310-cad44ebdf0d2 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:34:51.069490 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdc627d-ff3d-4ccc-a310-cad44ebdf0d2 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:34:51.076413 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c925d4-1e20-4566-a612-41e61b696f10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:34:51.079328 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c925d4-1e20-4566-a612-41e61b696f10 admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:34:51.080014 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c925d4-1e20-4566-a612-41e61b696f10 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:34:51.080274 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c925d4-1e20-4566-a612-41e61b696f10 admin admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:34:51.081400 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c925d4-1e20-4566-a612-41e61b696f10 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:34:51.085238 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c925d4-1e20-4566-a612-41e61b696f10 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:34:51.099080 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1125/2250] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Oct 12 02:34:51 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 02:34:51.103274 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34ec7a7-cbc9-4fe1-a1ca-7c7b21132c53 admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:34:51.119716 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34ec7a7-cbc9-4fe1-a1ca-7c7b21132c53 admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:34:51.124464 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb18437-2fd0-469c-9d87-7efd7088a36f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:34:51.125661 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb18437-2fd0-469c-9d87-7efd7088a36f admin admin] REQUEST_METHOD: `PUT` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:34:51.126124 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb18437-2fd0-469c-9d87-7efd7088a36f admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:34:51.126610 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb18437-2fd0-469c-9d87-7efd7088a36f admin admin] PATH_INFO: `/v3/projects/3a73109ad2a04472983b6755e1af9d46/users/df121323c1ae4956be7e2bc37a2a6df1/roles/3d75c4d7f1a849b9a771504d1583ab28` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:34:51.169203 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb18437-2fd0-469c-9d87-7efd7088a36f admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a73109ad2a04472983b6755e1af9d46, user_id=df121323c1ae4956be7e2bc37a2a6df1, role_id=3d75c4d7f1a849b9a771504d1583ab28)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:34:51.178950 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb18437-2fd0-469c-9d87-7efd7088a36f admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:34:51.215830 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1126/2251] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Oct 12 02:34:51 2022] PUT /identity/v3/projects/3a73109ad2a04472983b6755e1af9d46/users/df121323c1ae4956be7e2bc37a2a6df1/roles/3d75c4d7f1a849b9a771504d1583ab28 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 02:34:51.294688 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cb9ef4-4740-4c16-ae17-68744417b643 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:34:51.295055 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cb9ef4-4740-4c16-ae17-68744417b643 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:34:51.295319 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cb9ef4-4740-4c16-ae17-68744417b643 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:34:51.359230 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-b0cb9ef4-4740-4c16-ae17-68744417b643 None None] MFA Rules not processed for user `df121323c1ae4956be7e2bc37a2a6df1`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:34:51.361753 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-b0cb9ef4-4740-4c16-ae17-68744417b643 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:34:51.447124 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:34:51.518385 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1126/2252] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 02:34:51 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 02:34:51.527372 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb18437-2fd0-469c-9d87-7efd7088a36f admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:34:51.652201 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb18437-2fd0-469c-9d87-7efd7088a36f admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:34:51.657259 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1440d643-f861-4ac9-935e-b6e52e0f4df4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:34:51.657884 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1440d643-f861-4ac9-935e-b6e52e0f4df4 admin admin] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:34:51.658240 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1440d643-f861-4ac9-935e-b6e52e0f4df4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:34:51.658623 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1440d643-f861-4ac9-935e-b6e52e0f4df4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:34:51.659372 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1440d643-f861-4ac9-935e-b6e52e0f4df4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:34:51.661675 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1440d643-f861-4ac9-935e-b6e52e0f4df4 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:34:51.673449 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:34:51.705582 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1127/2253] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Oct 12 02:34:51 2022] POST /identity/v3/projects => generated 387 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 02:34:51.710293 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cb9ef4-4740-4c16-ae17-68744417b643 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:34:51.722508 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cb9ef4-4740-4c16-ae17-68744417b643 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:34:51.844620 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b0012e-decb-4b0e-8778-853427341645 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:34:51.845397 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b0012e-decb-4b0e-8778-853427341645 admin admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:34:51.845831 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b0012e-decb-4b0e-8778-853427341645 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:34:51.846167 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b0012e-decb-4b0e-8778-853427341645 admin admin] PATH_INFO: `/v3/users` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:34:51.846903 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b0012e-decb-4b0e-8778-853427341645 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:34:51.851354 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b0012e-decb-4b0e-8778-853427341645 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:34:51.935963 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1440d643-f861-4ac9-935e-b6e52e0f4df4 admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:34:51.942774 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1127/2254] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Oct 12 02:34:51 2022] POST /identity/v3/users => generated 300 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 02:34:51.948965 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1440d643-f861-4ac9-935e-b6e52e0f4df4 admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:34:51.956989 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50c97bf-e9fe-4cdd-bbe5-7db14318032b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:34:51.960017 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50c97bf-e9fe-4cdd-bbe5-7db14318032b admin admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:34:51.960306 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50c97bf-e9fe-4cdd-bbe5-7db14318032b admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:34:51.960696 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50c97bf-e9fe-4cdd-bbe5-7db14318032b admin admin] PATH_INFO: `/v3/roles` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:34:51.961516 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50c97bf-e9fe-4cdd-bbe5-7db14318032b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:34:51.964357 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50c97bf-e9fe-4cdd-bbe5-7db14318032b admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:34:51.988068 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1128/2255] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Oct 12 02:34:51 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 02:34:51.990976 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b0012e-decb-4b0e-8778-853427341645 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:34:52.027761 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b0012e-decb-4b0e-8778-853427341645 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:34:52.034057 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2adface8-4e84-44c2-93fb-8f4b08692cdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:34:52.038541 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adface8-4e84-44c2-93fb-8f4b08692cdd admin admin] REQUEST_METHOD: `PUT` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:34:52.038917 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adface8-4e84-44c2-93fb-8f4b08692cdd admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:34:52.039270 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adface8-4e84-44c2-93fb-8f4b08692cdd admin admin] PATH_INFO: `/v3/projects/ce4832ca4e224cc1bd47f1906f742073/users/7078be2d7de74cf2870aee98ec7b8b50/roles/39b1e8108dff402383def3c559f48189` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:34:52.059638 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2adface8-4e84-44c2-93fb-8f4b08692cdd admin admin] RBAC: Authorizing `identity:create_grant(project_id=ce4832ca4e224cc1bd47f1906f742073, user_id=7078be2d7de74cf2870aee98ec7b8b50, role_id=39b1e8108dff402383def3c559f48189)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:34:52.063908 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2adface8-4e84-44c2-93fb-8f4b08692cdd admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:34:52.091312 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1128/2256] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Oct 12 02:34:51 2022] PUT /identity/v3/projects/ce4832ca4e224cc1bd47f1906f742073/users/7078be2d7de74cf2870aee98ec7b8b50/roles/39b1e8108dff402383def3c559f48189 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 02:34:52.095053 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50c97bf-e9fe-4cdd-bbe5-7db14318032b admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:34:52.112794 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50c97bf-e9fe-4cdd-bbe5-7db14318032b admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:34:52.238361 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d6614d-2a16-4154-8bf9-50714b47bfd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:34:52.239699 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d6614d-2a16-4154-8bf9-50714b47bfd0 admin admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:34:52.239985 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d6614d-2a16-4154-8bf9-50714b47bfd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:34:52.240264 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d6614d-2a16-4154-8bf9-50714b47bfd0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:34:52.240960 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d6614d-2a16-4154-8bf9-50714b47bfd0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:34:52.243243 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d6614d-2a16-4154-8bf9-50714b47bfd0 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:34:52.268422 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1129/2257] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Oct 12 02:34:52 2022] GET /identity/v3/roles => generated 1420 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 02:34:52.272549 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2adface8-4e84-44c2-93fb-8f4b08692cdd admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:34:52.289040 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2adface8-4e84-44c2-93fb-8f4b08692cdd admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:34:52.299230 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f16eb9c-4a16-4887-847e-6f04631fe493 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:34:52.300204 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f16eb9c-4a16-4887-847e-6f04631fe493 admin admin] REQUEST_METHOD: `PUT` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:34:52.300673 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f16eb9c-4a16-4887-847e-6f04631fe493 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:34:52.301684 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f16eb9c-4a16-4887-847e-6f04631fe493 admin admin] PATH_INFO: `/v3/projects/ce4832ca4e224cc1bd47f1906f742073/users/7078be2d7de74cf2870aee98ec7b8b50/roles/39b1e8108dff402383def3c559f48189` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:34:52.305814 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f16eb9c-4a16-4887-847e-6f04631fe493 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ce4832ca4e224cc1bd47f1906f742073, user_id=7078be2d7de74cf2870aee98ec7b8b50, role_id=39b1e8108dff402383def3c559f48189)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:34:52.309209 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f16eb9c-4a16-4887-847e-6f04631fe493 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:34:52.322714 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1129/2258] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Oct 12 02:34:52 2022] PUT /identity/v3/projects/ce4832ca4e224cc1bd47f1906f742073/users/7078be2d7de74cf2870aee98ec7b8b50/roles/39b1e8108dff402383def3c559f48189 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 02:34:52.333311 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3539259-a2f3-47cb-bbe1-e193a88d7661 None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:34:52.333827 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3539259-a2f3-47cb-bbe1-e193a88d7661 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:34:52.334381 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3539259-a2f3-47cb-bbe1-e193a88d7661 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:34:52.362231 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82aabbd7-026b-45c5-8e5c-bf9d2af040bb None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:34:52.363475 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82aabbd7-026b-45c5-8e5c-bf9d2af040bb None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:34:52.364548 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82aabbd7-026b-45c5-8e5c-bf9d2af040bb None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:34:52.366444 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1130/2259] 10.222.0.18 () {54 vars in 921 bytes} [Wed Oct 12 02:34:52 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 02:34:52.396215 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941bc963-8188-4624-b834-1eb9264aaafa None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:34:52.396757 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941bc963-8188-4624-b834-1eb9264aaafa None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:34:52.397202 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941bc963-8188-4624-b834-1eb9264aaafa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:34:52.423698 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-f3539259-a2f3-47cb-bbe1-e193a88d7661 None None] MFA Rules not processed for user `7078be2d7de74cf2870aee98ec7b8b50`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:34:52.425840 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-f3539259-a2f3-47cb-bbe1-e193a88d7661 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:34:52.439503 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-941bc963-8188-4624-b834-1eb9264aaafa None None] MFA Rules not processed for user `a58b9e0467c040638c3d43e3ac9c0495`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:34:52.445010 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-941bc963-8188-4624-b834-1eb9264aaafa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:34:52.601601 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1131/2260] 10.222.0.18 () {58 vars in 1018 bytes} [Wed Oct 12 02:34:52 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 02:34:52.602484 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941bc963-8188-4624-b834-1eb9264aaafa None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:34:52.604314 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-941bc963-8188-4624-b834-1eb9264aaafa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:34:52.606560 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1130/2261] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 02:34:52 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 02:34:52.616700 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3539259-a2f3-47cb-bbe1-e193a88d7661 None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:34:52.618976 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-f3539259-a2f3-47cb-bbe1-e193a88d7661 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:34:52.648923 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:34:52.700899 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941bc963-8188-4624-b834-1eb9264aaafa None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:34:52.709772 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d647bbe0-8fa1-4b38-a943-8f74aa1a056c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:34:52.710781 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d647bbe0-8fa1-4b38-a943-8f74aa1a056c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:34:52.711156 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d647bbe0-8fa1-4b38-a943-8f74aa1a056c admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:34:52.711527 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d647bbe0-8fa1-4b38-a943-8f74aa1a056c admin admin] PATH_INFO: `/v3/users/4f91d4dca41d45ff8b6e96c3594e851b` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:34:52.712821 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d647bbe0-8fa1-4b38-a943-8f74aa1a056c admin admin] RBAC: Authorizing `identity:delete_user(user_id=4f91d4dca41d45ff8b6e96c3594e851b)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:34:52.714998 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d647bbe0-8fa1-4b38-a943-8f74aa1a056c admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:34:52.738254 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3539259-a2f3-47cb-bbe1-e193a88d7661 None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:34:52.747767 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfd0651-390f-4806-b9a5-8b2633cab7b4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ba688e0c4d44d13898539ee886f95fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'beb6def6fcad45959e56425bb8bff4d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:34:52.748405 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfd0651-390f-4806-b9a5-8b2633cab7b4 service cinder] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:34:52.749545 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfd0651-390f-4806-b9a5-8b2633cab7b4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:34:52.751304 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfd0651-390f-4806-b9a5-8b2633cab7b4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:34:52.772025 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dfd0651-390f-4806-b9a5-8b2633cab7b4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:34:52.773580 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dfd0651-390f-4806-b9a5-8b2633cab7b4 service cinder] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:34:52.789497 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1131/2262] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 02:34:52 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 12 02:34:52.792187 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfd0651-390f-4806-b9a5-8b2633cab7b4 service cinder] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:34:52.799174 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-5dfd0651-390f-4806-b9a5-8b2633cab7b4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:34:52.812525 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-d647bbe0-8fa1-4b38-a943-8f74aa1a056c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4f91d4dca41d45ff8b6e96c3594e851b'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:34:52.815162 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:34:52.824897 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-d647bbe0-8fa1-4b38-a943-8f74aa1a056c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4f91d4dca41d45ff8b6e96c3594e851b'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:34:52.836759 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfd0651-390f-4806-b9a5-8b2633cab7b4 service cinder] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:34:52.853925 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-d647bbe0-8fa1-4b38-a943-8f74aa1a056c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4f91d4dca41d45ff8b6e96c3594e851b'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:34:52.857583 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19dfff72-ca5c-4cb3-a74d-7623b7525b0e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a58b9e0467c040638c3d43e3ac9c0495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'beb6def6fcad45959e56425bb8bff4d1', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:34:52.858476 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19dfff72-ca5c-4cb3-a74d-7623b7525b0e service placement] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:34:52.859043 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19dfff72-ca5c-4cb3-a74d-7623b7525b0e service placement] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:34:52.859598 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19dfff72-ca5c-4cb3-a74d-7623b7525b0e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:34:52.876133 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19dfff72-ca5c-4cb3-a74d-7623b7525b0e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:34:52.879749 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19dfff72-ca5c-4cb3-a74d-7623b7525b0e service placement] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:34:52.882897 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-d647bbe0-8fa1-4b38-a943-8f74aa1a056c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4f91d4dca41d45ff8b6e96c3594e851b'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:34:52.883497 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-d647bbe0-8fa1-4b38-a943-8f74aa1a056c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4f91d4dca41d45ff8b6e96c3594e851b'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:34:52.897504 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1132/2263] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Oct 12 02:34:52 2022] DELETE /identity/v3/users/4f91d4dca41d45ff8b6e96c3594e851b => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 02:34:52.904659 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1132/2264] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 02:34:52 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 02:34:53.287386 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d647bbe0-8fa1-4b38-a943-8f74aa1a056c admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:34:53.289205 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-d647bbe0-8fa1-4b38-a943-8f74aa1a056c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:34:53.457209 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d647bbe0-8fa1-4b38-a943-8f74aa1a056c admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:34:53.464077 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301d7c1c-8c90-47e7-a2dd-956d155ef17d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:34:53.465589 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301d7c1c-8c90-47e7-a2dd-956d155ef17d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:34:53.465985 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301d7c1c-8c90-47e7-a2dd-956d155ef17d admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:34:53.466400 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301d7c1c-8c90-47e7-a2dd-956d155ef17d admin admin] PATH_INFO: `/v3/projects/23861c9a343c4b95b71a2415d0a28f37` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:34:53.467801 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301d7c1c-8c90-47e7-a2dd-956d155ef17d admin admin] RBAC: Authorizing `identity:delete_project(project_id=23861c9a343c4b95b71a2415d0a28f37)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:34:53.470139 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301d7c1c-8c90-47e7-a2dd-956d155ef17d admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:34:53.529293 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:34:53.534944 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-301d7c1c-8c90-47e7-a2dd-956d155ef17d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '23861c9a343c4b95b71a2415d0a28f37', 'request_id': 'req-301d7c1c-8c90-47e7-a2dd-956d155ef17d'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:34:53.545324 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-301d7c1c-8c90-47e7-a2dd-956d155ef17d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '23861c9a343c4b95b71a2415d0a28f37', 'request_id': 'req-301d7c1c-8c90-47e7-a2dd-956d155ef17d'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:34:53.557526 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-301d7c1c-8c90-47e7-a2dd-956d155ef17d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '23861c9a343c4b95b71a2415d0a28f37', 'request_id': 'req-301d7c1c-8c90-47e7-a2dd-956d155ef17d'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:34:53.577311 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-301d7c1c-8c90-47e7-a2dd-956d155ef17d admin admin] The token cache is being invalidate because project 23861c9a343c4b95b71a2415d0a28f37 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81362) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 02:34:53.577706 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-301d7c1c-8c90-47e7-a2dd-956d155ef17d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:34:53.578662 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-301d7c1c-8c90-47e7-a2dd-956d155ef17d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:34:53.580212 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1133/2265] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Oct 12 02:34:53 2022] DELETE /identity/v3/projects/23861c9a343c4b95b71a2415d0a28f37 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 02:34:53.585422 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04fc172-e944-41b3-b826-8c9ca1dc443b None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:34:53.585973 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04fc172-e944-41b3-b826-8c9ca1dc443b None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:34:53.585973 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04fc172-e944-41b3-b826-8c9ca1dc443b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:34:53.608329 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-c04fc172-e944-41b3-b826-8c9ca1dc443b None None] MFA Rules not processed for user `a326a5bb7364479382f528a592371656`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:34:53.609604 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-c04fc172-e944-41b3-b826-8c9ca1dc443b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:34:53.695913 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1133/2266] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 02:34:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 02:34:53.705605 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb38e9e0-5816-4692-afad-a01e7c2b52b2 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:34:53.705887 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb38e9e0-5816-4692-afad-a01e7c2b52b2 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:34:53.706264 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb38e9e0-5816-4692-afad-a01e7c2b52b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:34:53.738088 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04fc172-e944-41b3-b826-8c9ca1dc443b None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:34:53.739352 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-fb38e9e0-5816-4692-afad-a01e7c2b52b2 None None] MFA Rules not processed for user `a326a5bb7364479382f528a592371656`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:34:53.739755 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-c04fc172-e944-41b3-b826-8c9ca1dc443b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:34:53.741002 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-fb38e9e0-5816-4692-afad-a01e7c2b52b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:34:53.755063 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1134/2267] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 02:34:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 02:34:53.756443 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb38e9e0-5816-4692-afad-a01e7c2b52b2 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:34:53.766527 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04fc172-e944-41b3-b826-8c9ca1dc443b None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:34:53.768077 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb38e9e0-5816-4692-afad-a01e7c2b52b2 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:34:53.776398 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc07d63-db9e-4240-88d3-9f57f43b8306 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:34:53.779160 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc07d63-db9e-4240-88d3-9f57f43b8306 admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:34:53.779681 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc07d63-db9e-4240-88d3-9f57f43b8306 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:34:53.780640 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc07d63-db9e-4240-88d3-9f57f43b8306 admin admin] PATH_INFO: `/v3/domains` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:34:53.782690 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc07d63-db9e-4240-88d3-9f57f43b8306 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 02:34:53.783193 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151207e9-c58b-4740-9254-a8aa76e1b5e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:34:53.784023 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc07d63-db9e-4240-88d3-9f57f43b8306 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:34:53.785015 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151207e9-c58b-4740-9254-a8aa76e1b5e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:34:53.786252 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151207e9-c58b-4740-9254-a8aa76e1b5e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:34:53.787662 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc07d63-db9e-4240-88d3-9f57f43b8306 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:34:53.788319 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151207e9-c58b-4740-9254-a8aa76e1b5e2 admin admin] PATH_INFO: `/v3/users/df121323c1ae4956be7e2bc37a2a6df1` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:34:53.791177 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151207e9-c58b-4740-9254-a8aa76e1b5e2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=df121323c1ae4956be7e2bc37a2a6df1)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:34:53.797006 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151207e9-c58b-4740-9254-a8aa76e1b5e2 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:34:53.834092 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1135/2268] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Oct 12 02:34:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 02:34:53.834330 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc07d63-db9e-4240-88d3-9f57f43b8306 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:34:53.857092 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc07d63-db9e-4240-88d3-9f57f43b8306 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:34:53.865937 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cdf8bf-91fa-443f-bf83-245e359bce74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:34:53.867143 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cdf8bf-91fa-443f-bf83-245e359bce74 admin admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:34:53.869388 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cdf8bf-91fa-443f-bf83-245e359bce74 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:34:53.870625 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cdf8bf-91fa-443f-bf83-245e359bce74 admin admin] PATH_INFO: `/v3/projects` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:34:53.871521 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3cdf8bf-91fa-443f-bf83-245e359bce74 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:34:53.875319 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3cdf8bf-91fa-443f-bf83-245e359bce74 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:34:53.904553 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-151207e9-c58b-4740-9254-a8aa76e1b5e2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'df121323c1ae4956be7e2bc37a2a6df1'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:34:53.916579 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-151207e9-c58b-4740-9254-a8aa76e1b5e2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'df121323c1ae4956be7e2bc37a2a6df1'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:34:53.925733 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1136/2269] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Oct 12 02:34:53 2022] POST /identity/v3/projects => generated 373 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 02:34:53.930601 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cdf8bf-91fa-443f-bf83-245e359bce74 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:34:53.948009 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-151207e9-c58b-4740-9254-a8aa76e1b5e2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'df121323c1ae4956be7e2bc37a2a6df1'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:34:53.956067 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-151207e9-c58b-4740-9254-a8aa76e1b5e2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'df121323c1ae4956be7e2bc37a2a6df1'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:34:53.957008 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-151207e9-c58b-4740-9254-a8aa76e1b5e2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'df121323c1ae4956be7e2bc37a2a6df1'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:34:53.964118 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1134/2270] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Oct 12 02:34:53 2022] DELETE /identity/v3/users/df121323c1ae4956be7e2bc37a2a6df1 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 02:34:53.968152 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79364d3-77c0-4999-820a-6b3bf71fcf7e None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:34:53.968579 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79364d3-77c0-4999-820a-6b3bf71fcf7e None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:34:53.968960 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79364d3-77c0-4999-820a-6b3bf71fcf7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:34:53.992984 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-a79364d3-77c0-4999-820a-6b3bf71fcf7e None None] MFA Rules not processed for user `a326a5bb7364479382f528a592371656`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:34:53.995922 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-a79364d3-77c0-4999-820a-6b3bf71fcf7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:34:54.046578 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cdf8bf-91fa-443f-bf83-245e359bce74 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:34:54.074162 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1135/2271] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 02:34:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 02:34:54.090405 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79364d3-77c0-4999-820a-6b3bf71fcf7e None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:34:54.093833 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-a79364d3-77c0-4999-820a-6b3bf71fcf7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:34:54.112053 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:34:54.180339 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd078da3-2998-4090-b963-ca1b44021b74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:34:54.181015 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd078da3-2998-4090-b963-ca1b44021b74 admin admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:34:54.181296 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd078da3-2998-4090-b963-ca1b44021b74 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:34:54.181570 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd078da3-2998-4090-b963-ca1b44021b74 admin admin] PATH_INFO: `/v3/users` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:34:54.182215 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd078da3-2998-4090-b963-ca1b44021b74 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:34:54.184147 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd078da3-2998-4090-b963-ca1b44021b74 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:34:54.190022 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79364d3-77c0-4999-820a-6b3bf71fcf7e None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:34:54.194210 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb7af25-160d-4a51-8f43-680d65f7539c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5223b5cab3114e9b9a13c582f8ef8386', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'beb6def6fcad45959e56425bb8bff4d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:34:54.194957 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb7af25-160d-4a51-8f43-680d65f7539c service neutron] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:34:54.195343 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb7af25-160d-4a51-8f43-680d65f7539c service neutron] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:34:54.195717 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb7af25-160d-4a51-8f43-680d65f7539c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:34:54.209295 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb7af25-160d-4a51-8f43-680d65f7539c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:34:54.211410 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb7af25-160d-4a51-8f43-680d65f7539c service neutron] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:34:54.220764 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1137/2272] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Oct 12 02:34:53 2022] POST /identity/v3/users => generated 287 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 02:34:54.225804 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd078da3-2998-4090-b963-ca1b44021b74 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:34:54.227416 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1136/2273] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 02:34:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 02:34:54.232682 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-cd078da3-2998-4090-b963-ca1b44021b74 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:34:54.249136 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd078da3-2998-4090-b963-ca1b44021b74 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:34:54.258113 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ca96e2-c723-47a6-9e7f-d4256d283a0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:34:54.258648 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ca96e2-c723-47a6-9e7f-d4256d283a0f admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:34:54.258927 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ca96e2-c723-47a6-9e7f-d4256d283a0f admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:34:54.259192 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ca96e2-c723-47a6-9e7f-d4256d283a0f admin admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:34:54.259891 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ca96e2-c723-47a6-9e7f-d4256d283a0f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:34:54.261577 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ca96e2-c723-47a6-9e7f-d4256d283a0f admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:34:54.273203 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1138/2274] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Oct 12 02:34:54 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 02:34:54.276792 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb7af25-160d-4a51-8f43-680d65f7539c service neutron] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:34:54.290898 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb7af25-160d-4a51-8f43-680d65f7539c service neutron] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:34:54.295671 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91be0aeb-eb0d-4177-9829-74307ed0d01e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:34:54.296854 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91be0aeb-eb0d-4177-9829-74307ed0d01e admin admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:34:54.296854 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91be0aeb-eb0d-4177-9829-74307ed0d01e admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:34:54.297076 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91be0aeb-eb0d-4177-9829-74307ed0d01e admin admin] PATH_INFO: `/v3/roles` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:34:54.297581 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91be0aeb-eb0d-4177-9829-74307ed0d01e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:34:54.303698 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91be0aeb-eb0d-4177-9829-74307ed0d01e admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:34:54.314401 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1137/2275] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Oct 12 02:34:54 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 02:34:54.319850 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ca96e2-c723-47a6-9e7f-d4256d283a0f admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:34:54.335588 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ca96e2-c723-47a6-9e7f-d4256d283a0f admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:34:54.344511 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce61484-4695-48ad-93e9-c5b751d075c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:34:54.346341 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce61484-4695-48ad-93e9-c5b751d075c0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:34:54.346923 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce61484-4695-48ad-93e9-c5b751d075c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:34:54.347191 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce61484-4695-48ad-93e9-c5b751d075c0 admin admin] PATH_INFO: `/v3/projects/b1afa23825884629ae6db6793196f12d/users/51777b496e804bb58fb21ae38479da98/roles/3d75c4d7f1a849b9a771504d1583ab28` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:34:54.364133 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=91,keystone:DELETE=4,keystone:INSERT=5 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:34:54.372617 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce61484-4695-48ad-93e9-c5b751d075c0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b1afa23825884629ae6db6793196f12d, user_id=51777b496e804bb58fb21ae38479da98, role_id=3d75c4d7f1a849b9a771504d1583ab28)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:34:54.380120 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce61484-4695-48ad-93e9-c5b751d075c0 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:34:54.416873 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1139/2276] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Oct 12 02:34:54 2022] PUT /identity/v3/projects/b1afa23825884629ae6db6793196f12d/users/51777b496e804bb58fb21ae38479da98/roles/3d75c4d7f1a849b9a771504d1583ab28 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 02:34:54.429155 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c20f570-1289-498e-a00f-f1a126debd6b None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:34:54.429491 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c20f570-1289-498e-a00f-f1a126debd6b None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:34:54.429775 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c20f570-1289-498e-a00f-f1a126debd6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:34:54.472309 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-4c20f570-1289-498e-a00f-f1a126debd6b None None] MFA Rules not processed for user `51777b496e804bb58fb21ae38479da98`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:34:54.474213 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-4c20f570-1289-498e-a00f-f1a126debd6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:34:54.642550 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1138/2277] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 02:34:54 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 02:34:54.655793 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce61484-4695-48ad-93e9-c5b751d075c0 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:34:54.659387 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-4ce61484-4695-48ad-93e9-c5b751d075c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:34:54.761424 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c20f570-1289-498e-a00f-f1a126debd6b None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:34:54.762619 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce61484-4695-48ad-93e9-c5b751d075c0 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:34:54.762999 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-4c20f570-1289-498e-a00f-f1a126debd6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:34:54.770749 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e076f22-202e-4bf0-8c48-6d8347ff5e57 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fca96c111b45b795fb757f77908ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'beb6def6fcad45959e56425bb8bff4d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:34:54.771977 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e076f22-202e-4bf0-8c48-6d8347ff5e57 service nova] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:34:54.772257 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e076f22-202e-4bf0-8c48-6d8347ff5e57 service nova] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:34:54.772728 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e076f22-202e-4bf0-8c48-6d8347ff5e57 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:34:54.783481 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e076f22-202e-4bf0-8c48-6d8347ff5e57 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:34:54.785194 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e076f22-202e-4bf0-8c48-6d8347ff5e57 service nova] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:34:54.803936 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1140/2278] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 02:34:54 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 02:34:54.874833 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c20f570-1289-498e-a00f-f1a126debd6b None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:34:54.880222 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f7a981-1c2a-499a-9fdb-71f78b91960d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:34:54.880885 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f7a981-1c2a-499a-9fdb-71f78b91960d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:34:54.881191 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f7a981-1c2a-499a-9fdb-71f78b91960d admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:34:54.881479 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f7a981-1c2a-499a-9fdb-71f78b91960d admin admin] PATH_INFO: `/v3/projects/3a73109ad2a04472983b6755e1af9d46` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:34:54.882634 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f7a981-1c2a-499a-9fdb-71f78b91960d admin admin] RBAC: Authorizing `identity:delete_project(project_id=3a73109ad2a04472983b6755e1af9d46)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:34:54.884617 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f7a981-1c2a-499a-9fdb-71f78b91960d admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:34:54.925107 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:34:54.945544 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-f8f7a981-1c2a-499a-9fdb-71f78b91960d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3a73109ad2a04472983b6755e1af9d46', 'request_id': 'req-f8f7a981-1c2a-499a-9fdb-71f78b91960d'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:34:54.952508 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-f8f7a981-1c2a-499a-9fdb-71f78b91960d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3a73109ad2a04472983b6755e1af9d46', 'request_id': 'req-f8f7a981-1c2a-499a-9fdb-71f78b91960d'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:34:54.965844 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-f8f7a981-1c2a-499a-9fdb-71f78b91960d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3a73109ad2a04472983b6755e1af9d46', 'request_id': 'req-f8f7a981-1c2a-499a-9fdb-71f78b91960d'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:34:54.983147 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-f8f7a981-1c2a-499a-9fdb-71f78b91960d admin admin] The token cache is being invalidate because project 3a73109ad2a04472983b6755e1af9d46 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81361) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 02:34:54.983543 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-f8f7a981-1c2a-499a-9fdb-71f78b91960d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:34:54.984182 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-f8f7a981-1c2a-499a-9fdb-71f78b91960d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:34:54.985703 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1139/2279] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Oct 12 02:34:54 2022] DELETE /identity/v3/projects/3a73109ad2a04472983b6755e1af9d46 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 02:34:54.989792 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e076f22-202e-4bf0-8c48-6d8347ff5e57 service nova] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:34:55.002990 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e076f22-202e-4bf0-8c48-6d8347ff5e57 service nova] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:34:55.069889 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b996c6-b7b7-4348-a5b4-b6218cb01eb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:34:55.070523 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b996c6-b7b7-4348-a5b4-b6218cb01eb4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:34:55.070799 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b996c6-b7b7-4348-a5b4-b6218cb01eb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:34:55.071066 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b996c6-b7b7-4348-a5b4-b6218cb01eb4 admin admin] PATH_INFO: `/v3/users/7078be2d7de74cf2870aee98ec7b8b50` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:34:55.072191 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b996c6-b7b7-4348-a5b4-b6218cb01eb4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7078be2d7de74cf2870aee98ec7b8b50)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:34:55.074120 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b996c6-b7b7-4348-a5b4-b6218cb01eb4 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:34:55.131132 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-17b996c6-b7b7-4348-a5b4-b6218cb01eb4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7078be2d7de74cf2870aee98ec7b8b50'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:34:55.141875 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-17b996c6-b7b7-4348-a5b4-b6218cb01eb4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7078be2d7de74cf2870aee98ec7b8b50'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:34:55.157890 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-17b996c6-b7b7-4348-a5b4-b6218cb01eb4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7078be2d7de74cf2870aee98ec7b8b50'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:34:55.172802 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:34:55.175061 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-17b996c6-b7b7-4348-a5b4-b6218cb01eb4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7078be2d7de74cf2870aee98ec7b8b50'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:34:55.176015 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-17b996c6-b7b7-4348-a5b4-b6218cb01eb4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7078be2d7de74cf2870aee98ec7b8b50'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:34:55.184084 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1141/2280] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Oct 12 02:34:54 2022] DELETE /identity/v3/users/7078be2d7de74cf2870aee98ec7b8b50 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 02:34:55.468348 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f7a981-1c2a-499a-9fdb-71f78b91960d admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:34:55.469799 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-f8f7a981-1c2a-499a-9fdb-71f78b91960d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:34:55.485633 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f7a981-1c2a-499a-9fdb-71f78b91960d admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:34:55.554664 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a7777e-0d52-4a86-a23c-b8f76dfbc4d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:34:55.555399 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a7777e-0d52-4a86-a23c-b8f76dfbc4d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:34:55.555680 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a7777e-0d52-4a86-a23c-b8f76dfbc4d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:34:55.555995 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a7777e-0d52-4a86-a23c-b8f76dfbc4d4 admin admin] PATH_INFO: `/v3/projects/ce4832ca4e224cc1bd47f1906f742073` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:34:55.557333 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a7777e-0d52-4a86-a23c-b8f76dfbc4d4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ce4832ca4e224cc1bd47f1906f742073)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:34:55.559266 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a7777e-0d52-4a86-a23c-b8f76dfbc4d4 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:34:55.606338 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-b2a7777e-0d52-4a86-a23c-b8f76dfbc4d4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ce4832ca4e224cc1bd47f1906f742073', 'request_id': 'req-b2a7777e-0d52-4a86-a23c-b8f76dfbc4d4'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:34:55.611929 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-b2a7777e-0d52-4a86-a23c-b8f76dfbc4d4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ce4832ca4e224cc1bd47f1906f742073', 'request_id': 'req-b2a7777e-0d52-4a86-a23c-b8f76dfbc4d4'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:34:55.619050 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-b2a7777e-0d52-4a86-a23c-b8f76dfbc4d4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ce4832ca4e224cc1bd47f1906f742073', 'request_id': 'req-b2a7777e-0d52-4a86-a23c-b8f76dfbc4d4'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:34:55.632301 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-b2a7777e-0d52-4a86-a23c-b8f76dfbc4d4 admin admin] The token cache is being invalidate because project ce4832ca4e224cc1bd47f1906f742073 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81361) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 02:34:55.632621 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-b2a7777e-0d52-4a86-a23c-b8f76dfbc4d4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:34:55.633239 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-b2a7777e-0d52-4a86-a23c-b8f76dfbc4d4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:34:55.634710 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1140/2281] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Oct 12 02:34:55 2022] DELETE /identity/v3/projects/ce4832ca4e224cc1bd47f1906f742073 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 02:34:55.639846 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400c5ac7-1564-4f7f-ad94-56d747566477 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:34:55.640137 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400c5ac7-1564-4f7f-ad94-56d747566477 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:34:55.640412 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400c5ac7-1564-4f7f-ad94-56d747566477 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:34:55.661111 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-400c5ac7-1564-4f7f-ad94-56d747566477 None None] MFA Rules not processed for user `a326a5bb7364479382f528a592371656`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:34:55.662477 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-400c5ac7-1564-4f7f-ad94-56d747566477 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:34:55.724072 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1142/2282] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 02:34:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 02:34:55.733604 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1814d70d-3e94-42cb-a131-41515a040cf3 None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:34:55.734163 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1814d70d-3e94-42cb-a131-41515a040cf3 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:34:55.734282 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1814d70d-3e94-42cb-a131-41515a040cf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:34:55.755823 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-1814d70d-3e94-42cb-a131-41515a040cf3 None None] MFA Rules not processed for user `a326a5bb7364479382f528a592371656`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:34:55.757109 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-1814d70d-3e94-42cb-a131-41515a040cf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:34:55.765128 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1141/2283] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 02:34:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 02:34:55.769591 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400c5ac7-1564-4f7f-ad94-56d747566477 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:34:55.780051 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400c5ac7-1564-4f7f-ad94-56d747566477 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:34:55.784761 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a881b4a-e77b-4830-9b83-ebb191883617 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:34:55.785924 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a881b4a-e77b-4830-9b83-ebb191883617 admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:34:55.786235 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a881b4a-e77b-4830-9b83-ebb191883617 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:34:55.786522 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a881b4a-e77b-4830-9b83-ebb191883617 admin admin] PATH_INFO: `/v3/domains` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:34:55.787195 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a881b4a-e77b-4830-9b83-ebb191883617 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 02:34:55.787498 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a881b4a-e77b-4830-9b83-ebb191883617 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:34:55.789149 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a881b4a-e77b-4830-9b83-ebb191883617 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:34:55.805774 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1143/2284] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Oct 12 02:34:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 02:34:55.807283 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1814d70d-3e94-42cb-a131-41515a040cf3 None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:34:55.817971 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1814d70d-3e94-42cb-a131-41515a040cf3 None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:34:55.822969 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88c0f02-7793-4d26-8fc0-14f4aa76b537 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:34:55.823589 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88c0f02-7793-4d26-8fc0-14f4aa76b537 admin admin] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:34:55.823868 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88c0f02-7793-4d26-8fc0-14f4aa76b537 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:34:55.824278 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88c0f02-7793-4d26-8fc0-14f4aa76b537 admin admin] PATH_INFO: `/v3/projects` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:34:55.824996 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88c0f02-7793-4d26-8fc0-14f4aa76b537 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:34:55.826944 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88c0f02-7793-4d26-8fc0-14f4aa76b537 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:34:55.859930 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1142/2285] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Oct 12 02:34:55 2022] POST /identity/v3/projects => generated 373 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 02:34:55.861412 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a881b4a-e77b-4830-9b83-ebb191883617 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:34:55.874381 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a881b4a-e77b-4830-9b83-ebb191883617 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:34:55.934472 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d03ec6-55c0-4f8a-a5fe-20d0efba8a1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:34:55.935236 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d03ec6-55c0-4f8a-a5fe-20d0efba8a1e admin admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:34:55.935514 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d03ec6-55c0-4f8a-a5fe-20d0efba8a1e admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:34:55.935787 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d03ec6-55c0-4f8a-a5fe-20d0efba8a1e admin admin] PATH_INFO: `/v3/users` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:34:55.936438 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d03ec6-55c0-4f8a-a5fe-20d0efba8a1e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:34:55.938462 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d03ec6-55c0-4f8a-a5fe-20d0efba8a1e admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:34:55.965294 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1144/2286] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Oct 12 02:34:55 2022] POST /identity/v3/users => generated 287 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 02:34:55.966782 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88c0f02-7793-4d26-8fc0-14f4aa76b537 admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:34:55.977963 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88c0f02-7793-4d26-8fc0-14f4aa76b537 admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:34:55.983383 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34a880c-8dc0-494f-908c-cc0e545163e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:34:55.983987 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34a880c-8dc0-494f-908c-cc0e545163e7 admin admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:34:55.984265 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34a880c-8dc0-494f-908c-cc0e545163e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:34:55.984568 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34a880c-8dc0-494f-908c-cc0e545163e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:34:55.985211 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34a880c-8dc0-494f-908c-cc0e545163e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:34:55.986803 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34a880c-8dc0-494f-908c-cc0e545163e7 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:34:55.997910 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1143/2287] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Oct 12 02:34:55 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 02:34:56.001806 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d03ec6-55c0-4f8a-a5fe-20d0efba8a1e admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:34:56.012443 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d03ec6-55c0-4f8a-a5fe-20d0efba8a1e admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:34:56.017122 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907f9dbe-cba2-43cd-9c7d-0067581bcf3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:34:56.017717 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907f9dbe-cba2-43cd-9c7d-0067581bcf3e admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:34:56.018000 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907f9dbe-cba2-43cd-9c7d-0067581bcf3e admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:34:56.018277 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907f9dbe-cba2-43cd-9c7d-0067581bcf3e admin admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:34:56.018914 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907f9dbe-cba2-43cd-9c7d-0067581bcf3e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:34:56.020653 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907f9dbe-cba2-43cd-9c7d-0067581bcf3e admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:34:56.031197 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1145/2288] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Oct 12 02:34:56 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 02:34:56.035747 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34a880c-8dc0-494f-908c-cc0e545163e7 admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:34:56.042146 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:DELETE=13,keystone:SELECT=84,keystone:INSERT=3 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:34:56.046171 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34a880c-8dc0-494f-908c-cc0e545163e7 admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:34:56.052911 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0542df2-4d74-4fbe-8326-9b5fe800b884 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:34:56.053964 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0542df2-4d74-4fbe-8326-9b5fe800b884 admin admin] REQUEST_METHOD: `PUT` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:34:56.054362 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0542df2-4d74-4fbe-8326-9b5fe800b884 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:34:56.054665 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0542df2-4d74-4fbe-8326-9b5fe800b884 admin admin] PATH_INFO: `/v3/projects/6536908d430c46c6a9ef6368c1f40365/users/ddefe6e08a9145daa71e35ef3f1ae1e6/roles/3d75c4d7f1a849b9a771504d1583ab28` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:34:56.070155 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0542df2-4d74-4fbe-8326-9b5fe800b884 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6536908d430c46c6a9ef6368c1f40365, user_id=ddefe6e08a9145daa71e35ef3f1ae1e6, role_id=3d75c4d7f1a849b9a771504d1583ab28)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:34:56.072785 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0542df2-4d74-4fbe-8326-9b5fe800b884 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:34:56.085140 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1144/2289] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Oct 12 02:34:56 2022] PUT /identity/v3/projects/6536908d430c46c6a9ef6368c1f40365/users/ddefe6e08a9145daa71e35ef3f1ae1e6/roles/3d75c4d7f1a849b9a771504d1583ab28 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 02:34:56.095357 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88202f1-2f04-44fd-b2e4-667bb963b5c1 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:34:56.095646 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88202f1-2f04-44fd-b2e4-667bb963b5c1 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:34:56.095919 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88202f1-2f04-44fd-b2e4-667bb963b5c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:34:56.123664 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-d88202f1-2f04-44fd-b2e4-667bb963b5c1 None None] MFA Rules not processed for user `ddefe6e08a9145daa71e35ef3f1ae1e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:34:56.124898 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-d88202f1-2f04-44fd-b2e4-667bb963b5c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:34:56.171974 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:34:56.190054 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1146/2290] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 02:34:56 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 02:34:56.201548 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0542df2-4d74-4fbe-8326-9b5fe800b884 admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:34:56.203325 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-f0542df2-4d74-4fbe-8326-9b5fe800b884 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:34:56.263297 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0542df2-4d74-4fbe-8326-9b5fe800b884 admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:34:56.266987 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76eaa529-d039-4c7a-8c60-833e297cce09 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ba688e0c4d44d13898539ee886f95fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'beb6def6fcad45959e56425bb8bff4d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:34:56.267576 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76eaa529-d039-4c7a-8c60-833e297cce09 service cinder] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:34:56.267856 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76eaa529-d039-4c7a-8c60-833e297cce09 service cinder] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:34:56.268129 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76eaa529-d039-4c7a-8c60-833e297cce09 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:34:56.276927 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76eaa529-d039-4c7a-8c60-833e297cce09 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:34:56.278375 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76eaa529-d039-4c7a-8c60-833e297cce09 service cinder] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:34:56.287443 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1145/2291] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 02:34:56 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 02:34:56.309592 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88202f1-2f04-44fd-b2e4-667bb963b5c1 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:34:56.374133 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88202f1-2f04-44fd-b2e4-667bb963b5c1 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:34:56.378728 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bd282c-263e-465f-b5da-cf46f9e90ec4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:34:56.379724 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bd282c-263e-465f-b5da-cf46f9e90ec4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:34:56.380001 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bd282c-263e-465f-b5da-cf46f9e90ec4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:34:56.380273 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bd282c-263e-465f-b5da-cf46f9e90ec4 admin admin] PATH_INFO: `/v3/users/ddefe6e08a9145daa71e35ef3f1ae1e6` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:34:56.381540 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6bd282c-263e-465f-b5da-cf46f9e90ec4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ddefe6e08a9145daa71e35ef3f1ae1e6)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:34:56.383463 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6bd282c-263e-465f-b5da-cf46f9e90ec4 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:34:56.432575 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-f6bd282c-263e-465f-b5da-cf46f9e90ec4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ddefe6e08a9145daa71e35ef3f1ae1e6'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:34:56.440769 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-f6bd282c-263e-465f-b5da-cf46f9e90ec4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ddefe6e08a9145daa71e35ef3f1ae1e6'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:34:56.454728 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-f6bd282c-263e-465f-b5da-cf46f9e90ec4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ddefe6e08a9145daa71e35ef3f1ae1e6'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:34:56.462466 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-f6bd282c-263e-465f-b5da-cf46f9e90ec4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ddefe6e08a9145daa71e35ef3f1ae1e6'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:34:56.463181 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-f6bd282c-263e-465f-b5da-cf46f9e90ec4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ddefe6e08a9145daa71e35ef3f1ae1e6'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:34:56.469524 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1147/2292] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Oct 12 02:34:56 2022] DELETE /identity/v3/users/ddefe6e08a9145daa71e35ef3f1ae1e6 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 02:34:56.476226 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07017ce8-9129-46af-a3eb-a88492c8078f None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:34:56.476226 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07017ce8-9129-46af-a3eb-a88492c8078f None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:34:56.476226 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07017ce8-9129-46af-a3eb-a88492c8078f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:34:56.495792 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-07017ce8-9129-46af-a3eb-a88492c8078f None None] MFA Rules not processed for user `a326a5bb7364479382f528a592371656`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:34:56.497003 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-07017ce8-9129-46af-a3eb-a88492c8078f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:34:56.559535 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1146/2293] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 02:34:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 02:34:56.569962 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bd282c-263e-465f-b5da-cf46f9e90ec4 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:34:56.571398 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-f6bd282c-263e-465f-b5da-cf46f9e90ec4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:34:56.631569 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bd282c-263e-465f-b5da-cf46f9e90ec4 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:34:56.635210 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fb2f52-e120-4950-a188-593aea534a85 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5223b5cab3114e9b9a13c582f8ef8386', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'beb6def6fcad45959e56425bb8bff4d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:34:56.635808 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fb2f52-e120-4950-a188-593aea534a85 service neutron] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:34:56.636086 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fb2f52-e120-4950-a188-593aea534a85 service neutron] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:34:56.636359 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fb2f52-e120-4950-a188-593aea534a85 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:34:56.645529 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0fb2f52-e120-4950-a188-593aea534a85 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:34:56.646940 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0fb2f52-e120-4950-a188-593aea534a85 service neutron] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:34:56.656460 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1148/2294] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 02:34:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 02:34:56.918707 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07017ce8-9129-46af-a3eb-a88492c8078f None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:34:56.920236 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-07017ce8-9129-46af-a3eb-a88492c8078f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:34:56.933006 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07017ce8-9129-46af-a3eb-a88492c8078f None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:34:56.937687 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c32a58c-4f73-4ce2-8d23-5937af5f85c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:34:56.938315 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c32a58c-4f73-4ce2-8d23-5937af5f85c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:34:56.938588 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c32a58c-4f73-4ce2-8d23-5937af5f85c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:34:56.939305 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c32a58c-4f73-4ce2-8d23-5937af5f85c7 admin admin] PATH_INFO: `/v3/projects/6536908d430c46c6a9ef6368c1f40365` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:34:56.940112 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c32a58c-4f73-4ce2-8d23-5937af5f85c7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6536908d430c46c6a9ef6368c1f40365)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:34:56.942894 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c32a58c-4f73-4ce2-8d23-5937af5f85c7 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:34:56.990156 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-0c32a58c-4f73-4ce2-8d23-5937af5f85c7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6536908d430c46c6a9ef6368c1f40365', 'request_id': 'req-0c32a58c-4f73-4ce2-8d23-5937af5f85c7'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:34:56.995578 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-0c32a58c-4f73-4ce2-8d23-5937af5f85c7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6536908d430c46c6a9ef6368c1f40365', 'request_id': 'req-0c32a58c-4f73-4ce2-8d23-5937af5f85c7'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:34:57.001784 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-0c32a58c-4f73-4ce2-8d23-5937af5f85c7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6536908d430c46c6a9ef6368c1f40365', 'request_id': 'req-0c32a58c-4f73-4ce2-8d23-5937af5f85c7'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:34:57.015624 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-0c32a58c-4f73-4ce2-8d23-5937af5f85c7 admin admin] The token cache is being invalidate because project 6536908d430c46c6a9ef6368c1f40365 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81361) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 02:34:57.015935 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-0c32a58c-4f73-4ce2-8d23-5937af5f85c7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:34:57.016600 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-0c32a58c-4f73-4ce2-8d23-5937af5f85c7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:34:57.018325 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1147/2295] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Oct 12 02:34:56 2022] DELETE /identity/v3/projects/6536908d430c46c6a9ef6368c1f40365 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 02:34:57.022925 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9dbd73-d3ec-482f-ab0c-969688dd2996 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:34:57.023401 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9dbd73-d3ec-482f-ab0c-969688dd2996 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:34:57.023505 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9dbd73-d3ec-482f-ab0c-969688dd2996 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:34:57.043850 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-2f9dbd73-d3ec-482f-ab0c-969688dd2996 None None] MFA Rules not processed for user `a326a5bb7364479382f528a592371656`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:34:57.045267 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-2f9dbd73-d3ec-482f-ab0c-969688dd2996 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:34:57.054689 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:34:57.110200 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1149/2296] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 02:34:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 02:34:57.118796 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e298d1c-52ca-443c-ae08-4ff3d9277461 None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:34:57.119196 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e298d1c-52ca-443c-ae08-4ff3d9277461 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:34:57.119565 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e298d1c-52ca-443c-ae08-4ff3d9277461 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:34:57.134267 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:34:57.140968 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-3e298d1c-52ca-443c-ae08-4ff3d9277461 None None] MFA Rules not processed for user `a326a5bb7364479382f528a592371656`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:34:57.142985 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-3e298d1c-52ca-443c-ae08-4ff3d9277461 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:34:57.151397 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1148/2297] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 02:34:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 02:34:57.155947 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9dbd73-d3ec-482f-ab0c-969688dd2996 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:34:57.166937 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9dbd73-d3ec-482f-ab0c-969688dd2996 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:34:57.172306 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecf4a1b-4e68-41e2-8c73-ea6e572716d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:34:57.173015 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecf4a1b-4e68-41e2-8c73-ea6e572716d7 admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:34:57.173292 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecf4a1b-4e68-41e2-8c73-ea6e572716d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:34:57.173561 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecf4a1b-4e68-41e2-8c73-ea6e572716d7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:34:57.174204 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ecf4a1b-4e68-41e2-8c73-ea6e572716d7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 02:34:57.174501 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ecf4a1b-4e68-41e2-8c73-ea6e572716d7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:34:57.176742 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ecf4a1b-4e68-41e2-8c73-ea6e572716d7 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:34:57.192498 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1150/2298] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Oct 12 02:34:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 02:34:57.193831 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e298d1c-52ca-443c-ae08-4ff3d9277461 None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:34:57.202957 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e298d1c-52ca-443c-ae08-4ff3d9277461 None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:34:57.207729 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8543dcd7-7d8c-4d49-82b2-461cd08c218f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:34:57.208094 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8543dcd7-7d8c-4d49-82b2-461cd08c218f admin admin] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:34:57.208369 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8543dcd7-7d8c-4d49-82b2-461cd08c218f admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:34:57.208709 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8543dcd7-7d8c-4d49-82b2-461cd08c218f admin admin] PATH_INFO: `/v3/projects` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:34:57.209332 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8543dcd7-7d8c-4d49-82b2-461cd08c218f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:34:57.211242 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8543dcd7-7d8c-4d49-82b2-461cd08c218f admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:34:57.239661 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1149/2299] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Oct 12 02:34:57 2022] POST /identity/v3/projects => generated 363 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 02:34:57.244255 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecf4a1b-4e68-41e2-8c73-ea6e572716d7 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:34:57.254926 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecf4a1b-4e68-41e2-8c73-ea6e572716d7 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:34:57.311082 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d028624-90a6-4be0-87ba-74dd452bcf03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:34:57.311701 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d028624-90a6-4be0-87ba-74dd452bcf03 admin admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:34:57.311976 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d028624-90a6-4be0-87ba-74dd452bcf03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:34:57.312246 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d028624-90a6-4be0-87ba-74dd452bcf03 admin admin] PATH_INFO: `/v3/users` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:34:57.312959 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d028624-90a6-4be0-87ba-74dd452bcf03 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:34:57.314898 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d028624-90a6-4be0-87ba-74dd452bcf03 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:34:57.335795 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1151/2300] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Oct 12 02:34:57 2022] POST /identity/v3/users => generated 282 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 02:34:57.339913 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8543dcd7-7d8c-4d49-82b2-461cd08c218f admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:34:57.350586 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8543dcd7-7d8c-4d49-82b2-461cd08c218f admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:34:57.356717 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200c3475-5fbc-430d-9b64-aa7ababf59d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:34:57.357439 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200c3475-5fbc-430d-9b64-aa7ababf59d8 admin admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:34:57.357783 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200c3475-5fbc-430d-9b64-aa7ababf59d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:34:57.358326 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200c3475-5fbc-430d-9b64-aa7ababf59d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:34:57.358821 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200c3475-5fbc-430d-9b64-aa7ababf59d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:34:57.360589 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200c3475-5fbc-430d-9b64-aa7ababf59d8 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:34:57.371801 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1150/2301] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Oct 12 02:34:57 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 12 02:34:57.375652 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d028624-90a6-4be0-87ba-74dd452bcf03 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:34:57.386235 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d028624-90a6-4be0-87ba-74dd452bcf03 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:34:57.390876 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56afea8f-7f5d-4709-8117-097b85690682 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:34:57.391480 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56afea8f-7f5d-4709-8117-097b85690682 admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:34:57.391775 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56afea8f-7f5d-4709-8117-097b85690682 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:34:57.392063 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56afea8f-7f5d-4709-8117-097b85690682 admin admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:34:57.392732 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56afea8f-7f5d-4709-8117-097b85690682 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:34:57.394304 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56afea8f-7f5d-4709-8117-097b85690682 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:34:57.404977 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1152/2302] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Oct 12 02:34:57 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 12 02:34:57.409132 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200c3475-5fbc-430d-9b64-aa7ababf59d8 admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:34:57.420012 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200c3475-5fbc-430d-9b64-aa7ababf59d8 admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:34:57.424582 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db70e593-2650-4dbb-ba72-6bd4873f6112 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:34:57.425228 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db70e593-2650-4dbb-ba72-6bd4873f6112 admin admin] REQUEST_METHOD: `PUT` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:34:57.425505 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db70e593-2650-4dbb-ba72-6bd4873f6112 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:34:57.425915 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db70e593-2650-4dbb-ba72-6bd4873f6112 admin admin] PATH_INFO: `/v3/projects/20f5d854fac44e0b9462d7b9c918ff00/users/03fc1d26ad7d482088cb04249170b9b2/roles/3d75c4d7f1a849b9a771504d1583ab28` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:34:57.441049 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db70e593-2650-4dbb-ba72-6bd4873f6112 admin admin] RBAC: Authorizing `identity:create_grant(project_id=20f5d854fac44e0b9462d7b9c918ff00, user_id=03fc1d26ad7d482088cb04249170b9b2, role_id=3d75c4d7f1a849b9a771504d1583ab28)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:34:57.444378 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db70e593-2650-4dbb-ba72-6bd4873f6112 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:34:57.459383 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1151/2303] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Oct 12 02:34:57 2022] PUT /identity/v3/projects/20f5d854fac44e0b9462d7b9c918ff00/users/03fc1d26ad7d482088cb04249170b9b2/roles/3d75c4d7f1a849b9a771504d1583ab28 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 02:34:57.470522 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b35f2e4-2aaa-42b1-b56b-464983dadb3d None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:34:57.470805 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b35f2e4-2aaa-42b1-b56b-464983dadb3d None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:34:57.471075 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b35f2e4-2aaa-42b1-b56b-464983dadb3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:34:57.499263 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-9b35f2e4-2aaa-42b1-b56b-464983dadb3d None None] MFA Rules not processed for user `03fc1d26ad7d482088cb04249170b9b2`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:34:57.500508 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-9b35f2e4-2aaa-42b1-b56b-464983dadb3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:34:57.562705 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db70e593-2650-4dbb-ba72-6bd4873f6112 admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:34:57.562705 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-db70e593-2650-4dbb-ba72-6bd4873f6112 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:34:57.590246 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1153/2304] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 02:34:57 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 02:34:57.603350 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b35f2e4-2aaa-42b1-b56b-464983dadb3d None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:34:57.605280 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-9b35f2e4-2aaa-42b1-b56b-464983dadb3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:34:57.625340 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:34:57.635569 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db70e593-2650-4dbb-ba72-6bd4873f6112 admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:34:57.640277 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e8e828-341b-4516-8263-0c629bf40e96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:34:57.640930 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e8e828-341b-4516-8263-0c629bf40e96 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:34:57.641207 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e8e828-341b-4516-8263-0c629bf40e96 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:34:57.641476 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e8e828-341b-4516-8263-0c629bf40e96 admin admin] PATH_INFO: `/v3/users/51777b496e804bb58fb21ae38479da98` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:34:57.642598 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e8e828-341b-4516-8263-0c629bf40e96 admin admin] RBAC: Authorizing `identity:delete_user(user_id=51777b496e804bb58fb21ae38479da98)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:34:57.645062 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e8e828-341b-4516-8263-0c629bf40e96 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:34:57.674856 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b35f2e4-2aaa-42b1-b56b-464983dadb3d None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:34:57.679371 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7258c6c9-4218-429d-bb1e-f656aa69123e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ba688e0c4d44d13898539ee886f95fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'beb6def6fcad45959e56425bb8bff4d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:34:57.679995 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7258c6c9-4218-429d-bb1e-f656aa69123e service cinder] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:34:57.680264 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7258c6c9-4218-429d-bb1e-f656aa69123e service cinder] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:34:57.680562 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7258c6c9-4218-429d-bb1e-f656aa69123e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:34:57.689061 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7258c6c9-4218-429d-bb1e-f656aa69123e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:34:57.690843 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7258c6c9-4218-429d-bb1e-f656aa69123e service cinder] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:34:57.692605 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-c5e8e828-341b-4516-8263-0c629bf40e96 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '51777b496e804bb58fb21ae38479da98'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:34:57.700239 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1154/2305] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 02:34:57 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 12 02:34:57.700525 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-c5e8e828-341b-4516-8263-0c629bf40e96 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '51777b496e804bb58fb21ae38479da98'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:34:57.713710 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-c5e8e828-341b-4516-8263-0c629bf40e96 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '51777b496e804bb58fb21ae38479da98'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:34:57.720839 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-c5e8e828-341b-4516-8263-0c629bf40e96 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '51777b496e804bb58fb21ae38479da98'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:34:57.721561 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-c5e8e828-341b-4516-8263-0c629bf40e96 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '51777b496e804bb58fb21ae38479da98'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:34:57.728247 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1152/2306] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Oct 12 02:34:57 2022] DELETE /identity/v3/users/51777b496e804bb58fb21ae38479da98 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 02:34:57.732985 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19906749-c395-479b-b62e-f8ea2e9631dc None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:34:57.733272 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19906749-c395-479b-b62e-f8ea2e9631dc None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:34:57.733550 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19906749-c395-479b-b62e-f8ea2e9631dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:34:57.754573 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-19906749-c395-479b-b62e-f8ea2e9631dc None None] MFA Rules not processed for user `a326a5bb7364479382f528a592371656`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:34:57.755794 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-19906749-c395-479b-b62e-f8ea2e9631dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:34:57.816852 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1155/2307] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 02:34:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 02:34:57.826735 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e8e828-341b-4516-8263-0c629bf40e96 admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:34:57.828377 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-c5e8e828-341b-4516-8263-0c629bf40e96 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:34:57.862061 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:34:57.903485 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e8e828-341b-4516-8263-0c629bf40e96 admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:34:57.907752 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbee51e-f9e3-479d-95b9-8d711a613fea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5223b5cab3114e9b9a13c582f8ef8386', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'beb6def6fcad45959e56425bb8bff4d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:34:57.908366 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbee51e-f9e3-479d-95b9-8d711a613fea service neutron] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:34:57.908683 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbee51e-f9e3-479d-95b9-8d711a613fea service neutron] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:34:57.909276 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbee51e-f9e3-479d-95b9-8d711a613fea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:34:57.919794 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dbee51e-f9e3-479d-95b9-8d711a613fea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:34:57.921397 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dbee51e-f9e3-479d-95b9-8d711a613fea service neutron] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:34:57.932890 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1153/2308] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 02:34:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 02:34:58.497462 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19906749-c395-479b-b62e-f8ea2e9631dc None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:34:58.499005 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-19906749-c395-479b-b62e-f8ea2e9631dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:34:58.513690 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19906749-c395-479b-b62e-f8ea2e9631dc None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:34:58.524833 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41d2e32-193b-4186-8efa-171c19d40ed8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:34:58.525391 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41d2e32-193b-4186-8efa-171c19d40ed8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:34:58.525667 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41d2e32-193b-4186-8efa-171c19d40ed8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:34:58.525946 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41d2e32-193b-4186-8efa-171c19d40ed8 admin admin] PATH_INFO: `/v3/projects/b1afa23825884629ae6db6793196f12d` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:34:58.527066 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41d2e32-193b-4186-8efa-171c19d40ed8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b1afa23825884629ae6db6793196f12d)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:34:58.529030 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41d2e32-193b-4186-8efa-171c19d40ed8 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:34:58.576560 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-d41d2e32-193b-4186-8efa-171c19d40ed8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b1afa23825884629ae6db6793196f12d', 'request_id': 'req-d41d2e32-193b-4186-8efa-171c19d40ed8'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:34:58.582173 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-d41d2e32-193b-4186-8efa-171c19d40ed8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b1afa23825884629ae6db6793196f12d', 'request_id': 'req-d41d2e32-193b-4186-8efa-171c19d40ed8'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:34:58.588605 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-d41d2e32-193b-4186-8efa-171c19d40ed8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b1afa23825884629ae6db6793196f12d', 'request_id': 'req-d41d2e32-193b-4186-8efa-171c19d40ed8'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:34:58.601165 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-d41d2e32-193b-4186-8efa-171c19d40ed8 admin admin] The token cache is being invalidate because project b1afa23825884629ae6db6793196f12d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81362) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 02:34:58.601481 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-d41d2e32-193b-4186-8efa-171c19d40ed8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:34:58.602095 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-d41d2e32-193b-4186-8efa-171c19d40ed8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:34:58.603570 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1156/2309] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Oct 12 02:34:58 2022] DELETE /identity/v3/projects/b1afa23825884629ae6db6793196f12d => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 02:34:58.608798 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1bbc99-2cdc-4311-9bbd-1cebf47ff1c6 None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:34:58.609083 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1bbc99-2cdc-4311-9bbd-1cebf47ff1c6 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:34:58.609357 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1bbc99-2cdc-4311-9bbd-1cebf47ff1c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:34:58.629370 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-fd1bbc99-2cdc-4311-9bbd-1cebf47ff1c6 None None] MFA Rules not processed for user `a326a5bb7364479382f528a592371656`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:34:58.630467 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-fd1bbc99-2cdc-4311-9bbd-1cebf47ff1c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:34:58.689106 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1154/2310] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 02:34:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 02:34:58.697044 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a3a491-07c3-4949-b8d0-d558560e1bd5 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:34:58.697331 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a3a491-07c3-4949-b8d0-d558560e1bd5 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:34:58.697606 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a3a491-07c3-4949-b8d0-d558560e1bd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:34:58.717001 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-f3a3a491-07c3-4949-b8d0-d558560e1bd5 None None] MFA Rules not processed for user `a326a5bb7364479382f528a592371656`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:34:58.718187 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-f3a3a491-07c3-4949-b8d0-d558560e1bd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:34:58.726525 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1157/2311] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 02:34:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 02:34:58.730855 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1bbc99-2cdc-4311-9bbd-1cebf47ff1c6 None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:34:58.741261 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1bbc99-2cdc-4311-9bbd-1cebf47ff1c6 None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:34:58.745705 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86442e2-1194-49bd-8b67-5b6550c9b379 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:34:58.746295 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86442e2-1194-49bd-8b67-5b6550c9b379 admin admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:34:58.746576 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86442e2-1194-49bd-8b67-5b6550c9b379 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:34:58.746851 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86442e2-1194-49bd-8b67-5b6550c9b379 admin admin] PATH_INFO: `/v3/domains` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:34:58.747495 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86442e2-1194-49bd-8b67-5b6550c9b379 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 02:34:58.747808 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86442e2-1194-49bd-8b67-5b6550c9b379 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:34:58.749438 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86442e2-1194-49bd-8b67-5b6550c9b379 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:34:58.761008 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1155/2312] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Oct 12 02:34:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 02:34:58.765197 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a3a491-07c3-4949-b8d0-d558560e1bd5 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:34:58.774581 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a3a491-07c3-4949-b8d0-d558560e1bd5 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:34:58.779153 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250920a0-b2e5-4e0d-ac8c-c6811f462048 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:34:58.779853 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250920a0-b2e5-4e0d-ac8c-c6811f462048 admin admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:34:58.780187 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250920a0-b2e5-4e0d-ac8c-c6811f462048 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:34:58.780534 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250920a0-b2e5-4e0d-ac8c-c6811f462048 admin admin] PATH_INFO: `/v3/projects` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:34:58.781215 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250920a0-b2e5-4e0d-ac8c-c6811f462048 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:34:58.783121 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250920a0-b2e5-4e0d-ac8c-c6811f462048 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:34:58.810632 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1158/2313] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Oct 12 02:34:58 2022] POST /identity/v3/projects => generated 405 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 02:34:58.814783 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86442e2-1194-49bd-8b67-5b6550c9b379 admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:34:58.824701 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86442e2-1194-49bd-8b67-5b6550c9b379 admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:34:58.880583 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a3adcd-aef4-44e0-a06c-084c729a7a8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:34:58.881181 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a3adcd-aef4-44e0-a06c-084c729a7a8f admin admin] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:34:58.881463 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a3adcd-aef4-44e0-a06c-084c729a7a8f admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:34:58.881765 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a3adcd-aef4-44e0-a06c-084c729a7a8f admin admin] PATH_INFO: `/v3/users` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:34:58.882428 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a3adcd-aef4-44e0-a06c-084c729a7a8f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:34:58.884342 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a3adcd-aef4-44e0-a06c-084c729a7a8f admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:34:58.904969 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1156/2314] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Oct 12 02:34:58 2022] POST /identity/v3/users => generated 303 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 02:34:58.909166 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250920a0-b2e5-4e0d-ac8c-c6811f462048 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:34:58.919722 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250920a0-b2e5-4e0d-ac8c-c6811f462048 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:34:58.924210 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5ae66b-8db5-445f-b400-a76cc1e2bbcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:34:58.924861 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5ae66b-8db5-445f-b400-a76cc1e2bbcd admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:34:58.925140 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5ae66b-8db5-445f-b400-a76cc1e2bbcd admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:34:58.925424 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5ae66b-8db5-445f-b400-a76cc1e2bbcd admin admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:34:58.926730 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5ae66b-8db5-445f-b400-a76cc1e2bbcd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:34:58.928307 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5ae66b-8db5-445f-b400-a76cc1e2bbcd admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:34:58.929560 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:34:58.940091 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1159/2315] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Oct 12 02:34:58 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 02:34:58.943768 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a3adcd-aef4-44e0-a06c-084c729a7a8f admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:34:58.953725 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a3adcd-aef4-44e0-a06c-084c729a7a8f admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:34:58.958765 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f1e1b7-4a7a-4af4-9059-b7b98009e931 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:34:58.959351 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f1e1b7-4a7a-4af4-9059-b7b98009e931 admin admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:34:58.959625 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f1e1b7-4a7a-4af4-9059-b7b98009e931 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:34:58.959891 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f1e1b7-4a7a-4af4-9059-b7b98009e931 admin admin] PATH_INFO: `/v3/roles` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:34:58.960551 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f1e1b7-4a7a-4af4-9059-b7b98009e931 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:34:58.962129 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f1e1b7-4a7a-4af4-9059-b7b98009e931 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:34:58.972492 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1157/2316] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Oct 12 02:34:58 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 02:34:58.977113 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5ae66b-8db5-445f-b400-a76cc1e2bbcd admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:34:58.987276 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5ae66b-8db5-445f-b400-a76cc1e2bbcd admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:34:58.992366 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb48488d-1653-450c-8f86-90fe3dd6196f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:34:58.992976 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb48488d-1653-450c-8f86-90fe3dd6196f admin admin] REQUEST_METHOD: `PUT` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:34:58.993253 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb48488d-1653-450c-8f86-90fe3dd6196f admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:34:58.993544 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb48488d-1653-450c-8f86-90fe3dd6196f admin admin] PATH_INFO: `/v3/projects/278dee87efd148e1831c8c5d2bb0bdd7/users/006473747a8d440a87e0fe1ba3c569d5/roles/3d75c4d7f1a849b9a771504d1583ab28` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:34:59.008121 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb48488d-1653-450c-8f86-90fe3dd6196f admin admin] RBAC: Authorizing `identity:create_grant(project_id=278dee87efd148e1831c8c5d2bb0bdd7, user_id=006473747a8d440a87e0fe1ba3c569d5, role_id=3d75c4d7f1a849b9a771504d1583ab28)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:34:59.010816 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb48488d-1653-450c-8f86-90fe3dd6196f admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:34:59.024228 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1160/2317] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Oct 12 02:34:58 2022] PUT /identity/v3/projects/278dee87efd148e1831c8c5d2bb0bdd7/users/006473747a8d440a87e0fe1ba3c569d5/roles/3d75c4d7f1a849b9a771504d1583ab28 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 02:34:59.029146 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2220f16e-7d55-4120-9cc0-d59e271a6ef5 None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:34:59.029433 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2220f16e-7d55-4120-9cc0-d59e271a6ef5 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:34:59.029712 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2220f16e-7d55-4120-9cc0-d59e271a6ef5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:34:59.049854 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-2220f16e-7d55-4120-9cc0-d59e271a6ef5 None None] MFA Rules not processed for user `a326a5bb7364479382f528a592371656`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:34:59.051640 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-2220f16e-7d55-4120-9cc0-d59e271a6ef5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:34:59.079266 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:34:59.120222 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1158/2318] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 02:34:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 02:34:59.127122 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb48488d-1653-450c-8f86-90fe3dd6196f admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:34:59.130466 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-fb48488d-1653-450c-8f86-90fe3dd6196f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:34:59.201522 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb48488d-1653-450c-8f86-90fe3dd6196f admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:34:59.205290 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8d0004-cf2f-4fbd-989c-a2565414e151 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5223b5cab3114e9b9a13c582f8ef8386', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'beb6def6fcad45959e56425bb8bff4d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:34:59.205979 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8d0004-cf2f-4fbd-989c-a2565414e151 service neutron] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:34:59.206320 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8d0004-cf2f-4fbd-989c-a2565414e151 service neutron] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:34:59.206797 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8d0004-cf2f-4fbd-989c-a2565414e151 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:34:59.220536 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8d0004-cf2f-4fbd-989c-a2565414e151 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:34:59.222078 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8d0004-cf2f-4fbd-989c-a2565414e151 service neutron] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:34:59.248574 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1161/2319] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 02:34:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 12 02:34:59.860083 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2220f16e-7d55-4120-9cc0-d59e271a6ef5 None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:34:59.871141 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2220f16e-7d55-4120-9cc0-d59e271a6ef5 None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:34:59.875305 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7838072a-7b37-49b1-80ab-a5f9c7de4177 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5223b5cab3114e9b9a13c582f8ef8386', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'beb6def6fcad45959e56425bb8bff4d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:34:59.875953 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7838072a-7b37-49b1-80ab-a5f9c7de4177 service neutron] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:34:59.876275 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7838072a-7b37-49b1-80ab-a5f9c7de4177 service neutron] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:34:59.876582 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7838072a-7b37-49b1-80ab-a5f9c7de4177 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:34:59.878489 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-7838072a-7b37-49b1-80ab-a5f9c7de4177 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:34:59.889405 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7838072a-7b37-49b1-80ab-a5f9c7de4177 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:34:59.890861 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7838072a-7b37-49b1-80ab-a5f9c7de4177 service neutron] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:34:59.902176 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1159/2320] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 02:34:59 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 02:35:00.121381 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0777bf9e-e3a9-48e7-8bed-d0d7fec2a85e None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:35:00.121944 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0777bf9e-e3a9-48e7-8bed-d0d7fec2a85e None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:35:00.122051 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0777bf9e-e3a9-48e7-8bed-d0d7fec2a85e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:35:00.151870 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-0777bf9e-e3a9-48e7-8bed-d0d7fec2a85e None None] MFA Rules not processed for user `006473747a8d440a87e0fe1ba3c569d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:35:00.153112 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-0777bf9e-e3a9-48e7-8bed-d0d7fec2a85e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:35:00.223594 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1162/2321] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 02:35:00 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 02:35:00.228160 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7838072a-7b37-49b1-80ab-a5f9c7de4177 service neutron] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:35:00.239752 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7838072a-7b37-49b1-80ab-a5f9c7de4177 service neutron] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:35:00.244821 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0310d5-51d5-4c84-9d60-b62e01b1f482 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:35:00.245260 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0310d5-51d5-4c84-9d60-b62e01b1f482 admin admin] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:35:00.245493 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0310d5-51d5-4c84-9d60-b62e01b1f482 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:35:00.245769 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0310d5-51d5-4c84-9d60-b62e01b1f482 admin admin] PATH_INFO: `/v3/projects` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:35:00.246451 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0310d5-51d5-4c84-9d60-b62e01b1f482 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:35:00.248797 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0310d5-51d5-4c84-9d60-b62e01b1f482 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:35:00.277234 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1160/2322] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Oct 12 02:35:00 2022] POST /identity/v3/projects => generated 405 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 02:35:00.281381 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0777bf9e-e3a9-48e7-8bed-d0d7fec2a85e None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:35:00.293590 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0777bf9e-e3a9-48e7-8bed-d0d7fec2a85e None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:35:00.350129 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d5e675-807b-402f-9055-fbb3fe554006 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:35:00.350737 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d5e675-807b-402f-9055-fbb3fe554006 admin admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:35:00.351018 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d5e675-807b-402f-9055-fbb3fe554006 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:35:00.351291 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d5e675-807b-402f-9055-fbb3fe554006 admin admin] PATH_INFO: `/v3/users` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:35:00.351924 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d5e675-807b-402f-9055-fbb3fe554006 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:35:00.354131 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d5e675-807b-402f-9055-fbb3fe554006 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:35:00.364188 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:35:00.375457 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1163/2323] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Oct 12 02:35:00 2022] POST /identity/v3/users => generated 309 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 02:35:00.379968 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0310d5-51d5-4c84-9d60-b62e01b1f482 admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:35:00.390017 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0310d5-51d5-4c84-9d60-b62e01b1f482 admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:35:00.395123 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e944b0a-73fe-4459-bad5-5b5ef204b3df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:35:00.395845 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e944b0a-73fe-4459-bad5-5b5ef204b3df admin admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:35:00.396117 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e944b0a-73fe-4459-bad5-5b5ef204b3df admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:35:00.396379 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e944b0a-73fe-4459-bad5-5b5ef204b3df admin admin] PATH_INFO: `/v3/roles` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:35:00.397149 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e944b0a-73fe-4459-bad5-5b5ef204b3df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:35:00.398725 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e944b0a-73fe-4459-bad5-5b5ef204b3df admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:35:00.408344 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1161/2324] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Oct 12 02:35:00 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 02:35:00.412256 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d5e675-807b-402f-9055-fbb3fe554006 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:35:00.421954 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d5e675-807b-402f-9055-fbb3fe554006 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:35:00.426472 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcbca2b-2c1d-4873-9f55-b9cda8893931 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:35:00.427106 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcbca2b-2c1d-4873-9f55-b9cda8893931 admin admin] REQUEST_METHOD: `PUT` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:35:00.427382 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcbca2b-2c1d-4873-9f55-b9cda8893931 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:35:00.427653 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcbca2b-2c1d-4873-9f55-b9cda8893931 admin admin] PATH_INFO: `/v3/projects/d9b9ae8308814049aab3c6bebc1d8fcf/users/6fb00b281e8a4326b789cf9ae35a82b9/roles/39b1e8108dff402383def3c559f48189` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:35:00.442581 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fcbca2b-2c1d-4873-9f55-b9cda8893931 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d9b9ae8308814049aab3c6bebc1d8fcf, user_id=6fb00b281e8a4326b789cf9ae35a82b9, role_id=39b1e8108dff402383def3c559f48189)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:35:00.445238 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fcbca2b-2c1d-4873-9f55-b9cda8893931 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:35:00.458375 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1164/2325] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Oct 12 02:35:00 2022] PUT /identity/v3/projects/d9b9ae8308814049aab3c6bebc1d8fcf/users/6fb00b281e8a4326b789cf9ae35a82b9/roles/39b1e8108dff402383def3c559f48189 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 02:35:00.462184 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e944b0a-73fe-4459-bad5-5b5ef204b3df admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:35:00.472040 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e944b0a-73fe-4459-bad5-5b5ef204b3df admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:35:00.529179 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac977afa-39bb-47be-94d6-61912b34d944 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:35:00.529711 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac977afa-39bb-47be-94d6-61912b34d944 admin admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:35:00.529991 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac977afa-39bb-47be-94d6-61912b34d944 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:35:00.530265 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac977afa-39bb-47be-94d6-61912b34d944 admin admin] PATH_INFO: `/v3/roles` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:35:00.530908 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac977afa-39bb-47be-94d6-61912b34d944 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:35:00.532528 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac977afa-39bb-47be-94d6-61912b34d944 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:35:00.542587 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1162/2326] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Oct 12 02:35:00 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 02:35:00.546697 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcbca2b-2c1d-4873-9f55-b9cda8893931 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:35:00.557915 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcbca2b-2c1d-4873-9f55-b9cda8893931 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:35:00.562429 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af7d456-0f90-4ea9-8698-de58fd312046 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:35:00.563072 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af7d456-0f90-4ea9-8698-de58fd312046 admin admin] REQUEST_METHOD: `PUT` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:35:00.563348 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af7d456-0f90-4ea9-8698-de58fd312046 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:35:00.563621 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af7d456-0f90-4ea9-8698-de58fd312046 admin admin] PATH_INFO: `/v3/projects/d9b9ae8308814049aab3c6bebc1d8fcf/users/6fb00b281e8a4326b789cf9ae35a82b9/roles/39b1e8108dff402383def3c559f48189` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:35:00.565646 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af7d456-0f90-4ea9-8698-de58fd312046 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d9b9ae8308814049aab3c6bebc1d8fcf, user_id=6fb00b281e8a4326b789cf9ae35a82b9, role_id=39b1e8108dff402383def3c559f48189)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:35:00.569423 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af7d456-0f90-4ea9-8698-de58fd312046 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:35:00.579458 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1165/2327] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Oct 12 02:35:00 2022] PUT /identity/v3/projects/d9b9ae8308814049aab3c6bebc1d8fcf/users/6fb00b281e8a4326b789cf9ae35a82b9/roles/39b1e8108dff402383def3c559f48189 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 02:35:01.251525 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa6b60b-1180-4c51-ac05-3c8aee388597 None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:35:01.251988 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa6b60b-1180-4c51-ac05-3c8aee388597 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:35:01.252135 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa6b60b-1180-4c51-ac05-3c8aee388597 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:35:01.284278 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-8aa6b60b-1180-4c51-ac05-3c8aee388597 None None] MFA Rules not processed for user `6fb00b281e8a4326b789cf9ae35a82b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:35:01.285696 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-8aa6b60b-1180-4c51-ac05-3c8aee388597 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:35:01.357446 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1163/2328] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 02:35:01 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 02:35:01.445997 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717152a7-b9e6-43ac-90e8-72e31f3c626f None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:35:01.446645 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717152a7-b9e6-43ac-90e8-72e31f3c626f None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:35:01.447019 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717152a7-b9e6-43ac-90e8-72e31f3c626f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:35:01.469167 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-717152a7-b9e6-43ac-90e8-72e31f3c626f None None] MFA Rules not processed for user `8d0e2087e5324071926c3dc3a3cb9b1d`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:35:01.470431 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-717152a7-b9e6-43ac-90e8-72e31f3c626f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:35:01.543810 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1166/2329] 10.222.0.18 () {58 vars in 967 bytes} [Wed Oct 12 02:35:01 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 02:35:01.570864 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa6b60b-1180-4c51-ac05-3c8aee388597 None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:35:01.572383 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-8aa6b60b-1180-4c51-ac05-3c8aee388597 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:35:01.584370 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:35:01.653414 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa6b60b-1180-4c51-ac05-3c8aee388597 None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:35:01.658757 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69624a8-450f-4dc2-8e65-cfbfce9bed0e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af9bd50c42cc437dbdd5a431d8adbb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'beb6def6fcad45959e56425bb8bff4d1', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:35:01.659401 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69624a8-450f-4dc2-8e65-cfbfce9bed0e service swift] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:35:01.659669 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69624a8-450f-4dc2-8e65-cfbfce9bed0e service swift] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:35:01.659960 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69624a8-450f-4dc2-8e65-cfbfce9bed0e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:35:01.668900 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69624a8-450f-4dc2-8e65-cfbfce9bed0e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:35:01.670520 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69624a8-450f-4dc2-8e65-cfbfce9bed0e service swift] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:35:01.679576 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1164/2330] 10.222.0.18 () {60 vars in 1384 bytes} [Wed Oct 12 02:35:01 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 12 02:35:02.491130 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717152a7-b9e6-43ac-90e8-72e31f3c626f None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:35:02.558754 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717152a7-b9e6-43ac-90e8-72e31f3c626f None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:35:02.563217 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e4ab5e-2ae3-446c-83a6-077c4c852e67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:35:02.563845 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e4ab5e-2ae3-446c-83a6-077c4c852e67 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:35:02.564125 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e4ab5e-2ae3-446c-83a6-077c4c852e67 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:35:02.564396 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e4ab5e-2ae3-446c-83a6-077c4c852e67 admin admin] PATH_INFO: `/v3/users/006473747a8d440a87e0fe1ba3c569d5` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:35:02.565549 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e4ab5e-2ae3-446c-83a6-077c4c852e67 admin admin] RBAC: Authorizing `identity:delete_user(user_id=006473747a8d440a87e0fe1ba3c569d5)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:35:02.567955 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e4ab5e-2ae3-446c-83a6-077c4c852e67 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:35:02.614808 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-85e4ab5e-2ae3-446c-83a6-077c4c852e67 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '006473747a8d440a87e0fe1ba3c569d5'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:35:02.621686 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-85e4ab5e-2ae3-446c-83a6-077c4c852e67 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '006473747a8d440a87e0fe1ba3c569d5'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:35:02.628508 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:INSERT=4,keystone:SELECT=87,keystone:DELETE=9 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:35:02.635199 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-85e4ab5e-2ae3-446c-83a6-077c4c852e67 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '006473747a8d440a87e0fe1ba3c569d5'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:35:02.642183 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-85e4ab5e-2ae3-446c-83a6-077c4c852e67 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '006473747a8d440a87e0fe1ba3c569d5'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:35:02.642807 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-85e4ab5e-2ae3-446c-83a6-077c4c852e67 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '006473747a8d440a87e0fe1ba3c569d5'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:35:02.648638 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1167/2331] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Oct 12 02:35:02 2022] DELETE /identity/v3/users/006473747a8d440a87e0fe1ba3c569d5 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 02:35:02.820920 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69624a8-450f-4dc2-8e65-cfbfce9bed0e service swift] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:35:02.834403 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69624a8-450f-4dc2-8e65-cfbfce9bed0e service swift] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:35:02.891230 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b89e67-c27d-4ac2-897b-67c833f07f50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:35:02.891851 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b89e67-c27d-4ac2-897b-67c833f07f50 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:35:02.892126 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b89e67-c27d-4ac2-897b-67c833f07f50 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:35:02.892412 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b89e67-c27d-4ac2-897b-67c833f07f50 admin admin] PATH_INFO: `/v3/projects/278dee87efd148e1831c8c5d2bb0bdd7` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:35:02.893523 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b89e67-c27d-4ac2-897b-67c833f07f50 admin admin] RBAC: Authorizing `identity:delete_project(project_id=278dee87efd148e1831c8c5d2bb0bdd7)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:35:02.896014 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b89e67-c27d-4ac2-897b-67c833f07f50 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:35:02.940387 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-19b89e67-c27d-4ac2-897b-67c833f07f50 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '278dee87efd148e1831c8c5d2bb0bdd7', 'request_id': 'req-19b89e67-c27d-4ac2-897b-67c833f07f50'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:35:02.946033 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-19b89e67-c27d-4ac2-897b-67c833f07f50 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '278dee87efd148e1831c8c5d2bb0bdd7', 'request_id': 'req-19b89e67-c27d-4ac2-897b-67c833f07f50'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:35:02.952156 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-19b89e67-c27d-4ac2-897b-67c833f07f50 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '278dee87efd148e1831c8c5d2bb0bdd7', 'request_id': 'req-19b89e67-c27d-4ac2-897b-67c833f07f50'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:35:02.964686 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-19b89e67-c27d-4ac2-897b-67c833f07f50 admin admin] The token cache is being invalidate because project 278dee87efd148e1831c8c5d2bb0bdd7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81361) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 02:35:02.964971 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-19b89e67-c27d-4ac2-897b-67c833f07f50 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:35:02.965595 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-19b89e67-c27d-4ac2-897b-67c833f07f50 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:35:02.967075 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1165/2332] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Oct 12 02:35:02 2022] DELETE /identity/v3/projects/278dee87efd148e1831c8c5d2bb0bdd7 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 02:35:02.971283 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e4ab5e-2ae3-446c-83a6-077c4c852e67 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:35:02.973232 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-85e4ab5e-2ae3-446c-83a6-077c4c852e67 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:35:02.986421 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e4ab5e-2ae3-446c-83a6-077c4c852e67 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:35:03.041364 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae837e5a-6fab-4446-a525-739a794ec838 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:35:03.041988 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae837e5a-6fab-4446-a525-739a794ec838 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:35:03.042261 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae837e5a-6fab-4446-a525-739a794ec838 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:35:03.042527 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae837e5a-6fab-4446-a525-739a794ec838 admin admin] PATH_INFO: `/v3/users/6fb00b281e8a4326b789cf9ae35a82b9` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:35:03.043665 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae837e5a-6fab-4446-a525-739a794ec838 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6fb00b281e8a4326b789cf9ae35a82b9)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:35:03.045599 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae837e5a-6fab-4446-a525-739a794ec838 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:35:03.091125 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-ae837e5a-6fab-4446-a525-739a794ec838 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6fb00b281e8a4326b789cf9ae35a82b9'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:35:03.098930 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-ae837e5a-6fab-4446-a525-739a794ec838 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6fb00b281e8a4326b789cf9ae35a82b9'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:35:03.111192 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-ae837e5a-6fab-4446-a525-739a794ec838 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6fb00b281e8a4326b789cf9ae35a82b9'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:35:03.117977 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-ae837e5a-6fab-4446-a525-739a794ec838 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6fb00b281e8a4326b789cf9ae35a82b9'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:35:03.118618 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-ae837e5a-6fab-4446-a525-739a794ec838 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6fb00b281e8a4326b789cf9ae35a82b9'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:35:03.124433 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1168/2333] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Oct 12 02:35:02 2022] DELETE /identity/v3/users/6fb00b281e8a4326b789cf9ae35a82b9 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 02:35:03.301823 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b89e67-c27d-4ac2-897b-67c833f07f50 admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:35:03.303244 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-19b89e67-c27d-4ac2-897b-67c833f07f50 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:35:03.318641 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b89e67-c27d-4ac2-897b-67c833f07f50 admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:35:03.348856 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:35:03.390162 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00d3474-a8c0-47b0-9972-4e09016ebc00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:35:03.390989 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00d3474-a8c0-47b0-9972-4e09016ebc00 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:35:03.391262 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00d3474-a8c0-47b0-9972-4e09016ebc00 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:35:03.391534 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00d3474-a8c0-47b0-9972-4e09016ebc00 admin admin] PATH_INFO: `/v3/projects/d9b9ae8308814049aab3c6bebc1d8fcf` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:35:03.392672 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00d3474-a8c0-47b0-9972-4e09016ebc00 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d9b9ae8308814049aab3c6bebc1d8fcf)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:35:03.395635 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00d3474-a8c0-47b0-9972-4e09016ebc00 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:35:03.457617 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-e00d3474-a8c0-47b0-9972-4e09016ebc00 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd9b9ae8308814049aab3c6bebc1d8fcf', 'request_id': 'req-e00d3474-a8c0-47b0-9972-4e09016ebc00'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:35:03.464983 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-e00d3474-a8c0-47b0-9972-4e09016ebc00 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd9b9ae8308814049aab3c6bebc1d8fcf', 'request_id': 'req-e00d3474-a8c0-47b0-9972-4e09016ebc00'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:35:03.479200 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-e00d3474-a8c0-47b0-9972-4e09016ebc00 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd9b9ae8308814049aab3c6bebc1d8fcf', 'request_id': 'req-e00d3474-a8c0-47b0-9972-4e09016ebc00'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:35:03.494734 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-e00d3474-a8c0-47b0-9972-4e09016ebc00 admin admin] The token cache is being invalidate because project d9b9ae8308814049aab3c6bebc1d8fcf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81361) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 02:35:03.495173 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-e00d3474-a8c0-47b0-9972-4e09016ebc00 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:35:03.495910 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-e00d3474-a8c0-47b0-9972-4e09016ebc00 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:35:03.498152 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1166/2334] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Oct 12 02:35:03 2022] DELETE /identity/v3/projects/d9b9ae8308814049aab3c6bebc1d8fcf => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 02:35:03.503077 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2adf786-cae3-4d61-ad21-31114dff7dab None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:35:03.503604 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2adf786-cae3-4d61-ad21-31114dff7dab None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:35:03.504387 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2adf786-cae3-4d61-ad21-31114dff7dab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:35:03.526266 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-f2adf786-cae3-4d61-ad21-31114dff7dab None None] MFA Rules not processed for user `a326a5bb7364479382f528a592371656`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:35:03.527479 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-f2adf786-cae3-4d61-ad21-31114dff7dab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:35:03.592651 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:35:03.612195 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0cba71-dcab-40a4-9f89-74c79802c5e5 None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:35:03.612550 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0cba71-dcab-40a4-9f89-74c79802c5e5 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:35:03.612729 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0cba71-dcab-40a4-9f89-74c79802c5e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:35:03.616596 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1169/2335] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 02:35:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 02:35:03.637504 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-3a0cba71-dcab-40a4-9f89-74c79802c5e5 None None] MFA Rules not processed for user `a326a5bb7364479382f528a592371656`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:35:03.638862 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-3a0cba71-dcab-40a4-9f89-74c79802c5e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:35:03.648502 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1167/2336] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 02:35:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 02:35:03.651461 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2adf786-cae3-4d61-ad21-31114dff7dab None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:35:03.662014 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2adf786-cae3-4d61-ad21-31114dff7dab None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:35:03.666958 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1031898c-ee2a-4d3b-ad01-09b13a4c553d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:35:03.667560 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1031898c-ee2a-4d3b-ad01-09b13a4c553d admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:35:03.667835 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1031898c-ee2a-4d3b-ad01-09b13a4c553d admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:35:03.668099 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1031898c-ee2a-4d3b-ad01-09b13a4c553d admin admin] PATH_INFO: `/v3/domains` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:35:03.668774 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1031898c-ee2a-4d3b-ad01-09b13a4c553d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 02:35:03.669069 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1031898c-ee2a-4d3b-ad01-09b13a4c553d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:35:03.670635 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1031898c-ee2a-4d3b-ad01-09b13a4c553d admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:35:03.683323 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1170/2337] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Oct 12 02:35:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 02:35:03.687518 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0cba71-dcab-40a4-9f89-74c79802c5e5 None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:35:03.697425 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0cba71-dcab-40a4-9f89-74c79802c5e5 None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:35:03.707464 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e94fbec-8c47-4acc-b2cd-90026745786c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:35:03.708072 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e94fbec-8c47-4acc-b2cd-90026745786c admin admin] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:35:03.708346 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e94fbec-8c47-4acc-b2cd-90026745786c admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:35:03.708648 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e94fbec-8c47-4acc-b2cd-90026745786c admin admin] PATH_INFO: `/v3/projects` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:35:03.709303 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e94fbec-8c47-4acc-b2cd-90026745786c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:35:03.711223 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e94fbec-8c47-4acc-b2cd-90026745786c admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:35:03.738709 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1168/2338] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Oct 12 02:35:03 2022] POST /identity/v3/projects => generated 365 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 02:35:03.743324 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1031898c-ee2a-4d3b-ad01-09b13a4c553d admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:35:03.753236 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1031898c-ee2a-4d3b-ad01-09b13a4c553d admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:35:03.808430 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae354eb-6b55-4002-bad1-6ecec3b810b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:35:03.809515 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae354eb-6b55-4002-bad1-6ecec3b810b1 admin admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:35:03.809515 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae354eb-6b55-4002-bad1-6ecec3b810b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:35:03.809802 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae354eb-6b55-4002-bad1-6ecec3b810b1 admin admin] PATH_INFO: `/v3/users` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:35:03.810504 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae354eb-6b55-4002-bad1-6ecec3b810b1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:35:03.812629 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae354eb-6b55-4002-bad1-6ecec3b810b1 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:35:03.834594 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1171/2339] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Oct 12 02:35:03 2022] POST /identity/v3/users => generated 283 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 02:35:03.838578 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e94fbec-8c47-4acc-b2cd-90026745786c admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:35:03.849318 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e94fbec-8c47-4acc-b2cd-90026745786c admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:35:03.854306 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1811fffe-fd62-4712-a64f-b42508fa75c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:35:03.854904 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1811fffe-fd62-4712-a64f-b42508fa75c2 admin admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:35:03.855183 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1811fffe-fd62-4712-a64f-b42508fa75c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:35:03.855455 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1811fffe-fd62-4712-a64f-b42508fa75c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:35:03.856098 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1811fffe-fd62-4712-a64f-b42508fa75c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:35:03.857728 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1811fffe-fd62-4712-a64f-b42508fa75c2 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:35:03.868414 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1169/2340] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Oct 12 02:35:03 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 02:35:03.872394 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae354eb-6b55-4002-bad1-6ecec3b810b1 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:35:03.882379 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae354eb-6b55-4002-bad1-6ecec3b810b1 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:35:03.886994 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd6ca63-e73b-48f4-b0e0-28e68f3c23bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:35:03.887591 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd6ca63-e73b-48f4-b0e0-28e68f3c23bd admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:35:03.887869 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd6ca63-e73b-48f4-b0e0-28e68f3c23bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:35:03.888141 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd6ca63-e73b-48f4-b0e0-28e68f3c23bd admin admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:35:03.888806 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd6ca63-e73b-48f4-b0e0-28e68f3c23bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:35:03.890547 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd6ca63-e73b-48f4-b0e0-28e68f3c23bd admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:35:03.901352 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1172/2341] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Oct 12 02:35:03 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 02:35:03.905730 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1811fffe-fd62-4712-a64f-b42508fa75c2 admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:35:03.916111 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1811fffe-fd62-4712-a64f-b42508fa75c2 admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:35:03.920665 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0606ce1-1dae-48c1-90b4-6ff02a908aaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:35:03.921305 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0606ce1-1dae-48c1-90b4-6ff02a908aaa admin admin] REQUEST_METHOD: `PUT` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:35:03.921582 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0606ce1-1dae-48c1-90b4-6ff02a908aaa admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:35:03.921853 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0606ce1-1dae-48c1-90b4-6ff02a908aaa admin admin] PATH_INFO: `/v3/projects/10804db524b648598eab0b1144f4e5e6/users/3cf21f40d35642658ae65e8a99f23c37/roles/3d75c4d7f1a849b9a771504d1583ab28` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:35:03.940766 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0606ce1-1dae-48c1-90b4-6ff02a908aaa admin admin] RBAC: Authorizing `identity:create_grant(project_id=10804db524b648598eab0b1144f4e5e6, user_id=3cf21f40d35642658ae65e8a99f23c37, role_id=3d75c4d7f1a849b9a771504d1583ab28)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:35:03.943397 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0606ce1-1dae-48c1-90b4-6ff02a908aaa admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:35:03.955677 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1170/2342] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Oct 12 02:35:03 2022] PUT /identity/v3/projects/10804db524b648598eab0b1144f4e5e6/users/3cf21f40d35642658ae65e8a99f23c37/roles/3d75c4d7f1a849b9a771504d1583ab28 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 02:35:03.966223 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d135938-f92e-49d9-9889-a5724e431f22 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:35:03.966519 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d135938-f92e-49d9-9889-a5724e431f22 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:35:03.966828 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d135938-f92e-49d9-9889-a5724e431f22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:35:03.996956 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-4d135938-f92e-49d9-9889-a5724e431f22 None None] MFA Rules not processed for user `3cf21f40d35642658ae65e8a99f23c37`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:35:03.998165 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-4d135938-f92e-49d9-9889-a5724e431f22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:35:04.061462 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1173/2343] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 02:35:03 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 02:35:04.065879 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0606ce1-1dae-48c1-90b4-6ff02a908aaa admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:35:04.117317 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:35:04.129373 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0606ce1-1dae-48c1-90b4-6ff02a908aaa admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:35:04.134342 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d839ab-9cb9-4389-b037-51128f201e94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:35:04.134942 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d839ab-9cb9-4389-b037-51128f201e94 admin admin] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:35:04.135220 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d839ab-9cb9-4389-b037-51128f201e94 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:35:04.135493 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d839ab-9cb9-4389-b037-51128f201e94 admin admin] PATH_INFO: `/v3/projects` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:35:04.136114 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d839ab-9cb9-4389-b037-51128f201e94 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:35:04.138042 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d839ab-9cb9-4389-b037-51128f201e94 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:35:04.163954 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1171/2344] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Oct 12 02:35:04 2022] POST /identity/v3/projects => generated 361 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 02:35:04.168163 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d135938-f92e-49d9-9889-a5724e431f22 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:35:04.179467 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d135938-f92e-49d9-9889-a5724e431f22 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:35:04.230260 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:35:04.238748 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3009eef1-70c9-454a-a613-d55e49ef18c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:35:04.239365 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3009eef1-70c9-454a-a613-d55e49ef18c1 admin admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:35:04.239643 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3009eef1-70c9-454a-a613-d55e49ef18c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:35:04.239918 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3009eef1-70c9-454a-a613-d55e49ef18c1 admin admin] PATH_INFO: `/v3/users` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:35:04.240579 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3009eef1-70c9-454a-a613-d55e49ef18c1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:35:04.242484 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3009eef1-70c9-454a-a613-d55e49ef18c1 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:35:04.265750 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1174/2345] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Oct 12 02:35:04 2022] POST /identity/v3/users => generated 287 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 02:35:04.270468 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d839ab-9cb9-4389-b037-51128f201e94 admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:35:04.280405 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d839ab-9cb9-4389-b037-51128f201e94 admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:35:04.285531 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f961f8a4-ea71-42e9-bb4d-322fffa7db0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:35:04.286085 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f961f8a4-ea71-42e9-bb4d-322fffa7db0d admin admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:35:04.286357 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f961f8a4-ea71-42e9-bb4d-322fffa7db0d admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:35:04.286626 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f961f8a4-ea71-42e9-bb4d-322fffa7db0d admin admin] PATH_INFO: `/v3/roles` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:35:04.287257 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f961f8a4-ea71-42e9-bb4d-322fffa7db0d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:35:04.288854 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f961f8a4-ea71-42e9-bb4d-322fffa7db0d admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:35:04.299555 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1172/2346] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Oct 12 02:35:04 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 02:35:04.303585 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3009eef1-70c9-454a-a613-d55e49ef18c1 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:35:04.313477 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3009eef1-70c9-454a-a613-d55e49ef18c1 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:35:04.318652 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30946e8f-37c0-4270-a230-0859ff457d9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:35:04.319286 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30946e8f-37c0-4270-a230-0859ff457d9f admin admin] REQUEST_METHOD: `PUT` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:35:04.319559 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30946e8f-37c0-4270-a230-0859ff457d9f admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:35:04.319827 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30946e8f-37c0-4270-a230-0859ff457d9f admin admin] PATH_INFO: `/v3/projects/209f36a44904492aa8dbaa7e4abd477a/users/f8422bae00c245a9bc437369ac25e4ed/roles/39b1e8108dff402383def3c559f48189` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:35:04.334621 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30946e8f-37c0-4270-a230-0859ff457d9f admin admin] RBAC: Authorizing `identity:create_grant(project_id=209f36a44904492aa8dbaa7e4abd477a, user_id=f8422bae00c245a9bc437369ac25e4ed, role_id=39b1e8108dff402383def3c559f48189)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:35:04.337438 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30946e8f-37c0-4270-a230-0859ff457d9f admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:35:04.351005 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1175/2347] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Oct 12 02:35:04 2022] PUT /identity/v3/projects/209f36a44904492aa8dbaa7e4abd477a/users/f8422bae00c245a9bc437369ac25e4ed/roles/39b1e8108dff402383def3c559f48189 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 02:35:04.355106 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f961f8a4-ea71-42e9-bb4d-322fffa7db0d admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:35:04.365052 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f961f8a4-ea71-42e9-bb4d-322fffa7db0d admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:35:04.420789 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f0e167-0462-4fee-ae5f-c433328c319e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:35:04.421388 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f0e167-0462-4fee-ae5f-c433328c319e admin admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:35:04.421668 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f0e167-0462-4fee-ae5f-c433328c319e admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:35:04.421942 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f0e167-0462-4fee-ae5f-c433328c319e admin admin] PATH_INFO: `/v3/roles` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:35:04.422576 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f0e167-0462-4fee-ae5f-c433328c319e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:35:04.424162 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f0e167-0462-4fee-ae5f-c433328c319e admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:35:04.434009 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1173/2348] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Oct 12 02:35:04 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 02:35:04.438101 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30946e8f-37c0-4270-a230-0859ff457d9f admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:35:04.448438 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30946e8f-37c0-4270-a230-0859ff457d9f admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:35:04.453019 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebfd70f-c1fb-47f3-88a7-7ab280618b7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:35:04.453660 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebfd70f-c1fb-47f3-88a7-7ab280618b7c admin admin] REQUEST_METHOD: `PUT` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:35:04.453935 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebfd70f-c1fb-47f3-88a7-7ab280618b7c admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:35:04.454211 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebfd70f-c1fb-47f3-88a7-7ab280618b7c admin admin] PATH_INFO: `/v3/projects/209f36a44904492aa8dbaa7e4abd477a/users/f8422bae00c245a9bc437369ac25e4ed/roles/39b1e8108dff402383def3c559f48189` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:35:04.456098 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebfd70f-c1fb-47f3-88a7-7ab280618b7c admin admin] RBAC: Authorizing `identity:create_grant(project_id=209f36a44904492aa8dbaa7e4abd477a, user_id=f8422bae00c245a9bc437369ac25e4ed, role_id=39b1e8108dff402383def3c559f48189)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:35:04.459281 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebfd70f-c1fb-47f3-88a7-7ab280618b7c admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:35:04.469164 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1176/2349] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Oct 12 02:35:04 2022] PUT /identity/v3/projects/209f36a44904492aa8dbaa7e4abd477a/users/f8422bae00c245a9bc437369ac25e4ed/roles/39b1e8108dff402383def3c559f48189 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 02:35:04.481247 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd70bbd-0434-4069-948e-a92c4196885c None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:35:04.481468 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd70bbd-0434-4069-948e-a92c4196885c None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:35:04.481742 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd70bbd-0434-4069-948e-a92c4196885c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:35:04.509379 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-1cd70bbd-0434-4069-948e-a92c4196885c None None] MFA Rules not processed for user `f8422bae00c245a9bc437369ac25e4ed`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:35:04.510598 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-1cd70bbd-0434-4069-948e-a92c4196885c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:35:04.578112 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1174/2350] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 02:35:04 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 02:35:04.590393 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebfd70f-c1fb-47f3-88a7-7ab280618b7c admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:35:04.592155 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-6ebfd70f-c1fb-47f3-88a7-7ab280618b7c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:35:04.651896 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebfd70f-c1fb-47f3-88a7-7ab280618b7c admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:35:04.655912 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac990a80-9c33-4db3-8825-0d176842eae3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ba688e0c4d44d13898539ee886f95fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'beb6def6fcad45959e56425bb8bff4d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:35:04.656540 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac990a80-9c33-4db3-8825-0d176842eae3 service cinder] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:35:04.656818 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac990a80-9c33-4db3-8825-0d176842eae3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:35:04.657096 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac990a80-9c33-4db3-8825-0d176842eae3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:35:04.670855 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac990a80-9c33-4db3-8825-0d176842eae3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:35:04.672279 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac990a80-9c33-4db3-8825-0d176842eae3 service cinder] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:35:04.682786 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1177/2351] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 02:35:04 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 02:35:04.760731 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd70bbd-0434-4069-948e-a92c4196885c None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:35:04.771609 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd70bbd-0434-4069-948e-a92c4196885c None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:35:04.775231 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e2eca5-cc4a-4894-994d-4678d3a10b1d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ba688e0c4d44d13898539ee886f95fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'beb6def6fcad45959e56425bb8bff4d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:35:04.775829 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e2eca5-cc4a-4894-994d-4678d3a10b1d service cinder] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:35:04.776105 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e2eca5-cc4a-4894-994d-4678d3a10b1d service cinder] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:35:04.776376 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e2eca5-cc4a-4894-994d-4678d3a10b1d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:35:04.823405 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:35:04.837255 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e2eca5-cc4a-4894-994d-4678d3a10b1d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:35:04.838702 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e2eca5-cc4a-4894-994d-4678d3a10b1d service cinder] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:35:04.848330 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1175/2352] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 02:35:04 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 02:35:11.913164 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac990a80-9c33-4db3-8825-0d176842eae3 service cinder] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:35:11.976648 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac990a80-9c33-4db3-8825-0d176842eae3 service cinder] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:35:11.981438 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3728b6ab-3305-4804-baee-070e89fb7103 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:35:11.982090 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3728b6ab-3305-4804-baee-070e89fb7103 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:35:11.982405 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3728b6ab-3305-4804-baee-070e89fb7103 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:35:11.982675 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3728b6ab-3305-4804-baee-070e89fb7103 admin admin] PATH_INFO: `/v3/users/3cf21f40d35642658ae65e8a99f23c37` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:35:11.984056 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3728b6ab-3305-4804-baee-070e89fb7103 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3cf21f40d35642658ae65e8a99f23c37)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:35:11.986061 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3728b6ab-3305-4804-baee-070e89fb7103 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:35:12.036521 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-3728b6ab-3305-4804-baee-070e89fb7103 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3cf21f40d35642658ae65e8a99f23c37'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:35:12.041400 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=86,keystone:INSERT=6,keystone:DELETE=8 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:35:12.045448 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-3728b6ab-3305-4804-baee-070e89fb7103 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3cf21f40d35642658ae65e8a99f23c37'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:35:12.061553 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-3728b6ab-3305-4804-baee-070e89fb7103 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3cf21f40d35642658ae65e8a99f23c37'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:35:12.069463 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-3728b6ab-3305-4804-baee-070e89fb7103 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3cf21f40d35642658ae65e8a99f23c37'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:35:12.070194 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-3728b6ab-3305-4804-baee-070e89fb7103 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3cf21f40d35642658ae65e8a99f23c37'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:35:12.076408 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1178/2353] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Oct 12 02:35:11 2022] DELETE /identity/v3/users/3cf21f40d35642658ae65e8a99f23c37 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 02:35:12.081019 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a46298-0392-4d69-b380-204c58ad03f8 None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:35:12.081533 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a46298-0392-4d69-b380-204c58ad03f8 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:35:12.081631 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a46298-0392-4d69-b380-204c58ad03f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:35:12.102000 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-83a46298-0392-4d69-b380-204c58ad03f8 None None] MFA Rules not processed for user `a326a5bb7364479382f528a592371656`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:35:12.103227 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-83a46298-0392-4d69-b380-204c58ad03f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:35:12.166027 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1176/2354] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 02:35:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 02:35:12.176123 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3728b6ab-3305-4804-baee-070e89fb7103 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:35:12.177595 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-3728b6ab-3305-4804-baee-070e89fb7103 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:35:12.238047 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3728b6ab-3305-4804-baee-070e89fb7103 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:35:12.242749 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c60c33b-35f9-488e-aefb-b946f0cb3a95 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5223b5cab3114e9b9a13c582f8ef8386', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'beb6def6fcad45959e56425bb8bff4d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:35:12.243356 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c60c33b-35f9-488e-aefb-b946f0cb3a95 service neutron] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:35:12.243631 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c60c33b-35f9-488e-aefb-b946f0cb3a95 service neutron] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:35:12.243906 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c60c33b-35f9-488e-aefb-b946f0cb3a95 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:35:12.254239 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c60c33b-35f9-488e-aefb-b946f0cb3a95 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:35:12.255668 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c60c33b-35f9-488e-aefb-b946f0cb3a95 service neutron] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:35:12.265717 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1179/2355] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 02:35:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 02:35:12.560410 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a46298-0392-4d69-b380-204c58ad03f8 None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:35:12.562044 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-83a46298-0392-4d69-b380-204c58ad03f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:35:12.575172 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a46298-0392-4d69-b380-204c58ad03f8 None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:35:12.582267 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7584aba-fbc0-49a8-be3c-71363afdb4df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:35:12.582986 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7584aba-fbc0-49a8-be3c-71363afdb4df admin admin] REQUEST_METHOD: `DELETE` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:35:12.583349 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7584aba-fbc0-49a8-be3c-71363afdb4df admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:35:12.583688 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7584aba-fbc0-49a8-be3c-71363afdb4df admin admin] PATH_INFO: `/v3/projects/10804db524b648598eab0b1144f4e5e6` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:35:12.585867 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7584aba-fbc0-49a8-be3c-71363afdb4df admin admin] RBAC: Authorizing `identity:delete_project(project_id=10804db524b648598eab0b1144f4e5e6)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:35:12.588242 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7584aba-fbc0-49a8-be3c-71363afdb4df admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:35:12.637047 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-d7584aba-fbc0-49a8-be3c-71363afdb4df admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '10804db524b648598eab0b1144f4e5e6', 'request_id': 'req-d7584aba-fbc0-49a8-be3c-71363afdb4df'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:35:12.642405 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-d7584aba-fbc0-49a8-be3c-71363afdb4df admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '10804db524b648598eab0b1144f4e5e6', 'request_id': 'req-d7584aba-fbc0-49a8-be3c-71363afdb4df'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:35:12.649366 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-d7584aba-fbc0-49a8-be3c-71363afdb4df admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '10804db524b648598eab0b1144f4e5e6', 'request_id': 'req-d7584aba-fbc0-49a8-be3c-71363afdb4df'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:35:12.662982 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-d7584aba-fbc0-49a8-be3c-71363afdb4df admin admin] The token cache is being invalidate because project 10804db524b648598eab0b1144f4e5e6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81361) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 02:35:12.663273 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-d7584aba-fbc0-49a8-be3c-71363afdb4df admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:35:12.663920 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-d7584aba-fbc0-49a8-be3c-71363afdb4df admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:35:12.665437 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1177/2356] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Oct 12 02:35:12 2022] DELETE /identity/v3/projects/10804db524b648598eab0b1144f4e5e6 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 02:35:12.669399 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c60c33b-35f9-488e-aefb-b946f0cb3a95 service neutron] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:35:12.679705 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c60c33b-35f9-488e-aefb-b946f0cb3a95 service neutron] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:35:12.739698 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9cf5ba8-1a63-4428-8895-87133edc60b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:35:12.740533 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cf5ba8-1a63-4428-8895-87133edc60b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:35:12.740925 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cf5ba8-1a63-4428-8895-87133edc60b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:35:12.741203 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cf5ba8-1a63-4428-8895-87133edc60b4 admin admin] PATH_INFO: `/v3/users/f8422bae00c245a9bc437369ac25e4ed` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:35:12.742440 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9cf5ba8-1a63-4428-8895-87133edc60b4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f8422bae00c245a9bc437369ac25e4ed)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:35:12.744421 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9cf5ba8-1a63-4428-8895-87133edc60b4 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:35:12.792560 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-f9cf5ba8-1a63-4428-8895-87133edc60b4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f8422bae00c245a9bc437369ac25e4ed'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:35:12.803439 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-f9cf5ba8-1a63-4428-8895-87133edc60b4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f8422bae00c245a9bc437369ac25e4ed'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:35:12.816603 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-f9cf5ba8-1a63-4428-8895-87133edc60b4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f8422bae00c245a9bc437369ac25e4ed'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:35:12.819099 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:35:12.827301 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-f9cf5ba8-1a63-4428-8895-87133edc60b4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f8422bae00c245a9bc437369ac25e4ed'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:35:12.828157 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-f9cf5ba8-1a63-4428-8895-87133edc60b4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f8422bae00c245a9bc437369ac25e4ed'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:35:12.834634 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1180/2357] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Oct 12 02:35:12 2022] DELETE /identity/v3/users/f8422bae00c245a9bc437369ac25e4ed => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 02:35:13.113374 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7584aba-fbc0-49a8-be3c-71363afdb4df admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:35:13.114835 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-d7584aba-fbc0-49a8-be3c-71363afdb4df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:35:13.128388 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7584aba-fbc0-49a8-be3c-71363afdb4df admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:35:13.187256 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc442c86-ec17-48b7-b9ba-57e2e317cbb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:35:13.187996 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc442c86-ec17-48b7-b9ba-57e2e317cbb3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:35:13.188275 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc442c86-ec17-48b7-b9ba-57e2e317cbb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:35:13.188577 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc442c86-ec17-48b7-b9ba-57e2e317cbb3 admin admin] PATH_INFO: `/v3/projects/209f36a44904492aa8dbaa7e4abd477a` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:35:13.189733 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc442c86-ec17-48b7-b9ba-57e2e317cbb3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=209f36a44904492aa8dbaa7e4abd477a)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:35:13.191671 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc442c86-ec17-48b7-b9ba-57e2e317cbb3 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:35:13.204124 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:35:13.244051 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-bc442c86-ec17-48b7-b9ba-57e2e317cbb3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '209f36a44904492aa8dbaa7e4abd477a', 'request_id': 'req-bc442c86-ec17-48b7-b9ba-57e2e317cbb3'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:35:13.250159 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-bc442c86-ec17-48b7-b9ba-57e2e317cbb3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '209f36a44904492aa8dbaa7e4abd477a', 'request_id': 'req-bc442c86-ec17-48b7-b9ba-57e2e317cbb3'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:35:13.257213 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-bc442c86-ec17-48b7-b9ba-57e2e317cbb3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '209f36a44904492aa8dbaa7e4abd477a', 'request_id': 'req-bc442c86-ec17-48b7-b9ba-57e2e317cbb3'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:35:13.270274 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-bc442c86-ec17-48b7-b9ba-57e2e317cbb3 admin admin] The token cache is being invalidate because project 209f36a44904492aa8dbaa7e4abd477a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81361) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 02:35:13.270559 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-bc442c86-ec17-48b7-b9ba-57e2e317cbb3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:35:13.271179 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-bc442c86-ec17-48b7-b9ba-57e2e317cbb3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:35:13.273082 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1178/2358] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Oct 12 02:35:13 2022] DELETE /identity/v3/projects/209f36a44904492aa8dbaa7e4abd477a => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 02:35:13.278177 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9146fa-8101-4ef5-80b3-14436f38a361 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:35:13.278684 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9146fa-8101-4ef5-80b3-14436f38a361 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:35:13.278783 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9146fa-8101-4ef5-80b3-14436f38a361 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:35:13.298430 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-ae9146fa-8101-4ef5-80b3-14436f38a361 None None] MFA Rules not processed for user `a326a5bb7364479382f528a592371656`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:35:13.299646 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-ae9146fa-8101-4ef5-80b3-14436f38a361 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:35:13.359388 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1181/2359] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 02:35:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 02:35:13.367603 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e0d9a4-0e8f-4ed9-a824-496e966cc43d None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:35:13.367881 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e0d9a4-0e8f-4ed9-a824-496e966cc43d None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:35:13.368148 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e0d9a4-0e8f-4ed9-a824-496e966cc43d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:35:13.389633 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-88e0d9a4-0e8f-4ed9-a824-496e966cc43d None None] MFA Rules not processed for user `a326a5bb7364479382f528a592371656`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:35:13.390830 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-88e0d9a4-0e8f-4ed9-a824-496e966cc43d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:35:13.398688 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1179/2360] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 02:35:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 02:35:13.402931 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9146fa-8101-4ef5-80b3-14436f38a361 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:35:13.412934 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9146fa-8101-4ef5-80b3-14436f38a361 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:35:13.417747 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29895c41-12e3-4e34-9fb1-1b4d62e68f1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:35:13.418361 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29895c41-12e3-4e34-9fb1-1b4d62e68f1b admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:35:13.418640 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29895c41-12e3-4e34-9fb1-1b4d62e68f1b admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:35:13.418914 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29895c41-12e3-4e34-9fb1-1b4d62e68f1b admin admin] PATH_INFO: `/v3/domains` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:35:13.419565 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29895c41-12e3-4e34-9fb1-1b4d62e68f1b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 02:35:13.419896 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29895c41-12e3-4e34-9fb1-1b4d62e68f1b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:35:13.421554 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29895c41-12e3-4e34-9fb1-1b4d62e68f1b admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:35:13.434520 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1182/2361] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Oct 12 02:35:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 02:35:13.439342 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e0d9a4-0e8f-4ed9-a824-496e966cc43d None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:35:13.449760 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e0d9a4-0e8f-4ed9-a824-496e966cc43d None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:35:13.454356 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c5d22f-c592-4ef2-9d57-bf9b8d57d537 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:35:13.454975 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c5d22f-c592-4ef2-9d57-bf9b8d57d537 admin admin] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:35:13.455251 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c5d22f-c592-4ef2-9d57-bf9b8d57d537 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:35:13.455524 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c5d22f-c592-4ef2-9d57-bf9b8d57d537 admin admin] PATH_INFO: `/v3/projects` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:35:13.456144 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c5d22f-c592-4ef2-9d57-bf9b8d57d537 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:35:13.458070 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c5d22f-c592-4ef2-9d57-bf9b8d57d537 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:35:13.491342 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1180/2362] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Oct 12 02:35:13 2022] POST /identity/v3/projects => generated 379 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 02:35:13.492859 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29895c41-12e3-4e34-9fb1-1b4d62e68f1b admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:35:13.503142 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29895c41-12e3-4e34-9fb1-1b4d62e68f1b admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:35:13.568108 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a86155-012d-46e6-b38b-2ebe59f5d043 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:35:13.568784 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a86155-012d-46e6-b38b-2ebe59f5d043 admin admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:35:13.569059 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a86155-012d-46e6-b38b-2ebe59f5d043 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:35:13.569334 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a86155-012d-46e6-b38b-2ebe59f5d043 admin admin] PATH_INFO: `/v3/users` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:35:13.569962 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a86155-012d-46e6-b38b-2ebe59f5d043 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:35:13.572092 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a86155-012d-46e6-b38b-2ebe59f5d043 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:35:13.594806 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1183/2363] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Oct 12 02:35:13 2022] POST /identity/v3/users => generated 290 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 02:35:13.598776 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c5d22f-c592-4ef2-9d57-bf9b8d57d537 admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:35:13.610921 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c5d22f-c592-4ef2-9d57-bf9b8d57d537 admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:35:13.616229 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3760956d-912c-4d7d-b586-4eca4ef78b72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:35:13.617012 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3760956d-912c-4d7d-b586-4eca4ef78b72 admin admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:35:13.617289 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3760956d-912c-4d7d-b586-4eca4ef78b72 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:35:13.617565 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3760956d-912c-4d7d-b586-4eca4ef78b72 admin admin] PATH_INFO: `/v3/roles` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:35:13.618207 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3760956d-912c-4d7d-b586-4eca4ef78b72 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:35:13.619792 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3760956d-912c-4d7d-b586-4eca4ef78b72 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:35:13.629887 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1181/2364] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Oct 12 02:35:13 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 02:35:13.634654 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a86155-012d-46e6-b38b-2ebe59f5d043 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:35:13.644820 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a86155-012d-46e6-b38b-2ebe59f5d043 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:35:13.649436 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e98cb7e-4ef9-4c37-9e93-c39bdd4785a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:35:13.650035 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e98cb7e-4ef9-4c37-9e93-c39bdd4785a2 admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:35:13.650310 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e98cb7e-4ef9-4c37-9e93-c39bdd4785a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:35:13.650578 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e98cb7e-4ef9-4c37-9e93-c39bdd4785a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:35:13.651217 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e98cb7e-4ef9-4c37-9e93-c39bdd4785a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:35:13.652909 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e98cb7e-4ef9-4c37-9e93-c39bdd4785a2 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:35:13.664189 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1184/2365] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Oct 12 02:35:13 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 02:35:13.668378 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3760956d-912c-4d7d-b586-4eca4ef78b72 admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:35:13.679505 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3760956d-912c-4d7d-b586-4eca4ef78b72 admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:35:13.684157 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c19bd4-b1d5-4cc8-a862-21111e9e03fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:35:13.684850 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c19bd4-b1d5-4cc8-a862-21111e9e03fc admin admin] REQUEST_METHOD: `PUT` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:35:13.685125 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c19bd4-b1d5-4cc8-a862-21111e9e03fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:35:13.685398 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c19bd4-b1d5-4cc8-a862-21111e9e03fc admin admin] PATH_INFO: `/v3/projects/98c81dbd02b64034aa4115091bec9893/users/e65dedecdec54b1cbc7442323698f34a/roles/3d75c4d7f1a849b9a771504d1583ab28` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:35:13.700735 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c19bd4-b1d5-4cc8-a862-21111e9e03fc admin admin] RBAC: Authorizing `identity:create_grant(project_id=98c81dbd02b64034aa4115091bec9893, user_id=e65dedecdec54b1cbc7442323698f34a, role_id=3d75c4d7f1a849b9a771504d1583ab28)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:35:13.703390 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c19bd4-b1d5-4cc8-a862-21111e9e03fc admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:35:13.716665 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1182/2366] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Oct 12 02:35:13 2022] PUT /identity/v3/projects/98c81dbd02b64034aa4115091bec9893/users/e65dedecdec54b1cbc7442323698f34a/roles/3d75c4d7f1a849b9a771504d1583ab28 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 02:35:13.729484 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667c46b6-850c-4fae-938b-876b439bdedd None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:35:13.729767 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667c46b6-850c-4fae-938b-876b439bdedd None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:35:13.730067 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667c46b6-850c-4fae-938b-876b439bdedd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:35:13.760250 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-667c46b6-850c-4fae-938b-876b439bdedd None None] MFA Rules not processed for user `e65dedecdec54b1cbc7442323698f34a`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:35:13.761499 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-667c46b6-850c-4fae-938b-876b439bdedd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:35:13.807076 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:35:13.829136 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1185/2367] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 02:35:13 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 02:35:13.833525 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c19bd4-b1d5-4cc8-a862-21111e9e03fc admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:35:13.897883 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c19bd4-b1d5-4cc8-a862-21111e9e03fc admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:35:13.902397 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cf697c-42ee-4bc1-9713-9144af266345 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:35:13.902991 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cf697c-42ee-4bc1-9713-9144af266345 admin admin] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:35:13.903266 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cf697c-42ee-4bc1-9713-9144af266345 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:35:13.903535 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cf697c-42ee-4bc1-9713-9144af266345 admin admin] PATH_INFO: `/v3/projects` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:35:13.904154 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50cf697c-42ee-4bc1-9713-9144af266345 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:35:13.906271 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50cf697c-42ee-4bc1-9713-9144af266345 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:35:13.933971 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1183/2368] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Oct 12 02:35:13 2022] POST /identity/v3/projects => generated 381 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 02:35:13.938296 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667c46b6-850c-4fae-938b-876b439bdedd None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:35:13.949680 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667c46b6-850c-4fae-938b-876b439bdedd None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:35:14.010473 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352074d9-ccb2-4c67-a859-876bfee91cdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:35:14.011079 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352074d9-ccb2-4c67-a859-876bfee91cdf admin admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:35:14.011355 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352074d9-ccb2-4c67-a859-876bfee91cdf admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:35:14.011625 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352074d9-ccb2-4c67-a859-876bfee91cdf admin admin] PATH_INFO: `/v3/users` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:35:14.012279 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352074d9-ccb2-4c67-a859-876bfee91cdf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:35:14.014198 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352074d9-ccb2-4c67-a859-876bfee91cdf admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:35:14.036417 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1186/2369] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Oct 12 02:35:13 2022] POST /identity/v3/users => generated 297 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 02:35:14.041287 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cf697c-42ee-4bc1-9713-9144af266345 admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:35:14.052004 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cf697c-42ee-4bc1-9713-9144af266345 admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:35:14.056616 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d61839-2352-47b5-98f8-617f6ded53b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:35:14.057215 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d61839-2352-47b5-98f8-617f6ded53b7 admin admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:35:14.057489 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d61839-2352-47b5-98f8-617f6ded53b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:35:14.057757 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d61839-2352-47b5-98f8-617f6ded53b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:35:14.058392 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d61839-2352-47b5-98f8-617f6ded53b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:35:14.059978 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d61839-2352-47b5-98f8-617f6ded53b7 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:35:14.071165 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1184/2370] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Oct 12 02:35:14 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 02:35:14.076260 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352074d9-ccb2-4c67-a859-876bfee91cdf admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:35:14.086983 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352074d9-ccb2-4c67-a859-876bfee91cdf admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:35:14.091609 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ec4081-b8c3-4f21-b4a9-6dbea465cdd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:35:14.092260 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ec4081-b8c3-4f21-b4a9-6dbea465cdd5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:35:14.092569 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ec4081-b8c3-4f21-b4a9-6dbea465cdd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:35:14.092844 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ec4081-b8c3-4f21-b4a9-6dbea465cdd5 admin admin] PATH_INFO: `/v3/projects/a0bc52499c1c43159dc564d1e7d97477/users/41a29de765c54cc3af11a12dd4033c8c/roles/39b1e8108dff402383def3c559f48189` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:35:14.108771 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ec4081-b8c3-4f21-b4a9-6dbea465cdd5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a0bc52499c1c43159dc564d1e7d97477, user_id=41a29de765c54cc3af11a12dd4033c8c, role_id=39b1e8108dff402383def3c559f48189)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:35:14.111408 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ec4081-b8c3-4f21-b4a9-6dbea465cdd5 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:35:14.125633 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1187/2371] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Oct 12 02:35:14 2022] PUT /identity/v3/projects/a0bc52499c1c43159dc564d1e7d97477/users/41a29de765c54cc3af11a12dd4033c8c/roles/39b1e8108dff402383def3c559f48189 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 02:35:14.129663 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d61839-2352-47b5-98f8-617f6ded53b7 admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:35:14.140161 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d61839-2352-47b5-98f8-617f6ded53b7 admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:35:14.148656 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:35:14.200775 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359323d0-680c-45e2-93ca-3b7a0dc3e868 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:35:14.201379 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359323d0-680c-45e2-93ca-3b7a0dc3e868 admin admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:35:14.201656 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359323d0-680c-45e2-93ca-3b7a0dc3e868 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:35:14.201924 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359323d0-680c-45e2-93ca-3b7a0dc3e868 admin admin] PATH_INFO: `/v3/roles` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:35:14.202559 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359323d0-680c-45e2-93ca-3b7a0dc3e868 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:35:14.204145 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359323d0-680c-45e2-93ca-3b7a0dc3e868 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:35:14.215293 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1185/2372] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Oct 12 02:35:14 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 02:35:14.219449 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ec4081-b8c3-4f21-b4a9-6dbea465cdd5 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:35:14.230644 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ec4081-b8c3-4f21-b4a9-6dbea465cdd5 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:35:14.235231 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf71595-2196-4193-9957-5cc05dc07a63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:35:14.235885 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf71595-2196-4193-9957-5cc05dc07a63 admin admin] REQUEST_METHOD: `PUT` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:35:14.236163 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf71595-2196-4193-9957-5cc05dc07a63 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:35:14.236432 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf71595-2196-4193-9957-5cc05dc07a63 admin admin] PATH_INFO: `/v3/projects/a0bc52499c1c43159dc564d1e7d97477/users/41a29de765c54cc3af11a12dd4033c8c/roles/39b1e8108dff402383def3c559f48189` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:35:14.238364 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf71595-2196-4193-9957-5cc05dc07a63 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a0bc52499c1c43159dc564d1e7d97477, user_id=41a29de765c54cc3af11a12dd4033c8c, role_id=39b1e8108dff402383def3c559f48189)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:35:14.241350 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf71595-2196-4193-9957-5cc05dc07a63 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:35:14.253130 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1188/2373] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Oct 12 02:35:14 2022] PUT /identity/v3/projects/a0bc52499c1c43159dc564d1e7d97477/users/41a29de765c54cc3af11a12dd4033c8c/roles/39b1e8108dff402383def3c559f48189 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 02:35:14.263904 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6a31e7-f160-45fe-8c46-27acae5ba567 None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:35:14.264169 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6a31e7-f160-45fe-8c46-27acae5ba567 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:35:14.264443 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6a31e7-f160-45fe-8c46-27acae5ba567 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:35:14.293374 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-5b6a31e7-f160-45fe-8c46-27acae5ba567 None None] MFA Rules not processed for user `41a29de765c54cc3af11a12dd4033c8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:35:14.294744 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-5b6a31e7-f160-45fe-8c46-27acae5ba567 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:35:14.365288 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1186/2374] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 02:35:14 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 02:35:14.377403 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf71595-2196-4193-9957-5cc05dc07a63 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:35:14.379119 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-0bf71595-2196-4193-9957-5cc05dc07a63 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:35:14.437310 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf71595-2196-4193-9957-5cc05dc07a63 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:35:14.440881 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b074999c-6a9a-4140-9ca3-44d8150ca6bc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ba688e0c4d44d13898539ee886f95fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'beb6def6fcad45959e56425bb8bff4d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:35:14.441489 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b074999c-6a9a-4140-9ca3-44d8150ca6bc service cinder] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:35:14.441767 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b074999c-6a9a-4140-9ca3-44d8150ca6bc service cinder] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:35:14.442037 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b074999c-6a9a-4140-9ca3-44d8150ca6bc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:35:14.452091 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b074999c-6a9a-4140-9ca3-44d8150ca6bc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:35:14.453533 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b074999c-6a9a-4140-9ca3-44d8150ca6bc service cinder] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:35:14.464742 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1189/2375] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 02:35:14 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 02:35:14.781321 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6a31e7-f160-45fe-8c46-27acae5ba567 None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:35:14.790560 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6a31e7-f160-45fe-8c46-27acae5ba567 None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:35:14.795401 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0127b4e-315a-49b4-b267-87ac06032642 tempest-VolumeQuotaClassesTest-1354256416 tempest-VolumeQuotaClassesTest-1354256416-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41a29de765c54cc3af11a12dd4033c8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0bc52499c1c43159dc564d1e7d97477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:35:14.796032 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0127b4e-315a-49b4-b267-87ac06032642 tempest-VolumeQuotaClassesTest-1354256416 tempest-VolumeQuotaClassesTest-1354256416-project-admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:35:14.796316 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0127b4e-315a-49b4-b267-87ac06032642 tempest-VolumeQuotaClassesTest-1354256416 tempest-VolumeQuotaClassesTest-1354256416-project-admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:35:14.796638 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0127b4e-315a-49b4-b267-87ac06032642 tempest-VolumeQuotaClassesTest-1354256416 tempest-VolumeQuotaClassesTest-1354256416-project-admin] PATH_INFO: `/v3/domains` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:35:14.797367 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0127b4e-315a-49b4-b267-87ac06032642 tempest-VolumeQuotaClassesTest-1354256416 tempest-VolumeQuotaClassesTest-1354256416-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 02:35:14.797700 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0127b4e-315a-49b4-b267-87ac06032642 tempest-VolumeQuotaClassesTest-1354256416 tempest-VolumeQuotaClassesTest-1354256416-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:35:14.799403 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0127b4e-315a-49b4-b267-87ac06032642 tempest-VolumeQuotaClassesTest-1354256416 tempest-VolumeQuotaClassesTest-1354256416-project-admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:35:14.812647 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1187/2376] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Oct 12 02:35:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 02:35:14.816754 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b074999c-6a9a-4140-9ca3-44d8150ca6bc service cinder] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:35:14.826757 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b074999c-6a9a-4140-9ca3-44d8150ca6bc service cinder] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:35:14.831413 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1866b347-8d97-406f-9e2b-1886bf19a6db tempest-VolumeQuotaClassesTest-1354256416 tempest-VolumeQuotaClassesTest-1354256416-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41a29de765c54cc3af11a12dd4033c8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0bc52499c1c43159dc564d1e7d97477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:35:14.832031 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1866b347-8d97-406f-9e2b-1886bf19a6db tempest-VolumeQuotaClassesTest-1354256416 tempest-VolumeQuotaClassesTest-1354256416-project-admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:35:14.832312 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1866b347-8d97-406f-9e2b-1886bf19a6db tempest-VolumeQuotaClassesTest-1354256416 tempest-VolumeQuotaClassesTest-1354256416-project-admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:35:14.832640 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1866b347-8d97-406f-9e2b-1886bf19a6db tempest-VolumeQuotaClassesTest-1354256416 tempest-VolumeQuotaClassesTest-1354256416-project-admin] PATH_INFO: `/v3/projects` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:35:14.833349 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1866b347-8d97-406f-9e2b-1886bf19a6db tempest-VolumeQuotaClassesTest-1354256416 tempest-VolumeQuotaClassesTest-1354256416-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:35:14.835477 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1866b347-8d97-406f-9e2b-1886bf19a6db tempest-VolumeQuotaClassesTest-1354256416 tempest-VolumeQuotaClassesTest-1354256416-project-admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:35:14.865042 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1190/2377] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Oct 12 02:35:14 2022] POST /identity/v3/projects => generated 355 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 02:35:14.867165 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0127b4e-315a-49b4-b267-87ac06032642 tempest-VolumeQuotaClassesTest-1354256416 tempest-VolumeQuotaClassesTest-1354256416-project-admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:35:14.877142 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0127b4e-315a-49b4-b267-87ac06032642 tempest-VolumeQuotaClassesTest-1354256416 tempest-VolumeQuotaClassesTest-1354256416-project-admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:35:14.934800 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6422f7c-1cdf-41a3-af9b-336985ae2eae tempest-VolumeQuotaClassesTest-1354256416 tempest-VolumeQuotaClassesTest-1354256416-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41a29de765c54cc3af11a12dd4033c8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0bc52499c1c43159dc564d1e7d97477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:35:14.935426 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6422f7c-1cdf-41a3-af9b-336985ae2eae tempest-VolumeQuotaClassesTest-1354256416 tempest-VolumeQuotaClassesTest-1354256416-project-admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:35:14.935708 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6422f7c-1cdf-41a3-af9b-336985ae2eae tempest-VolumeQuotaClassesTest-1354256416 tempest-VolumeQuotaClassesTest-1354256416-project-admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:35:14.935984 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6422f7c-1cdf-41a3-af9b-336985ae2eae tempest-VolumeQuotaClassesTest-1354256416 tempest-VolumeQuotaClassesTest-1354256416-project-admin] PATH_INFO: `/v3/domains` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:35:14.936668 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6422f7c-1cdf-41a3-af9b-336985ae2eae tempest-VolumeQuotaClassesTest-1354256416 tempest-VolumeQuotaClassesTest-1354256416-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 02:35:14.937004 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6422f7c-1cdf-41a3-af9b-336985ae2eae tempest-VolumeQuotaClassesTest-1354256416 tempest-VolumeQuotaClassesTest-1354256416-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:35:14.938598 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6422f7c-1cdf-41a3-af9b-336985ae2eae tempest-VolumeQuotaClassesTest-1354256416 tempest-VolumeQuotaClassesTest-1354256416-project-admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:35:14.951538 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1188/2378] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Oct 12 02:35:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 02:35:14.988824 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1866b347-8d97-406f-9e2b-1886bf19a6db tempest-VolumeQuotaClassesTest-1354256416 tempest-VolumeQuotaClassesTest-1354256416-project-admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:35:15.000562 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1866b347-8d97-406f-9e2b-1886bf19a6db tempest-VolumeQuotaClassesTest-1354256416 tempest-VolumeQuotaClassesTest-1354256416-project-admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:35:15.005165 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca078fd-a4ed-4558-902e-efe6949bd429 tempest-VolumeQuotaClassesTest-1354256416 tempest-VolumeQuotaClassesTest-1354256416-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41a29de765c54cc3af11a12dd4033c8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0bc52499c1c43159dc564d1e7d97477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:35:15.006909 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca078fd-a4ed-4558-902e-efe6949bd429 tempest-VolumeQuotaClassesTest-1354256416 tempest-VolumeQuotaClassesTest-1354256416-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:35:15.007201 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca078fd-a4ed-4558-902e-efe6949bd429 tempest-VolumeQuotaClassesTest-1354256416 tempest-VolumeQuotaClassesTest-1354256416-project-admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:35:15.007477 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca078fd-a4ed-4558-902e-efe6949bd429 tempest-VolumeQuotaClassesTest-1354256416 tempest-VolumeQuotaClassesTest-1354256416-project-admin] PATH_INFO: `/v3/projects/def9bf0be49845ee9d7ec92668b3aad0` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:35:15.008646 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca078fd-a4ed-4558-902e-efe6949bd429 tempest-VolumeQuotaClassesTest-1354256416 tempest-VolumeQuotaClassesTest-1354256416-project-admin] RBAC: Authorizing `identity:delete_project(project_id=def9bf0be49845ee9d7ec92668b3aad0)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:35:15.010537 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca078fd-a4ed-4558-902e-efe6949bd429 tempest-VolumeQuotaClassesTest-1354256416 tempest-VolumeQuotaClassesTest-1354256416-project-admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:35:15.029161 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:35:15.062267 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-eca078fd-a4ed-4558-902e-efe6949bd429 tempest-VolumeQuotaClassesTest-1354256416 tempest-VolumeQuotaClassesTest-1354256416-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'def9bf0be49845ee9d7ec92668b3aad0', 'request_id': 'req-eca078fd-a4ed-4558-902e-efe6949bd429'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:35:15.067808 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-eca078fd-a4ed-4558-902e-efe6949bd429 tempest-VolumeQuotaClassesTest-1354256416 tempest-VolumeQuotaClassesTest-1354256416-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'def9bf0be49845ee9d7ec92668b3aad0', 'request_id': 'req-eca078fd-a4ed-4558-902e-efe6949bd429'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:35:15.075927 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-eca078fd-a4ed-4558-902e-efe6949bd429 tempest-VolumeQuotaClassesTest-1354256416 tempest-VolumeQuotaClassesTest-1354256416-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'def9bf0be49845ee9d7ec92668b3aad0', 'request_id': 'req-eca078fd-a4ed-4558-902e-efe6949bd429'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:35:15.089013 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-eca078fd-a4ed-4558-902e-efe6949bd429 tempest-VolumeQuotaClassesTest-1354256416 tempest-VolumeQuotaClassesTest-1354256416-project-admin] The token cache is being invalidate because project def9bf0be49845ee9d7ec92668b3aad0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81362) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 02:35:15.089304 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-eca078fd-a4ed-4558-902e-efe6949bd429 tempest-VolumeQuotaClassesTest-1354256416 tempest-VolumeQuotaClassesTest-1354256416-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:35:15.089957 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-eca078fd-a4ed-4558-902e-efe6949bd429 tempest-VolumeQuotaClassesTest-1354256416 tempest-VolumeQuotaClassesTest-1354256416-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:35:15.091446 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1191/2379] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Oct 12 02:35:14 2022] DELETE /identity/v3/projects/def9bf0be49845ee9d7ec92668b3aad0 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 02:35:15.294137 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6422f7c-1cdf-41a3-af9b-336985ae2eae tempest-VolumeQuotaClassesTest-1354256416 tempest-VolumeQuotaClassesTest-1354256416-project-admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:35:15.296110 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-f6422f7c-1cdf-41a3-af9b-336985ae2eae tempest-VolumeQuotaClassesTest-1354256416 tempest-VolumeQuotaClassesTest-1354256416-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:35:15.310715 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:35:15.362635 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6422f7c-1cdf-41a3-af9b-336985ae2eae tempest-VolumeQuotaClassesTest-1354256416 tempest-VolumeQuotaClassesTest-1354256416-project-admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:35:15.420916 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04dc808e-4c9f-4d49-886d-7440ee7dbe02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:35:15.421624 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dc808e-4c9f-4d49-886d-7440ee7dbe02 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:35:15.421972 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dc808e-4c9f-4d49-886d-7440ee7dbe02 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:35:15.422327 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dc808e-4c9f-4d49-886d-7440ee7dbe02 admin admin] PATH_INFO: `/v3/users/e65dedecdec54b1cbc7442323698f34a` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:35:15.423494 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04dc808e-4c9f-4d49-886d-7440ee7dbe02 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e65dedecdec54b1cbc7442323698f34a)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:35:15.425448 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04dc808e-4c9f-4d49-886d-7440ee7dbe02 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:35:15.474086 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-04dc808e-4c9f-4d49-886d-7440ee7dbe02 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e65dedecdec54b1cbc7442323698f34a'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:35:15.481457 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-04dc808e-4c9f-4d49-886d-7440ee7dbe02 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e65dedecdec54b1cbc7442323698f34a'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:35:15.494441 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-04dc808e-4c9f-4d49-886d-7440ee7dbe02 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e65dedecdec54b1cbc7442323698f34a'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:35:15.501158 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-04dc808e-4c9f-4d49-886d-7440ee7dbe02 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e65dedecdec54b1cbc7442323698f34a'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:35:15.501860 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-04dc808e-4c9f-4d49-886d-7440ee7dbe02 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e65dedecdec54b1cbc7442323698f34a'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:35:15.508734 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1189/2380] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Oct 12 02:35:15 2022] DELETE /identity/v3/users/e65dedecdec54b1cbc7442323698f34a => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 02:35:15.513980 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14851fab-b592-456b-a71e-cfeca06ed9eb None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:35:15.514490 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14851fab-b592-456b-a71e-cfeca06ed9eb None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:35:15.514601 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14851fab-b592-456b-a71e-cfeca06ed9eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:35:15.533972 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-14851fab-b592-456b-a71e-cfeca06ed9eb None None] MFA Rules not processed for user `a326a5bb7364479382f528a592371656`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:35:15.535112 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-14851fab-b592-456b-a71e-cfeca06ed9eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:35:15.597114 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1192/2381] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 02:35:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 02:35:15.607401 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04dc808e-4c9f-4d49-886d-7440ee7dbe02 admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:35:15.608880 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-04dc808e-4c9f-4d49-886d-7440ee7dbe02 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:35:15.658662 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:35:15.675858 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04dc808e-4c9f-4d49-886d-7440ee7dbe02 admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:35:15.681227 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4411dc7a-7a04-43fd-a138-4c6bf6be39a5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5223b5cab3114e9b9a13c582f8ef8386', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'beb6def6fcad45959e56425bb8bff4d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:35:15.681833 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4411dc7a-7a04-43fd-a138-4c6bf6be39a5 service neutron] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:35:15.682106 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4411dc7a-7a04-43fd-a138-4c6bf6be39a5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:35:15.682374 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4411dc7a-7a04-43fd-a138-4c6bf6be39a5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:35:15.691715 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4411dc7a-7a04-43fd-a138-4c6bf6be39a5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:35:15.693218 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4411dc7a-7a04-43fd-a138-4c6bf6be39a5 service neutron] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:35:15.703250 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1190/2382] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 02:35:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 02:35:15.980543 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14851fab-b592-456b-a71e-cfeca06ed9eb None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:35:15.982065 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-14851fab-b592-456b-a71e-cfeca06ed9eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:35:15.994677 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14851fab-b592-456b-a71e-cfeca06ed9eb None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:35:16.000059 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db727d02-9985-495c-9de4-413eefb5c0f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:35:16.000736 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db727d02-9985-495c-9de4-413eefb5c0f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:35:16.001015 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db727d02-9985-495c-9de4-413eefb5c0f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:35:16.001287 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db727d02-9985-495c-9de4-413eefb5c0f0 admin admin] PATH_INFO: `/v3/projects/98c81dbd02b64034aa4115091bec9893` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:35:16.002477 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db727d02-9985-495c-9de4-413eefb5c0f0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=98c81dbd02b64034aa4115091bec9893)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:35:16.004569 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db727d02-9985-495c-9de4-413eefb5c0f0 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:35:16.055308 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-db727d02-9985-495c-9de4-413eefb5c0f0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '98c81dbd02b64034aa4115091bec9893', 'request_id': 'req-db727d02-9985-495c-9de4-413eefb5c0f0'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:35:16.060722 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-db727d02-9985-495c-9de4-413eefb5c0f0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '98c81dbd02b64034aa4115091bec9893', 'request_id': 'req-db727d02-9985-495c-9de4-413eefb5c0f0'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:35:16.067063 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-db727d02-9985-495c-9de4-413eefb5c0f0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '98c81dbd02b64034aa4115091bec9893', 'request_id': 'req-db727d02-9985-495c-9de4-413eefb5c0f0'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:35:16.081584 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-db727d02-9985-495c-9de4-413eefb5c0f0 admin admin] The token cache is being invalidate because project 98c81dbd02b64034aa4115091bec9893 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81362) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 02:35:16.081876 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-db727d02-9985-495c-9de4-413eefb5c0f0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:35:16.082502 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-db727d02-9985-495c-9de4-413eefb5c0f0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:35:16.084900 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1193/2383] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Oct 12 02:35:15 2022] DELETE /identity/v3/projects/98c81dbd02b64034aa4115091bec9893 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 02:35:16.088697 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4411dc7a-7a04-43fd-a138-4c6bf6be39a5 service neutron] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:35:16.098262 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4411dc7a-7a04-43fd-a138-4c6bf6be39a5 service neutron] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:35:16.155150 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d69fcb-00e9-4f03-98ce-f6ad66f12afa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:35:16.155858 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d69fcb-00e9-4f03-98ce-f6ad66f12afa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:35:16.156136 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d69fcb-00e9-4f03-98ce-f6ad66f12afa admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:35:16.156407 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d69fcb-00e9-4f03-98ce-f6ad66f12afa admin admin] PATH_INFO: `/v3/users/41a29de765c54cc3af11a12dd4033c8c` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:35:16.157548 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d69fcb-00e9-4f03-98ce-f6ad66f12afa admin admin] RBAC: Authorizing `identity:delete_user(user_id=41a29de765c54cc3af11a12dd4033c8c)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:35:16.159473 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d69fcb-00e9-4f03-98ce-f6ad66f12afa admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:35:16.207833 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-d2d69fcb-00e9-4f03-98ce-f6ad66f12afa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '41a29de765c54cc3af11a12dd4033c8c'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:35:16.215646 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-d2d69fcb-00e9-4f03-98ce-f6ad66f12afa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '41a29de765c54cc3af11a12dd4033c8c'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:35:16.228285 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-d2d69fcb-00e9-4f03-98ce-f6ad66f12afa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '41a29de765c54cc3af11a12dd4033c8c'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:35:16.235521 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-d2d69fcb-00e9-4f03-98ce-f6ad66f12afa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '41a29de765c54cc3af11a12dd4033c8c'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:35:16.236234 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-d2d69fcb-00e9-4f03-98ce-f6ad66f12afa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '41a29de765c54cc3af11a12dd4033c8c'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:35:16.242527 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1191/2384] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Oct 12 02:35:16 2022] DELETE /identity/v3/users/41a29de765c54cc3af11a12dd4033c8c => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 02:35:16.522058 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db727d02-9985-495c-9de4-413eefb5c0f0 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:35:16.523672 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-db727d02-9985-495c-9de4-413eefb5c0f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:35:16.539056 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db727d02-9985-495c-9de4-413eefb5c0f0 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:35:16.567063 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:35:16.605749 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c1272a-7cc9-4256-a8c9-f9accf981d47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:35:16.606317 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c1272a-7cc9-4256-a8c9-f9accf981d47 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:35:16.606602 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c1272a-7cc9-4256-a8c9-f9accf981d47 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:35:16.606874 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c1272a-7cc9-4256-a8c9-f9accf981d47 admin admin] PATH_INFO: `/v3/projects/a0bc52499c1c43159dc564d1e7d97477` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:35:16.608124 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c1272a-7cc9-4256-a8c9-f9accf981d47 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a0bc52499c1c43159dc564d1e7d97477)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:35:16.610080 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c1272a-7cc9-4256-a8c9-f9accf981d47 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:35:16.660141 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-90c1272a-7cc9-4256-a8c9-f9accf981d47 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a0bc52499c1c43159dc564d1e7d97477', 'request_id': 'req-90c1272a-7cc9-4256-a8c9-f9accf981d47'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:35:16.668955 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-90c1272a-7cc9-4256-a8c9-f9accf981d47 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a0bc52499c1c43159dc564d1e7d97477', 'request_id': 'req-90c1272a-7cc9-4256-a8c9-f9accf981d47'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:35:16.676167 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-90c1272a-7cc9-4256-a8c9-f9accf981d47 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a0bc52499c1c43159dc564d1e7d97477', 'request_id': 'req-90c1272a-7cc9-4256-a8c9-f9accf981d47'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:35:16.693990 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-90c1272a-7cc9-4256-a8c9-f9accf981d47 admin admin] The token cache is being invalidate because project a0bc52499c1c43159dc564d1e7d97477 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81362) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 02:35:16.694292 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-90c1272a-7cc9-4256-a8c9-f9accf981d47 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:35:16.694916 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-90c1272a-7cc9-4256-a8c9-f9accf981d47 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:35:16.696796 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1194/2385] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Oct 12 02:35:16 2022] DELETE /identity/v3/projects/a0bc52499c1c43159dc564d1e7d97477 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 02:35:16.701692 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff863978-a2d7-4a0c-9551-49dd2cfb6c39 None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:35:16.702139 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff863978-a2d7-4a0c-9551-49dd2cfb6c39 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:35:16.702139 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff863978-a2d7-4a0c-9551-49dd2cfb6c39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:35:16.722394 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-ff863978-a2d7-4a0c-9551-49dd2cfb6c39 None None] MFA Rules not processed for user `a326a5bb7364479382f528a592371656`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:35:16.723589 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-ff863978-a2d7-4a0c-9551-49dd2cfb6c39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:35:16.787765 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1192/2386] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 02:35:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 02:35:16.795789 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe7474d-ab53-4577-9f30-145009975fe6 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:35:16.796076 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe7474d-ab53-4577-9f30-145009975fe6 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:35:16.796353 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe7474d-ab53-4577-9f30-145009975fe6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:35:16.817432 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-afe7474d-ab53-4577-9f30-145009975fe6 None None] MFA Rules not processed for user `a326a5bb7364479382f528a592371656`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:35:16.818704 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-afe7474d-ab53-4577-9f30-145009975fe6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:35:16.827253 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1195/2387] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 02:35:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 02:35:16.831567 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff863978-a2d7-4a0c-9551-49dd2cfb6c39 None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:35:16.836632 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:35:16.842771 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff863978-a2d7-4a0c-9551-49dd2cfb6c39 None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:35:16.848312 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33558221-5d24-41e5-9d84-205cfe20ed55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:35:16.848964 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33558221-5d24-41e5-9d84-205cfe20ed55 admin admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:35:16.849240 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33558221-5d24-41e5-9d84-205cfe20ed55 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:35:16.850048 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33558221-5d24-41e5-9d84-205cfe20ed55 admin admin] PATH_INFO: `/v3/domains` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:35:16.850705 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33558221-5d24-41e5-9d84-205cfe20ed55 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 02:35:16.851008 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33558221-5d24-41e5-9d84-205cfe20ed55 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:35:16.852643 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33558221-5d24-41e5-9d84-205cfe20ed55 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:35:16.865748 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1193/2388] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Oct 12 02:35:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 02:35:16.870341 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe7474d-ab53-4577-9f30-145009975fe6 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:35:16.879810 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe7474d-ab53-4577-9f30-145009975fe6 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:35:16.884564 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4a894f-9828-433b-9073-8936e249ee95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:35:16.885169 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4a894f-9828-433b-9073-8936e249ee95 admin admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:35:16.885443 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4a894f-9828-433b-9073-8936e249ee95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:35:16.885714 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4a894f-9828-433b-9073-8936e249ee95 admin admin] PATH_INFO: `/v3/projects` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:35:16.886350 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4a894f-9828-433b-9073-8936e249ee95 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:35:16.888234 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4a894f-9828-433b-9073-8936e249ee95 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:35:16.920601 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1196/2389] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Oct 12 02:35:16 2022] POST /identity/v3/projects => generated 371 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 02:35:16.921810 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33558221-5d24-41e5-9d84-205cfe20ed55 admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:35:16.932792 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33558221-5d24-41e5-9d84-205cfe20ed55 admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:35:16.993615 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5d6978-fab0-4b4f-98cf-e1bfb0ded346 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:35:16.994415 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5d6978-fab0-4b4f-98cf-e1bfb0ded346 admin admin] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:35:16.994694 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5d6978-fab0-4b4f-98cf-e1bfb0ded346 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:35:16.994969 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5d6978-fab0-4b4f-98cf-e1bfb0ded346 admin admin] PATH_INFO: `/v3/users` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:35:16.995830 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5d6978-fab0-4b4f-98cf-e1bfb0ded346 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:35:16.998059 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5d6978-fab0-4b4f-98cf-e1bfb0ded346 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:35:17.021789 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1194/2390] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Oct 12 02:35:16 2022] POST /identity/v3/users => generated 286 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 02:35:17.024456 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4a894f-9828-433b-9073-8936e249ee95 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:35:17.034992 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4a894f-9828-433b-9073-8936e249ee95 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:35:17.040451 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05dc679-258a-4210-aed9-f4a0796167f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:35:17.041083 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05dc679-258a-4210-aed9-f4a0796167f2 admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:35:17.041360 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05dc679-258a-4210-aed9-f4a0796167f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:35:17.041636 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05dc679-258a-4210-aed9-f4a0796167f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:35:17.042276 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05dc679-258a-4210-aed9-f4a0796167f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:35:17.043919 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05dc679-258a-4210-aed9-f4a0796167f2 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:35:17.054788 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1197/2391] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Oct 12 02:35:17 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 02:35:17.058968 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5d6978-fab0-4b4f-98cf-e1bfb0ded346 admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:35:17.070136 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5d6978-fab0-4b4f-98cf-e1bfb0ded346 admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:35:17.074767 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5ad8de-1d09-48fe-9b91-cbe387c8e4c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:35:17.075361 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5ad8de-1d09-48fe-9b91-cbe387c8e4c0 admin admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:35:17.075640 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5ad8de-1d09-48fe-9b91-cbe387c8e4c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:35:17.075914 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5ad8de-1d09-48fe-9b91-cbe387c8e4c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:35:17.076583 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5ad8de-1d09-48fe-9b91-cbe387c8e4c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:35:17.078184 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5ad8de-1d09-48fe-9b91-cbe387c8e4c0 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:35:17.089010 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1195/2392] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Oct 12 02:35:17 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 02:35:17.093650 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05dc679-258a-4210-aed9-f4a0796167f2 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:35:17.103913 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05dc679-258a-4210-aed9-f4a0796167f2 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:35:17.108434 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf272c9a-7c1a-46d5-946b-4fb31c6fd852 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:35:17.109197 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf272c9a-7c1a-46d5-946b-4fb31c6fd852 admin admin] REQUEST_METHOD: `PUT` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:35:17.109476 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf272c9a-7c1a-46d5-946b-4fb31c6fd852 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:35:17.109748 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf272c9a-7c1a-46d5-946b-4fb31c6fd852 admin admin] PATH_INFO: `/v3/projects/a83ac4d634a046b98166a0e58dff2964/users/35b3e0b09af64352aa37ced210e8f949/roles/3d75c4d7f1a849b9a771504d1583ab28` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:35:17.124927 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf272c9a-7c1a-46d5-946b-4fb31c6fd852 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a83ac4d634a046b98166a0e58dff2964, user_id=35b3e0b09af64352aa37ced210e8f949, role_id=3d75c4d7f1a849b9a771504d1583ab28)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:35:17.127699 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf272c9a-7c1a-46d5-946b-4fb31c6fd852 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:35:17.141991 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1198/2393] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Oct 12 02:35:17 2022] PUT /identity/v3/projects/a83ac4d634a046b98166a0e58dff2964/users/35b3e0b09af64352aa37ced210e8f949/roles/3d75c4d7f1a849b9a771504d1583ab28 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 02:35:17.147353 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26ecc19-3d4f-4b0f-9c00-1b437b730b7c None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:35:17.147631 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26ecc19-3d4f-4b0f-9c00-1b437b730b7c None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:35:17.147901 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26ecc19-3d4f-4b0f-9c00-1b437b730b7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:35:17.166753 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-d26ecc19-3d4f-4b0f-9c00-1b437b730b7c None None] MFA Rules not processed for user `a326a5bb7364479382f528a592371656`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:35:17.167948 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-d26ecc19-3d4f-4b0f-9c00-1b437b730b7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:35:17.229638 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1196/2394] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 02:35:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 02:35:17.239588 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf272c9a-7c1a-46d5-946b-4fb31c6fd852 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:35:17.241888 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-cf272c9a-7c1a-46d5-946b-4fb31c6fd852 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:35:17.301731 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf272c9a-7c1a-46d5-946b-4fb31c6fd852 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:35:17.306108 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15aae137-2774-4b1a-8251-ee3b6f4be4e0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5223b5cab3114e9b9a13c582f8ef8386', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'beb6def6fcad45959e56425bb8bff4d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:35:17.306742 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15aae137-2774-4b1a-8251-ee3b6f4be4e0 service neutron] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:35:17.307023 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15aae137-2774-4b1a-8251-ee3b6f4be4e0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:35:17.307297 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15aae137-2774-4b1a-8251-ee3b6f4be4e0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:35:17.314213 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:35:17.316844 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15aae137-2774-4b1a-8251-ee3b6f4be4e0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:35:17.318988 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15aae137-2774-4b1a-8251-ee3b6f4be4e0 service neutron] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:35:17.330225 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1199/2395] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 02:35:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 02:35:17.997504 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9956fed4-cc7e-44bb-ae3b-281e0f845be7 None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:35:17.998036 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9956fed4-cc7e-44bb-ae3b-281e0f845be7 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:35:17.998036 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9956fed4-cc7e-44bb-ae3b-281e0f845be7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:35:18.029119 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-9956fed4-cc7e-44bb-ae3b-281e0f845be7 None None] MFA Rules not processed for user `35b3e0b09af64352aa37ced210e8f949`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:35:18.030388 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-9956fed4-cc7e-44bb-ae3b-281e0f845be7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:35:18.099092 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:35:18.108767 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1197/2396] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 02:35:17 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 02:35:18.112123 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15aae137-2774-4b1a-8251-ee3b6f4be4e0 service neutron] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:35:18.122040 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15aae137-2774-4b1a-8251-ee3b6f4be4e0 service neutron] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:35:18.126657 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf06daf-a6ed-4d86-8271-19199f335be7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:35:18.127339 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf06daf-a6ed-4d86-8271-19199f335be7 admin admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:35:18.127683 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf06daf-a6ed-4d86-8271-19199f335be7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:35:18.128018 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf06daf-a6ed-4d86-8271-19199f335be7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:35:18.131619 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf06daf-a6ed-4d86-8271-19199f335be7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:35:18.133032 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf06daf-a6ed-4d86-8271-19199f335be7 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:35:18.161341 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1200/2397] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Oct 12 02:35:18 2022] POST /identity/v3/projects => generated 373 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 02:35:18.165557 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9956fed4-cc7e-44bb-ae3b-281e0f845be7 None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:35:18.176141 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9956fed4-cc7e-44bb-ae3b-281e0f845be7 None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:35:18.235705 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35011779-5fd8-44a5-a0cd-b959d89defeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:35:18.236222 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35011779-5fd8-44a5-a0cd-b959d89defeb admin admin] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:35:18.236519 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35011779-5fd8-44a5-a0cd-b959d89defeb admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:35:18.236792 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35011779-5fd8-44a5-a0cd-b959d89defeb admin admin] PATH_INFO: `/v3/users` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:35:18.237421 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35011779-5fd8-44a5-a0cd-b959d89defeb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:35:18.239335 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35011779-5fd8-44a5-a0cd-b959d89defeb admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:35:18.262266 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1198/2398] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Oct 12 02:35:18 2022] POST /identity/v3/users => generated 293 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 02:35:18.266221 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf06daf-a6ed-4d86-8271-19199f335be7 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:35:18.277939 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf06daf-a6ed-4d86-8271-19199f335be7 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:35:18.282453 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a61a5e5-6d8d-4ac3-977c-a3f7b9f3ba89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:35:18.283054 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a61a5e5-6d8d-4ac3-977c-a3f7b9f3ba89 admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:35:18.283359 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a61a5e5-6d8d-4ac3-977c-a3f7b9f3ba89 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:35:18.283601 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a61a5e5-6d8d-4ac3-977c-a3f7b9f3ba89 admin admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:35:18.284239 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a61a5e5-6d8d-4ac3-977c-a3f7b9f3ba89 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:35:18.285874 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a61a5e5-6d8d-4ac3-977c-a3f7b9f3ba89 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:35:18.297364 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1201/2399] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Oct 12 02:35:18 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 02:35:18.302286 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35011779-5fd8-44a5-a0cd-b959d89defeb admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:35:18.312373 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35011779-5fd8-44a5-a0cd-b959d89defeb admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:35:18.316908 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19f7225-f88b-40c1-968c-e30aaf4a1028 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:35:18.317547 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19f7225-f88b-40c1-968c-e30aaf4a1028 admin admin] REQUEST_METHOD: `PUT` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:35:18.317821 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19f7225-f88b-40c1-968c-e30aaf4a1028 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:35:18.318627 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19f7225-f88b-40c1-968c-e30aaf4a1028 admin admin] PATH_INFO: `/v3/projects/3c84e4b8d59740fb92c2253912e227d6/users/d27907ddc6584509888d19ffa03971bc/roles/39b1e8108dff402383def3c559f48189` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:35:18.334782 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19f7225-f88b-40c1-968c-e30aaf4a1028 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3c84e4b8d59740fb92c2253912e227d6, user_id=d27907ddc6584509888d19ffa03971bc, role_id=39b1e8108dff402383def3c559f48189)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:35:18.337490 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19f7225-f88b-40c1-968c-e30aaf4a1028 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:35:18.350156 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1199/2400] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Oct 12 02:35:18 2022] PUT /identity/v3/projects/3c84e4b8d59740fb92c2253912e227d6/users/d27907ddc6584509888d19ffa03971bc/roles/39b1e8108dff402383def3c559f48189 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 02:35:18.354485 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a61a5e5-6d8d-4ac3-977c-a3f7b9f3ba89 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:35:18.364799 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a61a5e5-6d8d-4ac3-977c-a3f7b9f3ba89 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:35:18.425365 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0cfda1-237d-4c3d-9a45-2441358c220b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:35:18.425970 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0cfda1-237d-4c3d-9a45-2441358c220b admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:35:18.426245 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0cfda1-237d-4c3d-9a45-2441358c220b admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:35:18.426513 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0cfda1-237d-4c3d-9a45-2441358c220b admin admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:35:18.427146 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0cfda1-237d-4c3d-9a45-2441358c220b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:35:18.429376 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0cfda1-237d-4c3d-9a45-2441358c220b admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:35:18.438901 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1202/2401] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Oct 12 02:35:18 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 02:35:18.444307 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19f7225-f88b-40c1-968c-e30aaf4a1028 admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:35:18.454521 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19f7225-f88b-40c1-968c-e30aaf4a1028 admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:35:18.459311 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f7c89d-3e29-45d5-b7b2-7fcc45bef8f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:35:18.459946 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f7c89d-3e29-45d5-b7b2-7fcc45bef8f8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:35:18.460219 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f7c89d-3e29-45d5-b7b2-7fcc45bef8f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:35:18.460511 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f7c89d-3e29-45d5-b7b2-7fcc45bef8f8 admin admin] PATH_INFO: `/v3/projects/3c84e4b8d59740fb92c2253912e227d6/users/d27907ddc6584509888d19ffa03971bc/roles/39b1e8108dff402383def3c559f48189` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:35:18.462410 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f7c89d-3e29-45d5-b7b2-7fcc45bef8f8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3c84e4b8d59740fb92c2253912e227d6, user_id=d27907ddc6584509888d19ffa03971bc, role_id=39b1e8108dff402383def3c559f48189)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:35:18.465059 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f7c89d-3e29-45d5-b7b2-7fcc45bef8f8 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:35:18.475657 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1200/2402] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Oct 12 02:35:18 2022] PUT /identity/v3/projects/3c84e4b8d59740fb92c2253912e227d6/users/d27907ddc6584509888d19ffa03971bc/roles/39b1e8108dff402383def3c559f48189 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 02:35:19.130556 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090b59cf-d621-4b18-ba3e-15520c6eeab0 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:35:19.131370 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090b59cf-d621-4b18-ba3e-15520c6eeab0 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:35:19.131370 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090b59cf-d621-4b18-ba3e-15520c6eeab0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:35:19.160343 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-090b59cf-d621-4b18-ba3e-15520c6eeab0 None None] MFA Rules not processed for user `d27907ddc6584509888d19ffa03971bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:35:19.161591 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-090b59cf-d621-4b18-ba3e-15520c6eeab0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:35:19.239768 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1203/2403] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 02:35:19 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 02:35:19.250916 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a55b3d5-3a0d-4347-891f-3d6e6c4ef312 None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:35:19.251456 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a55b3d5-3a0d-4347-891f-3d6e6c4ef312 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:35:19.251694 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a55b3d5-3a0d-4347-891f-3d6e6c4ef312 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:35:19.275501 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-3a55b3d5-3a0d-4347-891f-3d6e6c4ef312 None None] MFA Rules not processed for user `35b3e0b09af64352aa37ced210e8f949`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:35:19.276905 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-3a55b3d5-3a0d-4347-891f-3d6e6c4ef312 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:35:19.337543 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1201/2404] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 02:35:19 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 02:35:19.351769 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090b59cf-d621-4b18-ba3e-15520c6eeab0 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:35:19.353969 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-090b59cf-d621-4b18-ba3e-15520c6eeab0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:35:19.400497 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:35:19.430223 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090b59cf-d621-4b18-ba3e-15520c6eeab0 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:35:19.435974 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6b60af-40ae-4b34-8fcc-9b3cca8bbdc8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fca96c111b45b795fb757f77908ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'beb6def6fcad45959e56425bb8bff4d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:35:19.436622 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6b60af-40ae-4b34-8fcc-9b3cca8bbdc8 service nova] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:35:19.436899 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6b60af-40ae-4b34-8fcc-9b3cca8bbdc8 service nova] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:35:19.437165 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6b60af-40ae-4b34-8fcc-9b3cca8bbdc8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:35:19.445356 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6b60af-40ae-4b34-8fcc-9b3cca8bbdc8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:35:19.446910 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6b60af-40ae-4b34-8fcc-9b3cca8bbdc8 service nova] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:35:19.460545 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1204/2405] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 02:35:19 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 02:35:19.696744 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a55b3d5-3a0d-4347-891f-3d6e6c4ef312 None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:35:19.750617 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a55b3d5-3a0d-4347-891f-3d6e6c4ef312 None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:35:19.754829 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858086d8-ed74-4045-b8f4-41ad0350876c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5223b5cab3114e9b9a13c582f8ef8386', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'beb6def6fcad45959e56425bb8bff4d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:35:19.755431 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858086d8-ed74-4045-b8f4-41ad0350876c service neutron] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:35:19.756239 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858086d8-ed74-4045-b8f4-41ad0350876c service neutron] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:35:19.756643 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858086d8-ed74-4045-b8f4-41ad0350876c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:35:19.758256 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-858086d8-ed74-4045-b8f4-41ad0350876c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:35:19.767913 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858086d8-ed74-4045-b8f4-41ad0350876c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:35:19.769366 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858086d8-ed74-4045-b8f4-41ad0350876c service neutron] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:35:19.773195 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:35:19.780325 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1202/2406] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 02:35:19 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 02:35:22.562919 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6b60af-40ae-4b34-8fcc-9b3cca8bbdc8 service nova] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:35:22.577734 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6b60af-40ae-4b34-8fcc-9b3cca8bbdc8 service nova] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:35:22.583328 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6847af95-636d-4354-8434-90404b60d4e0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fca96c111b45b795fb757f77908ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'beb6def6fcad45959e56425bb8bff4d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:35:22.583931 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6847af95-636d-4354-8434-90404b60d4e0 service nova] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:35:22.584361 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6847af95-636d-4354-8434-90404b60d4e0 service nova] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:35:22.584671 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6847af95-636d-4354-8434-90404b60d4e0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:35:22.587101 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-6847af95-636d-4354-8434-90404b60d4e0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:35:22.603639 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6847af95-636d-4354-8434-90404b60d4e0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:35:22.606652 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6847af95-636d-4354-8434-90404b60d4e0 service nova] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:35:22.625756 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1205/2407] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 02:35:22 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 02:35:27.686388 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858086d8-ed74-4045-b8f4-41ad0350876c service neutron] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:35:27.688111 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-858086d8-ed74-4045-b8f4-41ad0350876c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:35:27.704749 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858086d8-ed74-4045-b8f4-41ad0350876c service neutron] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:35:27.710907 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d741ba33-60cc-4303-a47a-34e73f47c5d2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fca96c111b45b795fb757f77908ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'beb6def6fcad45959e56425bb8bff4d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:35:27.711498 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d741ba33-60cc-4303-a47a-34e73f47c5d2 service nova] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:35:27.711772 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d741ba33-60cc-4303-a47a-34e73f47c5d2 service nova] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:35:27.712037 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d741ba33-60cc-4303-a47a-34e73f47c5d2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:35:27.713747 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-d741ba33-60cc-4303-a47a-34e73f47c5d2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:35:27.731953 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d741ba33-60cc-4303-a47a-34e73f47c5d2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:35:27.733576 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d741ba33-60cc-4303-a47a-34e73f47c5d2 service nova] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:35:27.744115 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1203/2408] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 02:35:27 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 02:35:28.096078 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6847af95-636d-4354-8434-90404b60d4e0 service nova] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:35:28.097577 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-6847af95-636d-4354-8434-90404b60d4e0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:35:28.164346 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6847af95-636d-4354-8434-90404b60d4e0 service nova] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:35:28.168879 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94af30f3-ac7d-4fb8-b009-2b735c9b7400 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:35:28.169495 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94af30f3-ac7d-4fb8-b009-2b735c9b7400 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:35:28.169792 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94af30f3-ac7d-4fb8-b009-2b735c9b7400 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:35:28.170060 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94af30f3-ac7d-4fb8-b009-2b735c9b7400 admin admin] PATH_INFO: `/v3/users/03fc1d26ad7d482088cb04249170b9b2` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:35:28.171196 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94af30f3-ac7d-4fb8-b009-2b735c9b7400 admin admin] RBAC: Authorizing `identity:delete_user(user_id=03fc1d26ad7d482088cb04249170b9b2)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:35:28.173168 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94af30f3-ac7d-4fb8-b009-2b735c9b7400 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:35:28.222153 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-94af30f3-ac7d-4fb8-b009-2b735c9b7400 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '03fc1d26ad7d482088cb04249170b9b2'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:35:28.229738 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-94af30f3-ac7d-4fb8-b009-2b735c9b7400 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '03fc1d26ad7d482088cb04249170b9b2'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:35:28.242562 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-94af30f3-ac7d-4fb8-b009-2b735c9b7400 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '03fc1d26ad7d482088cb04249170b9b2'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:35:28.251176 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-94af30f3-ac7d-4fb8-b009-2b735c9b7400 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '03fc1d26ad7d482088cb04249170b9b2'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:35:28.252000 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-94af30f3-ac7d-4fb8-b009-2b735c9b7400 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '03fc1d26ad7d482088cb04249170b9b2'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:35:28.259010 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1206/2409] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Oct 12 02:35:28 2022] DELETE /identity/v3/users/03fc1d26ad7d482088cb04249170b9b2 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 02:35:28.263475 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b390fe50-712d-4c7d-9518-0c12c699f40e None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:35:28.263757 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b390fe50-712d-4c7d-9518-0c12c699f40e None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:35:28.264029 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b390fe50-712d-4c7d-9518-0c12c699f40e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:35:28.283954 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-b390fe50-712d-4c7d-9518-0c12c699f40e None None] MFA Rules not processed for user `a326a5bb7364479382f528a592371656`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:35:28.285206 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-b390fe50-712d-4c7d-9518-0c12c699f40e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:35:28.343891 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1204/2410] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 02:35:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 02:35:28.353967 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94af30f3-ac7d-4fb8-b009-2b735c9b7400 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:35:28.355392 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-94af30f3-ac7d-4fb8-b009-2b735c9b7400 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:35:28.397502 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:35:28.416942 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94af30f3-ac7d-4fb8-b009-2b735c9b7400 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:35:28.420554 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64adc0d-a638-4324-ba2f-9f9bd43d8cfe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5223b5cab3114e9b9a13c582f8ef8386', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'beb6def6fcad45959e56425bb8bff4d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:35:28.421162 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64adc0d-a638-4324-ba2f-9f9bd43d8cfe service neutron] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:35:28.421434 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64adc0d-a638-4324-ba2f-9f9bd43d8cfe service neutron] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:35:28.421702 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64adc0d-a638-4324-ba2f-9f9bd43d8cfe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:35:28.431617 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64adc0d-a638-4324-ba2f-9f9bd43d8cfe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:35:28.433070 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64adc0d-a638-4324-ba2f-9f9bd43d8cfe service neutron] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:35:28.443022 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1207/2411] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 02:35:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 02:35:28.785348 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b390fe50-712d-4c7d-9518-0c12c699f40e None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:35:28.787349 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-b390fe50-712d-4c7d-9518-0c12c699f40e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:35:28.803169 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b390fe50-712d-4c7d-9518-0c12c699f40e None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:35:28.807825 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae987a67-40bf-4acc-a7a4-242780ea680f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:35:28.808450 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae987a67-40bf-4acc-a7a4-242780ea680f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:35:28.808755 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae987a67-40bf-4acc-a7a4-242780ea680f admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:35:28.809024 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae987a67-40bf-4acc-a7a4-242780ea680f admin admin] PATH_INFO: `/v3/projects/20f5d854fac44e0b9462d7b9c918ff00` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:35:28.811033 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae987a67-40bf-4acc-a7a4-242780ea680f admin admin] RBAC: Authorizing `identity:delete_project(project_id=20f5d854fac44e0b9462d7b9c918ff00)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:35:28.812977 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae987a67-40bf-4acc-a7a4-242780ea680f admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:35:28.859996 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-ae987a67-40bf-4acc-a7a4-242780ea680f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '20f5d854fac44e0b9462d7b9c918ff00', 'request_id': 'req-ae987a67-40bf-4acc-a7a4-242780ea680f'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:35:28.866616 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-ae987a67-40bf-4acc-a7a4-242780ea680f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '20f5d854fac44e0b9462d7b9c918ff00', 'request_id': 'req-ae987a67-40bf-4acc-a7a4-242780ea680f'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:35:28.872892 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-ae987a67-40bf-4acc-a7a4-242780ea680f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '20f5d854fac44e0b9462d7b9c918ff00', 'request_id': 'req-ae987a67-40bf-4acc-a7a4-242780ea680f'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:35:28.886234 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-ae987a67-40bf-4acc-a7a4-242780ea680f admin admin] The token cache is being invalidate because project 20f5d854fac44e0b9462d7b9c918ff00 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81361) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 02:35:28.886578 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-ae987a67-40bf-4acc-a7a4-242780ea680f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:35:28.887577 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-ae987a67-40bf-4acc-a7a4-242780ea680f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:35:28.889101 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1205/2412] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Oct 12 02:35:28 2022] DELETE /identity/v3/projects/20f5d854fac44e0b9462d7b9c918ff00 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 02:35:31.471172 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64adc0d-a638-4324-ba2f-9f9bd43d8cfe service neutron] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:35:31.472748 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-e64adc0d-a638-4324-ba2f-9f9bd43d8cfe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:35:31.537514 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64adc0d-a638-4324-ba2f-9f9bd43d8cfe service neutron] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:35:31.586365 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f709d1f-248d-49b0-9170-9a2ccbdd44e4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ba688e0c4d44d13898539ee886f95fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'beb6def6fcad45959e56425bb8bff4d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:35:31.586974 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f709d1f-248d-49b0-9170-9a2ccbdd44e4 service cinder] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:35:31.587260 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f709d1f-248d-49b0-9170-9a2ccbdd44e4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:35:31.587530 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f709d1f-248d-49b0-9170-9a2ccbdd44e4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:35:31.589332 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-9f709d1f-248d-49b0-9170-9a2ccbdd44e4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:35:31.651391 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f709d1f-248d-49b0-9170-9a2ccbdd44e4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:35:31.652816 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f709d1f-248d-49b0-9170-9a2ccbdd44e4 service cinder] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:35:31.663874 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1208/2413] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 02:35:31 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 02:35:38.882149 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=61,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:35:41.658440 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=80 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:35:43.151262 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae987a67-40bf-4acc-a7a4-242780ea680f admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:35:43.152776 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-ae987a67-40bf-4acc-a7a4-242780ea680f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:35:43.209977 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae987a67-40bf-4acc-a7a4-242780ea680f admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:35:43.213520 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12906247-d5a4-464d-8686-ca4e43e9d427 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5223b5cab3114e9b9a13c582f8ef8386', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'beb6def6fcad45959e56425bb8bff4d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:35:43.214116 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12906247-d5a4-464d-8686-ca4e43e9d427 service neutron] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:35:43.214395 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12906247-d5a4-464d-8686-ca4e43e9d427 service neutron] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:35:43.214660 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12906247-d5a4-464d-8686-ca4e43e9d427 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:35:43.216325 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-12906247-d5a4-464d-8686-ca4e43e9d427 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:35:43.279733 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12906247-d5a4-464d-8686-ca4e43e9d427 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:35:43.281188 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12906247-d5a4-464d-8686-ca4e43e9d427 service neutron] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:35:43.291509 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1206/2414] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 02:35:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 02:35:46.283086 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f709d1f-248d-49b0-9170-9a2ccbdd44e4 service cinder] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:35:46.283086 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-9f709d1f-248d-49b0-9170-9a2ccbdd44e4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:35:46.307688 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f709d1f-248d-49b0-9170-9a2ccbdd44e4 service cinder] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:35:46.314158 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41095c1e-49bc-46bd-b313-0f17ec9887fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:35:46.314716 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41095c1e-49bc-46bd-b313-0f17ec9887fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:35:46.316311 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41095c1e-49bc-46bd-b313-0f17ec9887fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:35:46.317451 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41095c1e-49bc-46bd-b313-0f17ec9887fb admin admin] PATH_INFO: `/v3/users/961c8dd429784f79ae70fe961c9e4dcb` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:35:46.318627 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41095c1e-49bc-46bd-b313-0f17ec9887fb admin admin] RBAC: Authorizing `identity:delete_user(user_id=961c8dd429784f79ae70fe961c9e4dcb)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:35:46.321247 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41095c1e-49bc-46bd-b313-0f17ec9887fb admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:35:46.371986 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-41095c1e-49bc-46bd-b313-0f17ec9887fb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '961c8dd429784f79ae70fe961c9e4dcb'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:35:46.379881 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-41095c1e-49bc-46bd-b313-0f17ec9887fb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '961c8dd429784f79ae70fe961c9e4dcb'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:35:46.392147 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-41095c1e-49bc-46bd-b313-0f17ec9887fb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '961c8dd429784f79ae70fe961c9e4dcb'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:35:46.399222 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-41095c1e-49bc-46bd-b313-0f17ec9887fb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '961c8dd429784f79ae70fe961c9e4dcb'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:35:46.399886 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-41095c1e-49bc-46bd-b313-0f17ec9887fb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '961c8dd429784f79ae70fe961c9e4dcb'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:35:46.405703 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1209/2415] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Oct 12 02:35:46 2022] DELETE /identity/v3/users/961c8dd429784f79ae70fe961c9e4dcb => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 02:35:46.594200 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12906247-d5a4-464d-8686-ca4e43e9d427 service neutron] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:35:46.616663 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12906247-d5a4-464d-8686-ca4e43e9d427 service neutron] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:35:46.679704 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecb391c-de5a-489b-8381-f9d4eb2d6e7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:35:46.680334 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecb391c-de5a-489b-8381-f9d4eb2d6e7e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:35:46.680682 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecb391c-de5a-489b-8381-f9d4eb2d6e7e admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:35:46.680940 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecb391c-de5a-489b-8381-f9d4eb2d6e7e admin admin] PATH_INFO: `/v3/projects/1eff676e44134d7d8b2049ad864793d9` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:35:46.682042 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ecb391c-de5a-489b-8381-f9d4eb2d6e7e admin admin] RBAC: Authorizing `identity:delete_project(project_id=1eff676e44134d7d8b2049ad864793d9)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:35:46.683960 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ecb391c-de5a-489b-8381-f9d4eb2d6e7e admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:35:46.731746 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-8ecb391c-de5a-489b-8381-f9d4eb2d6e7e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1eff676e44134d7d8b2049ad864793d9', 'request_id': 'req-8ecb391c-de5a-489b-8381-f9d4eb2d6e7e'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:35:46.733669 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:35:46.738230 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-8ecb391c-de5a-489b-8381-f9d4eb2d6e7e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1eff676e44134d7d8b2049ad864793d9', 'request_id': 'req-8ecb391c-de5a-489b-8381-f9d4eb2d6e7e'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:35:46.744983 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-8ecb391c-de5a-489b-8381-f9d4eb2d6e7e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1eff676e44134d7d8b2049ad864793d9', 'request_id': 'req-8ecb391c-de5a-489b-8381-f9d4eb2d6e7e'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:35:46.757343 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-8ecb391c-de5a-489b-8381-f9d4eb2d6e7e admin admin] The token cache is being invalidate because project 1eff676e44134d7d8b2049ad864793d9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81361) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 02:35:46.757639 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-8ecb391c-de5a-489b-8381-f9d4eb2d6e7e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:35:46.758258 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-8ecb391c-de5a-489b-8381-f9d4eb2d6e7e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:35:46.759741 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1207/2416] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Oct 12 02:35:46 2022] DELETE /identity/v3/projects/1eff676e44134d7d8b2049ad864793d9 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 02:35:46.764820 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1154d662-6f74-48d3-8a6a-63afcfe25c8c None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:35:46.765100 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1154d662-6f74-48d3-8a6a-63afcfe25c8c None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:35:46.765379 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1154d662-6f74-48d3-8a6a-63afcfe25c8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:35:46.788638 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-1154d662-6f74-48d3-8a6a-63afcfe25c8c None None] MFA Rules not processed for user `a326a5bb7364479382f528a592371656`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:35:46.789858 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-1154d662-6f74-48d3-8a6a-63afcfe25c8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:35:46.851935 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1210/2417] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 02:35:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 02:35:46.860780 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b8faaa-a933-4fe1-9861-e28100f05e11 None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:35:46.861064 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b8faaa-a933-4fe1-9861-e28100f05e11 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:35:46.861353 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b8faaa-a933-4fe1-9861-e28100f05e11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:35:46.881185 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-95b8faaa-a933-4fe1-9861-e28100f05e11 None None] MFA Rules not processed for user `a326a5bb7364479382f528a592371656`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:35:46.882385 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-95b8faaa-a933-4fe1-9861-e28100f05e11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:35:46.890466 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1208/2418] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 02:35:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 02:35:46.895490 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1154d662-6f74-48d3-8a6a-63afcfe25c8c None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:35:46.905365 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1154d662-6f74-48d3-8a6a-63afcfe25c8c None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:35:46.909951 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a438cd64-b28e-40f2-bfcd-1214bd9e09b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:35:46.911209 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a438cd64-b28e-40f2-bfcd-1214bd9e09b4 admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:35:46.911540 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a438cd64-b28e-40f2-bfcd-1214bd9e09b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:35:46.911813 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a438cd64-b28e-40f2-bfcd-1214bd9e09b4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:35:46.912456 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a438cd64-b28e-40f2-bfcd-1214bd9e09b4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 02:35:46.912784 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a438cd64-b28e-40f2-bfcd-1214bd9e09b4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:35:46.914373 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a438cd64-b28e-40f2-bfcd-1214bd9e09b4 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:35:46.926180 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1211/2419] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Oct 12 02:35:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 02:35:46.930395 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b8faaa-a933-4fe1-9861-e28100f05e11 None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:35:46.939630 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b8faaa-a933-4fe1-9861-e28100f05e11 None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:35:46.944404 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b81cf0a-280f-4ce1-8fde-bf9533ada695 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:35:46.945085 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b81cf0a-280f-4ce1-8fde-bf9533ada695 admin admin] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:35:46.945365 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b81cf0a-280f-4ce1-8fde-bf9533ada695 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:35:46.945635 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b81cf0a-280f-4ce1-8fde-bf9533ada695 admin admin] PATH_INFO: `/v3/projects` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:35:46.946257 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b81cf0a-280f-4ce1-8fde-bf9533ada695 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:35:46.948142 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b81cf0a-280f-4ce1-8fde-bf9533ada695 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:35:46.977266 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1209/2420] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Oct 12 02:35:46 2022] POST /identity/v3/projects => generated 383 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 02:35:46.981590 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a438cd64-b28e-40f2-bfcd-1214bd9e09b4 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:35:46.991850 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a438cd64-b28e-40f2-bfcd-1214bd9e09b4 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:35:47.048613 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fb73ce-74fa-41dc-8cc6-d919da8f3b3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:35:47.049165 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fb73ce-74fa-41dc-8cc6-d919da8f3b3a admin admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:35:47.049467 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fb73ce-74fa-41dc-8cc6-d919da8f3b3a admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:35:47.049745 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fb73ce-74fa-41dc-8cc6-d919da8f3b3a admin admin] PATH_INFO: `/v3/users` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:35:47.050443 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55fb73ce-74fa-41dc-8cc6-d919da8f3b3a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:35:47.052434 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55fb73ce-74fa-41dc-8cc6-d919da8f3b3a admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:35:47.060444 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:35:47.075885 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1212/2421] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Oct 12 02:35:46 2022] POST /identity/v3/users => generated 292 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 02:35:47.079828 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b81cf0a-280f-4ce1-8fde-bf9533ada695 admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:35:47.090551 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b81cf0a-280f-4ce1-8fde-bf9533ada695 admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:35:47.095055 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96da2f61-dc9a-495c-bc36-9caa02025e58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:35:47.095637 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96da2f61-dc9a-495c-bc36-9caa02025e58 admin admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:35:47.095909 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96da2f61-dc9a-495c-bc36-9caa02025e58 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:35:47.096173 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96da2f61-dc9a-495c-bc36-9caa02025e58 admin admin] PATH_INFO: `/v3/roles` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:35:47.096865 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96da2f61-dc9a-495c-bc36-9caa02025e58 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:35:47.098782 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96da2f61-dc9a-495c-bc36-9caa02025e58 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:35:47.108858 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1210/2422] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Oct 12 02:35:47 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 02:35:47.112724 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fb73ce-74fa-41dc-8cc6-d919da8f3b3a admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:35:47.123644 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fb73ce-74fa-41dc-8cc6-d919da8f3b3a admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:35:47.128671 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44b9751-02b5-40e4-99a1-1ce13484efcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:35:47.129867 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44b9751-02b5-40e4-99a1-1ce13484efcd admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:35:47.130138 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44b9751-02b5-40e4-99a1-1ce13484efcd admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:35:47.130401 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44b9751-02b5-40e4-99a1-1ce13484efcd admin admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:35:47.131037 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44b9751-02b5-40e4-99a1-1ce13484efcd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:35:47.132624 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44b9751-02b5-40e4-99a1-1ce13484efcd admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:35:47.143141 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1213/2423] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Oct 12 02:35:47 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 02:35:47.147481 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96da2f61-dc9a-495c-bc36-9caa02025e58 admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:35:47.157524 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96da2f61-dc9a-495c-bc36-9caa02025e58 admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:35:47.162296 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b3db57-4402-47fe-9a6b-f519f8090de0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:35:47.162960 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b3db57-4402-47fe-9a6b-f519f8090de0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:35:47.163236 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b3db57-4402-47fe-9a6b-f519f8090de0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:35:47.163510 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b3db57-4402-47fe-9a6b-f519f8090de0 admin admin] PATH_INFO: `/v3/projects/7eee400d8a3e49779363a82047c30632/users/98bd9ff10bf74e1ab588810c83a9c7e9/roles/3d75c4d7f1a849b9a771504d1583ab28` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:35:47.178370 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b3db57-4402-47fe-9a6b-f519f8090de0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7eee400d8a3e49779363a82047c30632, user_id=98bd9ff10bf74e1ab588810c83a9c7e9, role_id=3d75c4d7f1a849b9a771504d1583ab28)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:35:47.181120 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b3db57-4402-47fe-9a6b-f519f8090de0 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:35:47.194312 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1211/2424] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Oct 12 02:35:47 2022] PUT /identity/v3/projects/7eee400d8a3e49779363a82047c30632/users/98bd9ff10bf74e1ab588810c83a9c7e9/roles/3d75c4d7f1a849b9a771504d1583ab28 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 02:35:47.199378 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e4248b-4378-4099-8a0c-6589d42548c1 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:35:47.199662 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e4248b-4378-4099-8a0c-6589d42548c1 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:35:47.199937 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e4248b-4378-4099-8a0c-6589d42548c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:35:47.218404 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-25e4248b-4378-4099-8a0c-6589d42548c1 None None] MFA Rules not processed for user `a326a5bb7364479382f528a592371656`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:35:47.219583 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-25e4248b-4378-4099-8a0c-6589d42548c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:35:47.278658 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1214/2425] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 02:35:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 02:35:47.288844 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b3db57-4402-47fe-9a6b-f519f8090de0 admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:35:47.290615 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-63b3db57-4402-47fe-9a6b-f519f8090de0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:35:47.346642 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b3db57-4402-47fe-9a6b-f519f8090de0 admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:35:47.350718 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b206cd7-ee4e-4bca-911f-160efe531b70 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5223b5cab3114e9b9a13c582f8ef8386', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'beb6def6fcad45959e56425bb8bff4d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:35:47.351315 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b206cd7-ee4e-4bca-911f-160efe531b70 service neutron] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:35:47.351594 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b206cd7-ee4e-4bca-911f-160efe531b70 service neutron] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:35:47.351867 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b206cd7-ee4e-4bca-911f-160efe531b70 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:35:47.361059 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b206cd7-ee4e-4bca-911f-160efe531b70 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:35:47.362483 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b206cd7-ee4e-4bca-911f-160efe531b70 service neutron] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:35:47.372458 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1212/2426] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 02:35:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 02:35:51.453581 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450b4770-2588-45d5-b402-73242c2c74e9 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:35:51.454131 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450b4770-2588-45d5-b402-73242c2c74e9 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:35:51.454131 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450b4770-2588-45d5-b402-73242c2c74e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:35:51.489947 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-450b4770-2588-45d5-b402-73242c2c74e9 None None] MFA Rules not processed for user `98bd9ff10bf74e1ab588810c83a9c7e9`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:35:51.491387 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-450b4770-2588-45d5-b402-73242c2c74e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:35:51.588272 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1215/2427] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 02:35:51 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 02:35:51.603158 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b206cd7-ee4e-4bca-911f-160efe531b70 service neutron] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:35:51.604782 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-1b206cd7-ee4e-4bca-911f-160efe531b70 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:35:51.699468 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b206cd7-ee4e-4bca-911f-160efe531b70 service neutron] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:35:51.709687 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f966fe-e0d4-4f15-920c-156ea3746610 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fca96c111b45b795fb757f77908ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'beb6def6fcad45959e56425bb8bff4d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:35:51.710936 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f966fe-e0d4-4f15-920c-156ea3746610 service nova] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:35:51.711457 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f966fe-e0d4-4f15-920c-156ea3746610 service nova] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:35:51.711935 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f966fe-e0d4-4f15-920c-156ea3746610 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:35:51.721516 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f966fe-e0d4-4f15-920c-156ea3746610 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:35:51.723552 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f966fe-e0d4-4f15-920c-156ea3746610 service nova] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:35:51.735238 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1213/2428] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 02:35:51 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 02:35:52.423271 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450b4770-2588-45d5-b402-73242c2c74e9 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:35:52.424835 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-450b4770-2588-45d5-b402-73242c2c74e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:35:52.507451 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f966fe-e0d4-4f15-920c-156ea3746610 service nova] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:35:52.508995 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-a4f966fe-e0d4-4f15-920c-156ea3746610 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:35:52.523585 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:35:52.541566 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f966fe-e0d4-4f15-920c-156ea3746610 service nova] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:35:52.543062 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450b4770-2588-45d5-b402-73242c2c74e9 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:35:52.555787 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c183bbf-2f88-437f-9637-901e2cf8f481 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:35:52.556437 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c183bbf-2f88-437f-9637-901e2cf8f481 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:35:52.559883 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c183bbf-2f88-437f-9637-901e2cf8f481 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:35:52.560165 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c183bbf-2f88-437f-9637-901e2cf8f481 admin admin] PATH_INFO: `/v3/users/35b3e0b09af64352aa37ced210e8f949` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:35:52.579212 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb10593e-8f6c-4265-a3f7-f71234fdad95 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a58b9e0467c040638c3d43e3ac9c0495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'beb6def6fcad45959e56425bb8bff4d1', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:35:52.579887 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb10593e-8f6c-4265-a3f7-f71234fdad95 service placement] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:35:52.580136 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb10593e-8f6c-4265-a3f7-f71234fdad95 service placement] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:35:52.580411 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb10593e-8f6c-4265-a3f7-f71234fdad95 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:35:52.581321 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c183bbf-2f88-437f-9637-901e2cf8f481 admin admin] RBAC: Authorizing `identity:delete_user(user_id=35b3e0b09af64352aa37ced210e8f949)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:35:52.583602 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c183bbf-2f88-437f-9637-901e2cf8f481 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:35:52.593002 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-cb10593e-8f6c-4265-a3f7-f71234fdad95 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:35:52.611914 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb10593e-8f6c-4265-a3f7-f71234fdad95 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:35:52.614044 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb10593e-8f6c-4265-a3f7-f71234fdad95 service placement] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:35:52.620004 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:35:52.639038 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1216/2429] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 02:35:52 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 02:35:52.671420 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-7c183bbf-2f88-437f-9637-901e2cf8f481 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '35b3e0b09af64352aa37ced210e8f949'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:35:52.680719 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-7c183bbf-2f88-437f-9637-901e2cf8f481 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '35b3e0b09af64352aa37ced210e8f949'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:35:52.703886 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-7c183bbf-2f88-437f-9637-901e2cf8f481 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '35b3e0b09af64352aa37ced210e8f949'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:35:52.720212 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-7c183bbf-2f88-437f-9637-901e2cf8f481 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '35b3e0b09af64352aa37ced210e8f949'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:35:52.720345 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-7c183bbf-2f88-437f-9637-901e2cf8f481 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '35b3e0b09af64352aa37ced210e8f949'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:35:52.731424 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1214/2430] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Oct 12 02:35:52 2022] DELETE /identity/v3/users/35b3e0b09af64352aa37ced210e8f949 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 02:35:52.985506 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb10593e-8f6c-4265-a3f7-f71234fdad95 service placement] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:35:53.025487 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb10593e-8f6c-4265-a3f7-f71234fdad95 service placement] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:35:53.090510 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f3a465-c642-4936-9a6d-d71f2509a5c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:35:53.091709 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f3a465-c642-4936-9a6d-d71f2509a5c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:35:53.092093 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f3a465-c642-4936-9a6d-d71f2509a5c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:35:53.092461 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f3a465-c642-4936-9a6d-d71f2509a5c1 admin admin] PATH_INFO: `/v3/projects/a83ac4d634a046b98166a0e58dff2964` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:35:53.093938 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f3a465-c642-4936-9a6d-d71f2509a5c1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a83ac4d634a046b98166a0e58dff2964)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:35:53.096263 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f3a465-c642-4936-9a6d-d71f2509a5c1 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:35:53.154411 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-43f3a465-c642-4936-9a6d-d71f2509a5c1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a83ac4d634a046b98166a0e58dff2964', 'request_id': 'req-43f3a465-c642-4936-9a6d-d71f2509a5c1'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:35:53.163826 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-43f3a465-c642-4936-9a6d-d71f2509a5c1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a83ac4d634a046b98166a0e58dff2964', 'request_id': 'req-43f3a465-c642-4936-9a6d-d71f2509a5c1'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:35:53.171885 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-43f3a465-c642-4936-9a6d-d71f2509a5c1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a83ac4d634a046b98166a0e58dff2964', 'request_id': 'req-43f3a465-c642-4936-9a6d-d71f2509a5c1'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:35:53.188203 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-43f3a465-c642-4936-9a6d-d71f2509a5c1 admin admin] The token cache is being invalidate because project a83ac4d634a046b98166a0e58dff2964 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81362) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 02:35:53.188622 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-43f3a465-c642-4936-9a6d-d71f2509a5c1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:35:53.189496 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-43f3a465-c642-4936-9a6d-d71f2509a5c1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:35:53.192559 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1217/2431] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Oct 12 02:35:52 2022] DELETE /identity/v3/projects/a83ac4d634a046b98166a0e58dff2964 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 02:35:53.196074 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c183bbf-2f88-437f-9637-901e2cf8f481 admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:35:53.197358 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-7c183bbf-2f88-437f-9637-901e2cf8f481 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:35:53.212098 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c183bbf-2f88-437f-9637-901e2cf8f481 admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:35:53.285751 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86b2cb8-f153-40ac-a44a-84c28bdbd079 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:35:53.286618 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86b2cb8-f153-40ac-a44a-84c28bdbd079 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:35:53.286904 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86b2cb8-f153-40ac-a44a-84c28bdbd079 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:35:53.287179 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86b2cb8-f153-40ac-a44a-84c28bdbd079 admin admin] PATH_INFO: `/v3/users/d27907ddc6584509888d19ffa03971bc` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:35:53.289855 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86b2cb8-f153-40ac-a44a-84c28bdbd079 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d27907ddc6584509888d19ffa03971bc)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:35:53.291851 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86b2cb8-f153-40ac-a44a-84c28bdbd079 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:35:53.350146 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-e86b2cb8-f153-40ac-a44a-84c28bdbd079 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd27907ddc6584509888d19ffa03971bc'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:35:53.358524 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-e86b2cb8-f153-40ac-a44a-84c28bdbd079 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd27907ddc6584509888d19ffa03971bc'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:35:53.371563 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-e86b2cb8-f153-40ac-a44a-84c28bdbd079 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd27907ddc6584509888d19ffa03971bc'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:35:53.377218 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:35:53.379534 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-e86b2cb8-f153-40ac-a44a-84c28bdbd079 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd27907ddc6584509888d19ffa03971bc'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:35:53.380657 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-e86b2cb8-f153-40ac-a44a-84c28bdbd079 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd27907ddc6584509888d19ffa03971bc'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:35:53.388337 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1215/2432] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Oct 12 02:35:53 2022] DELETE /identity/v3/users/d27907ddc6584509888d19ffa03971bc => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 02:35:53.573803 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f3a465-c642-4936-9a6d-d71f2509a5c1 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:35:53.575482 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-43f3a465-c642-4936-9a6d-d71f2509a5c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:35:53.591240 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f3a465-c642-4936-9a6d-d71f2509a5c1 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:35:53.624400 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408db878-8de3-41e3-9e78-f8b4fe82caf5 None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:35:53.624724 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408db878-8de3-41e3-9e78-f8b4fe82caf5 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:35:53.624994 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408db878-8de3-41e3-9e78-f8b4fe82caf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:35:53.646635 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-408db878-8de3-41e3-9e78-f8b4fe82caf5 None None] MFA Rules not processed for user `98bd9ff10bf74e1ab588810c83a9c7e9`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:35:53.647839 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-408db878-8de3-41e3-9e78-f8b4fe82caf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:35:53.660867 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4604b322-606e-48bb-8fe0-03eb7b92cfa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:35:53.661589 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4604b322-606e-48bb-8fe0-03eb7b92cfa7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:35:53.661934 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4604b322-606e-48bb-8fe0-03eb7b92cfa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:35:53.662290 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4604b322-606e-48bb-8fe0-03eb7b92cfa7 admin admin] PATH_INFO: `/v3/projects/3c84e4b8d59740fb92c2253912e227d6` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:35:53.663486 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4604b322-606e-48bb-8fe0-03eb7b92cfa7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3c84e4b8d59740fb92c2253912e227d6)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:35:53.665498 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4604b322-606e-48bb-8fe0-03eb7b92cfa7 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:35:53.701537 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:35:53.705509 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1216/2433] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 02:35:53 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 02:35:53.717478 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-4604b322-606e-48bb-8fe0-03eb7b92cfa7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3c84e4b8d59740fb92c2253912e227d6', 'request_id': 'req-4604b322-606e-48bb-8fe0-03eb7b92cfa7'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:35:53.723136 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-4604b322-606e-48bb-8fe0-03eb7b92cfa7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3c84e4b8d59740fb92c2253912e227d6', 'request_id': 'req-4604b322-606e-48bb-8fe0-03eb7b92cfa7'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:35:53.733907 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-4604b322-606e-48bb-8fe0-03eb7b92cfa7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3c84e4b8d59740fb92c2253912e227d6', 'request_id': 'req-4604b322-606e-48bb-8fe0-03eb7b92cfa7'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:35:53.760101 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-4604b322-606e-48bb-8fe0-03eb7b92cfa7 admin admin] The token cache is being invalidate because project 3c84e4b8d59740fb92c2253912e227d6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81362) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 02:35:53.760642 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-4604b322-606e-48bb-8fe0-03eb7b92cfa7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:35:53.761398 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-4604b322-606e-48bb-8fe0-03eb7b92cfa7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:35:53.766649 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1218/2434] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Oct 12 02:35:53 2022] DELETE /identity/v3/projects/3c84e4b8d59740fb92c2253912e227d6 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 02:35:53.768211 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca46a3a6-4fa3-4405-a813-c9b05fcd826d None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:35:53.768524 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca46a3a6-4fa3-4405-a813-c9b05fcd826d None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:35:53.768802 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca46a3a6-4fa3-4405-a813-c9b05fcd826d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:35:53.790279 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-ca46a3a6-4fa3-4405-a813-c9b05fcd826d None None] MFA Rules not processed for user `a326a5bb7364479382f528a592371656`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:35:53.791540 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-ca46a3a6-4fa3-4405-a813-c9b05fcd826d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:35:53.863564 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1217/2435] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 02:35:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 02:35:53.872039 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8433b252-218d-4611-bc4f-d27c802ae71f None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:35:53.872328 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8433b252-218d-4611-bc4f-d27c802ae71f None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:35:53.873543 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8433b252-218d-4611-bc4f-d27c802ae71f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:35:53.898540 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-8433b252-218d-4611-bc4f-d27c802ae71f None None] MFA Rules not processed for user `a326a5bb7364479382f528a592371656`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:35:53.899764 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-8433b252-218d-4611-bc4f-d27c802ae71f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:35:53.909975 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1219/2436] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 02:35:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 02:35:53.914090 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca46a3a6-4fa3-4405-a813-c9b05fcd826d None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:35:53.924353 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca46a3a6-4fa3-4405-a813-c9b05fcd826d None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:35:53.930191 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46b9b43-eab2-4c28-bb28-c6f60f506ff0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:35:53.930936 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46b9b43-eab2-4c28-bb28-c6f60f506ff0 admin admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:35:53.931216 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46b9b43-eab2-4c28-bb28-c6f60f506ff0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:35:53.931483 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46b9b43-eab2-4c28-bb28-c6f60f506ff0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:35:53.932157 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46b9b43-eab2-4c28-bb28-c6f60f506ff0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 02:35:53.932452 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46b9b43-eab2-4c28-bb28-c6f60f506ff0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:35:53.934081 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46b9b43-eab2-4c28-bb28-c6f60f506ff0 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:35:53.947760 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1218/2437] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Oct 12 02:35:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 02:35:53.955562 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8433b252-218d-4611-bc4f-d27c802ae71f None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:35:53.965565 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8433b252-218d-4611-bc4f-d27c802ae71f None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:35:53.970315 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76cdd8e-3612-4b68-a2de-cde00a661107 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:35:53.970945 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76cdd8e-3612-4b68-a2de-cde00a661107 admin admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:35:53.971303 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76cdd8e-3612-4b68-a2de-cde00a661107 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:35:53.971569 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76cdd8e-3612-4b68-a2de-cde00a661107 admin admin] PATH_INFO: `/v3/projects` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:35:53.972252 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76cdd8e-3612-4b68-a2de-cde00a661107 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:35:53.974822 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76cdd8e-3612-4b68-a2de-cde00a661107 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:35:54.029746 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1220/2438] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Oct 12 02:35:53 2022] POST /identity/v3/projects => generated 375 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 02:35:54.031189 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46b9b43-eab2-4c28-bb28-c6f60f506ff0 admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:35:54.045379 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46b9b43-eab2-4c28-bb28-c6f60f506ff0 admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:35:54.075096 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76cdd8e-3612-4b68-a2de-cde00a661107 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:35:54.076964 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-a76cdd8e-3612-4b68-a2de-cde00a661107 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:35:54.129806 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33387e9-0aaf-4bfb-bc96-464421cc07ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:35:54.130299 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33387e9-0aaf-4bfb-bc96-464421cc07ed admin admin] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:35:54.130583 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33387e9-0aaf-4bfb-bc96-464421cc07ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:35:54.130860 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33387e9-0aaf-4bfb-bc96-464421cc07ed admin admin] PATH_INFO: `/v3/users` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:35:54.131536 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33387e9-0aaf-4bfb-bc96-464421cc07ed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:35:54.134219 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33387e9-0aaf-4bfb-bc96-464421cc07ed admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:35:54.152424 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76cdd8e-3612-4b68-a2de-cde00a661107 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:35:54.156402 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf69493-e300-4837-949e-ebb0bf73d2db service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5223b5cab3114e9b9a13c582f8ef8386', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'beb6def6fcad45959e56425bb8bff4d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:35:54.157058 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf69493-e300-4837-949e-ebb0bf73d2db service neutron] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:35:54.157369 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf69493-e300-4837-949e-ebb0bf73d2db service neutron] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:35:54.157604 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf69493-e300-4837-949e-ebb0bf73d2db service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:35:54.160917 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-baf69493-e300-4837-949e-ebb0bf73d2db service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:35:54.166698 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1219/2439] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Oct 12 02:35:54 2022] POST /identity/v3/users => generated 288 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 02:35:54.167748 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33387e9-0aaf-4bfb-bc96-464421cc07ed admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:35:54.173184 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf69493-e300-4837-949e-ebb0bf73d2db service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:35:54.174666 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf69493-e300-4837-949e-ebb0bf73d2db service neutron] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:35:54.182576 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33387e9-0aaf-4bfb-bc96-464421cc07ed admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:35:54.185534 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1221/2440] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 02:35:54 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 12 02:35:54.189300 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42818f29-6c4e-472a-94b1-328bb285c75a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:35:54.189923 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42818f29-6c4e-472a-94b1-328bb285c75a admin admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:35:54.190195 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42818f29-6c4e-472a-94b1-328bb285c75a admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:35:54.190461 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42818f29-6c4e-472a-94b1-328bb285c75a admin admin] PATH_INFO: `/v3/roles` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:35:54.191172 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42818f29-6c4e-472a-94b1-328bb285c75a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:35:54.192825 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42818f29-6c4e-472a-94b1-328bb285c75a admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:35:54.206215 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1220/2441] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Oct 12 02:35:54 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 02:35:54.209803 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf69493-e300-4837-949e-ebb0bf73d2db service neutron] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:35:54.223813 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf69493-e300-4837-949e-ebb0bf73d2db service neutron] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:35:54.228892 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c833e2-8969-4226-a706-0197c8b08517 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:35:54.229540 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c833e2-8969-4226-a706-0197c8b08517 admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:35:54.229836 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c833e2-8969-4226-a706-0197c8b08517 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:35:54.230157 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c833e2-8969-4226-a706-0197c8b08517 admin admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:35:54.230823 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c833e2-8969-4226-a706-0197c8b08517 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:35:54.232488 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c833e2-8969-4226-a706-0197c8b08517 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:35:54.244379 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1222/2442] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Oct 12 02:35:54 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 02:35:54.249993 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42818f29-6c4e-472a-94b1-328bb285c75a admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:35:54.265171 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42818f29-6c4e-472a-94b1-328bb285c75a admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:35:54.271061 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2330397e-1313-4bfd-9c76-fed8968d1562 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:35:54.272246 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2330397e-1313-4bfd-9c76-fed8968d1562 admin admin] REQUEST_METHOD: `PUT` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:35:54.272246 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2330397e-1313-4bfd-9c76-fed8968d1562 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:35:54.272641 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2330397e-1313-4bfd-9c76-fed8968d1562 admin admin] PATH_INFO: `/v3/projects/5fa306b14971464ca327898e9dfa1656/users/7e63bcad68ec46f5b173a4f2e0cbe4e7/roles/3d75c4d7f1a849b9a771504d1583ab28` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:35:54.275188 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:35:54.299126 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2330397e-1313-4bfd-9c76-fed8968d1562 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5fa306b14971464ca327898e9dfa1656, user_id=7e63bcad68ec46f5b173a4f2e0cbe4e7, role_id=3d75c4d7f1a849b9a771504d1583ab28)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:35:54.302539 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2330397e-1313-4bfd-9c76-fed8968d1562 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:35:54.323020 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1221/2443] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Oct 12 02:35:54 2022] PUT /identity/v3/projects/5fa306b14971464ca327898e9dfa1656/users/7e63bcad68ec46f5b173a4f2e0cbe4e7/roles/3d75c4d7f1a849b9a771504d1583ab28 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 02:35:54.334647 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacbf5b3-bb2c-47e8-b03c-813b53f2684e None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:35:54.334950 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacbf5b3-bb2c-47e8-b03c-813b53f2684e None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:35:54.335284 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacbf5b3-bb2c-47e8-b03c-813b53f2684e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:35:54.370651 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-cacbf5b3-bb2c-47e8-b03c-813b53f2684e None None] MFA Rules not processed for user `7e63bcad68ec46f5b173a4f2e0cbe4e7`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:35:54.372083 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-cacbf5b3-bb2c-47e8-b03c-813b53f2684e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:35:54.444831 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1223/2444] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 02:35:54 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 02:35:54.449597 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2330397e-1313-4bfd-9c76-fed8968d1562 admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:35:54.517636 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2330397e-1313-4bfd-9c76-fed8968d1562 admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:35:54.523108 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb8ef78-f768-483c-b1d9-77e4d07ae29a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:35:54.523908 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb8ef78-f768-483c-b1d9-77e4d07ae29a admin admin] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:35:54.524192 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb8ef78-f768-483c-b1d9-77e4d07ae29a admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:35:54.524463 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb8ef78-f768-483c-b1d9-77e4d07ae29a admin admin] PATH_INFO: `/v3/projects` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:35:54.526382 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb8ef78-f768-483c-b1d9-77e4d07ae29a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:35:54.528574 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb8ef78-f768-483c-b1d9-77e4d07ae29a admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:35:54.559175 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1222/2445] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Oct 12 02:35:54 2022] POST /identity/v3/projects => generated 375 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 02:35:54.563271 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacbf5b3-bb2c-47e8-b03c-813b53f2684e None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:35:54.574777 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacbf5b3-bb2c-47e8-b03c-813b53f2684e None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:35:54.583457 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:35:54.634213 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fde961f-8afa-439e-8bfb-b04efac5ecef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:35:54.634930 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fde961f-8afa-439e-8bfb-b04efac5ecef admin admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:35:54.635214 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fde961f-8afa-439e-8bfb-b04efac5ecef admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:35:54.635639 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fde961f-8afa-439e-8bfb-b04efac5ecef admin admin] PATH_INFO: `/v3/users` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:35:54.636288 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fde961f-8afa-439e-8bfb-b04efac5ecef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:35:54.638271 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fde961f-8afa-439e-8bfb-b04efac5ecef admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:35:54.664959 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1224/2446] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Oct 12 02:35:54 2022] POST /identity/v3/users => generated 294 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 02:35:54.666517 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb8ef78-f768-483c-b1d9-77e4d07ae29a admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:35:54.677028 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb8ef78-f768-483c-b1d9-77e4d07ae29a admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:35:54.681659 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7dec12a-ad81-430e-96b2-c14ee67e0add admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:35:54.682254 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dec12a-ad81-430e-96b2-c14ee67e0add admin admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:35:54.682537 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dec12a-ad81-430e-96b2-c14ee67e0add admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:35:54.682809 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dec12a-ad81-430e-96b2-c14ee67e0add admin admin] PATH_INFO: `/v3/roles` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:35:54.683450 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7dec12a-ad81-430e-96b2-c14ee67e0add admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:35:54.685089 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7dec12a-ad81-430e-96b2-c14ee67e0add admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:35:54.695943 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1223/2447] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Oct 12 02:35:54 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 02:35:54.700034 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fde961f-8afa-439e-8bfb-b04efac5ecef admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:35:54.710950 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fde961f-8afa-439e-8bfb-b04efac5ecef admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:35:54.715932 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66434aa3-5e34-4b3f-a495-bdf5572f05d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:35:54.716696 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66434aa3-5e34-4b3f-a495-bdf5572f05d9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:35:54.717048 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66434aa3-5e34-4b3f-a495-bdf5572f05d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:35:54.717420 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66434aa3-5e34-4b3f-a495-bdf5572f05d9 admin admin] PATH_INFO: `/v3/projects/ee10dd150c564313ab3749a17dbd025e/users/92a02ca65f4648b886a7a8c9c72870f7/roles/39b1e8108dff402383def3c559f48189` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:35:54.733098 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66434aa3-5e34-4b3f-a495-bdf5572f05d9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ee10dd150c564313ab3749a17dbd025e, user_id=92a02ca65f4648b886a7a8c9c72870f7, role_id=39b1e8108dff402383def3c559f48189)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:35:54.735875 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66434aa3-5e34-4b3f-a495-bdf5572f05d9 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:35:54.750005 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1225/2448] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Oct 12 02:35:54 2022] PUT /identity/v3/projects/ee10dd150c564313ab3749a17dbd025e/users/92a02ca65f4648b886a7a8c9c72870f7/roles/39b1e8108dff402383def3c559f48189 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 02:35:54.754202 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7dec12a-ad81-430e-96b2-c14ee67e0add admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:35:54.764173 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7dec12a-ad81-430e-96b2-c14ee67e0add admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:35:54.822942 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bd5cf2-ec1c-446e-a936-53dc903dc883 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:35:54.823552 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bd5cf2-ec1c-446e-a936-53dc903dc883 admin admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:35:54.823833 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bd5cf2-ec1c-446e-a936-53dc903dc883 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:35:54.824105 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bd5cf2-ec1c-446e-a936-53dc903dc883 admin admin] PATH_INFO: `/v3/roles` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:35:54.824773 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40bd5cf2-ec1c-446e-a936-53dc903dc883 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:35:54.826375 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40bd5cf2-ec1c-446e-a936-53dc903dc883 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:35:54.836600 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1224/2449] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Oct 12 02:35:54 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 02:35:54.840901 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66434aa3-5e34-4b3f-a495-bdf5572f05d9 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:35:54.851759 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66434aa3-5e34-4b3f-a495-bdf5572f05d9 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:35:54.857028 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58da1b90-be03-4a55-9ef9-f55ecaa6fd04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:35:54.857691 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58da1b90-be03-4a55-9ef9-f55ecaa6fd04 admin admin] REQUEST_METHOD: `PUT` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:35:54.857972 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58da1b90-be03-4a55-9ef9-f55ecaa6fd04 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:35:54.858249 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58da1b90-be03-4a55-9ef9-f55ecaa6fd04 admin admin] PATH_INFO: `/v3/projects/ee10dd150c564313ab3749a17dbd025e/users/92a02ca65f4648b886a7a8c9c72870f7/roles/39b1e8108dff402383def3c559f48189` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:35:54.862202 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58da1b90-be03-4a55-9ef9-f55ecaa6fd04 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ee10dd150c564313ab3749a17dbd025e, user_id=92a02ca65f4648b886a7a8c9c72870f7, role_id=39b1e8108dff402383def3c559f48189)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:35:54.863234 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58da1b90-be03-4a55-9ef9-f55ecaa6fd04 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:35:54.874353 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1226/2450] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Oct 12 02:35:54 2022] PUT /identity/v3/projects/ee10dd150c564313ab3749a17dbd025e/users/92a02ca65f4648b886a7a8c9c72870f7/roles/39b1e8108dff402383def3c559f48189 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 02:35:54.942183 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98675ab-da67-443c-b8c6-a7cc267c3250 None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:35:54.942468 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98675ab-da67-443c-b8c6-a7cc267c3250 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:35:54.942770 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98675ab-da67-443c-b8c6-a7cc267c3250 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:35:54.971910 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-f98675ab-da67-443c-b8c6-a7cc267c3250 None None] MFA Rules not processed for user `92a02ca65f4648b886a7a8c9c72870f7`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:35:54.973358 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-f98675ab-da67-443c-b8c6-a7cc267c3250 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:35:55.016140 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:35:55.044935 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1225/2451] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 02:35:54 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 02:35:55.057398 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58da1b90-be03-4a55-9ef9-f55ecaa6fd04 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:35:55.059622 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-58da1b90-be03-4a55-9ef9-f55ecaa6fd04 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:35:55.120708 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58da1b90-be03-4a55-9ef9-f55ecaa6fd04 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:35:55.124581 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a01c2a3-30f1-41a9-b41d-e47fdc8ba063 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ba688e0c4d44d13898539ee886f95fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'beb6def6fcad45959e56425bb8bff4d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:35:55.125195 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a01c2a3-30f1-41a9-b41d-e47fdc8ba063 service cinder] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:35:55.125475 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a01c2a3-30f1-41a9-b41d-e47fdc8ba063 service cinder] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:35:55.125750 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a01c2a3-30f1-41a9-b41d-e47fdc8ba063 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:35:55.185997 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a01c2a3-30f1-41a9-b41d-e47fdc8ba063 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:35:55.187340 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a01c2a3-30f1-41a9-b41d-e47fdc8ba063 service cinder] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:35:55.197340 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1227/2452] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 02:35:55 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 02:35:57.801341 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98675ab-da67-443c-b8c6-a7cc267c3250 None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:35:57.875922 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98675ab-da67-443c-b8c6-a7cc267c3250 None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:35:57.882159 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a8e1f0-c3b2-4d4a-841b-97d04632fc1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:35:57.882810 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a8e1f0-c3b2-4d4a-841b-97d04632fc1d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:35:57.883086 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a8e1f0-c3b2-4d4a-841b-97d04632fc1d admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:35:57.883511 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a8e1f0-c3b2-4d4a-841b-97d04632fc1d admin admin] PATH_INFO: `/v3/users/7e63bcad68ec46f5b173a4f2e0cbe4e7` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:35:57.884524 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a8e1f0-c3b2-4d4a-841b-97d04632fc1d admin admin] RBAC: Authorizing `identity:delete_user(user_id=7e63bcad68ec46f5b173a4f2e0cbe4e7)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:35:57.886559 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a8e1f0-c3b2-4d4a-841b-97d04632fc1d admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:35:57.952823 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-c5a8e1f0-c3b2-4d4a-841b-97d04632fc1d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7e63bcad68ec46f5b173a4f2e0cbe4e7'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:35:57.962659 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-c5a8e1f0-c3b2-4d4a-841b-97d04632fc1d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7e63bcad68ec46f5b173a4f2e0cbe4e7'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:35:57.978430 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-c5a8e1f0-c3b2-4d4a-841b-97d04632fc1d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7e63bcad68ec46f5b173a4f2e0cbe4e7'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:35:57.988135 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-c5a8e1f0-c3b2-4d4a-841b-97d04632fc1d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7e63bcad68ec46f5b173a4f2e0cbe4e7'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:35:57.989238 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-c5a8e1f0-c3b2-4d4a-841b-97d04632fc1d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7e63bcad68ec46f5b173a4f2e0cbe4e7'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:35:57.996717 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1226/2453] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Oct 12 02:35:57 2022] DELETE /identity/v3/users/7e63bcad68ec46f5b173a4f2e0cbe4e7 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 02:35:58.001137 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58dc28b-308e-49a7-bd3f-80649e8e5775 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:35:58.001632 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58dc28b-308e-49a7-bd3f-80649e8e5775 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:35:58.001997 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58dc28b-308e-49a7-bd3f-80649e8e5775 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:35:58.025320 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-d58dc28b-308e-49a7-bd3f-80649e8e5775 None None] MFA Rules not processed for user `a326a5bb7364479382f528a592371656`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:35:58.027406 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-d58dc28b-308e-49a7-bd3f-80649e8e5775 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:35:58.044544 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:35:58.122546 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1228/2454] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 02:35:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 02:35:58.133414 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a8e1f0-c3b2-4d4a-841b-97d04632fc1d admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:35:58.134943 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-c5a8e1f0-c3b2-4d4a-841b-97d04632fc1d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:35:58.195984 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a8e1f0-c3b2-4d4a-841b-97d04632fc1d admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:35:58.199633 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61804abe-5bce-4e1c-b1ac-1d76e9b88964 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5223b5cab3114e9b9a13c582f8ef8386', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'beb6def6fcad45959e56425bb8bff4d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:35:58.200270 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61804abe-5bce-4e1c-b1ac-1d76e9b88964 service neutron] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:35:58.200622 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61804abe-5bce-4e1c-b1ac-1d76e9b88964 service neutron] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:35:58.200903 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61804abe-5bce-4e1c-b1ac-1d76e9b88964 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:35:58.212038 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61804abe-5bce-4e1c-b1ac-1d76e9b88964 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:35:58.213555 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61804abe-5bce-4e1c-b1ac-1d76e9b88964 service neutron] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:35:58.218831 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:35:58.224942 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1227/2455] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 02:35:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 12 02:35:58.551312 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58dc28b-308e-49a7-bd3f-80649e8e5775 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:35:58.552978 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-d58dc28b-308e-49a7-bd3f-80649e8e5775 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:35:58.566186 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58dc28b-308e-49a7-bd3f-80649e8e5775 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:35:58.572102 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6482e9b-b38b-42ab-98b4-4df5dacefb5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:35:58.572900 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6482e9b-b38b-42ab-98b4-4df5dacefb5c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:35:58.573277 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6482e9b-b38b-42ab-98b4-4df5dacefb5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:35:58.573644 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6482e9b-b38b-42ab-98b4-4df5dacefb5c admin admin] PATH_INFO: `/v3/projects/5fa306b14971464ca327898e9dfa1656` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:35:58.574842 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6482e9b-b38b-42ab-98b4-4df5dacefb5c admin admin] RBAC: Authorizing `identity:delete_project(project_id=5fa306b14971464ca327898e9dfa1656)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:35:58.576876 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6482e9b-b38b-42ab-98b4-4df5dacefb5c admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:35:58.629817 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-e6482e9b-b38b-42ab-98b4-4df5dacefb5c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5fa306b14971464ca327898e9dfa1656', 'request_id': 'req-e6482e9b-b38b-42ab-98b4-4df5dacefb5c'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:35:58.635792 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-e6482e9b-b38b-42ab-98b4-4df5dacefb5c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5fa306b14971464ca327898e9dfa1656', 'request_id': 'req-e6482e9b-b38b-42ab-98b4-4df5dacefb5c'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:35:58.643079 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-e6482e9b-b38b-42ab-98b4-4df5dacefb5c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5fa306b14971464ca327898e9dfa1656', 'request_id': 'req-e6482e9b-b38b-42ab-98b4-4df5dacefb5c'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:35:58.657548 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-e6482e9b-b38b-42ab-98b4-4df5dacefb5c admin admin] The token cache is being invalidate because project 5fa306b14971464ca327898e9dfa1656 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81362) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 02:35:58.657951 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-e6482e9b-b38b-42ab-98b4-4df5dacefb5c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:35:58.658664 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-e6482e9b-b38b-42ab-98b4-4df5dacefb5c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:35:58.660547 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1229/2456] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Oct 12 02:35:58 2022] DELETE /identity/v3/projects/5fa306b14971464ca327898e9dfa1656 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 02:35:58.664707 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61804abe-5bce-4e1c-b1ac-1d76e9b88964 service neutron] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:35:58.674766 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61804abe-5bce-4e1c-b1ac-1d76e9b88964 service neutron] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:35:58.736540 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857cd72a-3fe7-4630-a395-ebab8b3f211a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:35:58.737323 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857cd72a-3fe7-4630-a395-ebab8b3f211a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:35:58.737655 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857cd72a-3fe7-4630-a395-ebab8b3f211a admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:35:58.738149 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857cd72a-3fe7-4630-a395-ebab8b3f211a admin admin] PATH_INFO: `/v3/users/92a02ca65f4648b886a7a8c9c72870f7` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:35:58.739701 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857cd72a-3fe7-4630-a395-ebab8b3f211a admin admin] RBAC: Authorizing `identity:delete_user(user_id=92a02ca65f4648b886a7a8c9c72870f7)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:35:58.741741 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857cd72a-3fe7-4630-a395-ebab8b3f211a admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:35:58.790224 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-857cd72a-3fe7-4630-a395-ebab8b3f211a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '92a02ca65f4648b886a7a8c9c72870f7'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:35:58.797817 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-857cd72a-3fe7-4630-a395-ebab8b3f211a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '92a02ca65f4648b886a7a8c9c72870f7'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:35:58.811338 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-857cd72a-3fe7-4630-a395-ebab8b3f211a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '92a02ca65f4648b886a7a8c9c72870f7'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:35:58.819151 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-857cd72a-3fe7-4630-a395-ebab8b3f211a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '92a02ca65f4648b886a7a8c9c72870f7'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:35:58.819878 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-857cd72a-3fe7-4630-a395-ebab8b3f211a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '92a02ca65f4648b886a7a8c9c72870f7'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:35:58.826107 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1228/2457] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Oct 12 02:35:58 2022] DELETE /identity/v3/users/92a02ca65f4648b886a7a8c9c72870f7 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 02:35:59.105814 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6482e9b-b38b-42ab-98b4-4df5dacefb5c admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:35:59.109366 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-e6482e9b-b38b-42ab-98b4-4df5dacefb5c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:35:59.136330 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6482e9b-b38b-42ab-98b4-4df5dacefb5c admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:35:59.213620 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4697501-a5c9-4f12-8280-e438fdd347ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:35:59.214265 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4697501-a5c9-4f12-8280-e438fdd347ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:35:59.214544 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4697501-a5c9-4f12-8280-e438fdd347ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:35:59.214816 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4697501-a5c9-4f12-8280-e438fdd347ad admin admin] PATH_INFO: `/v3/projects/ee10dd150c564313ab3749a17dbd025e` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:35:59.216122 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4697501-a5c9-4f12-8280-e438fdd347ad admin admin] RBAC: Authorizing `identity:delete_project(project_id=ee10dd150c564313ab3749a17dbd025e)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:35:59.218066 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4697501-a5c9-4f12-8280-e438fdd347ad admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:35:59.269928 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:35:59.275118 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-c4697501-a5c9-4f12-8280-e438fdd347ad admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ee10dd150c564313ab3749a17dbd025e', 'request_id': 'req-c4697501-a5c9-4f12-8280-e438fdd347ad'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:35:59.281489 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-c4697501-a5c9-4f12-8280-e438fdd347ad admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ee10dd150c564313ab3749a17dbd025e', 'request_id': 'req-c4697501-a5c9-4f12-8280-e438fdd347ad'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:35:59.288148 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-c4697501-a5c9-4f12-8280-e438fdd347ad admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ee10dd150c564313ab3749a17dbd025e', 'request_id': 'req-c4697501-a5c9-4f12-8280-e438fdd347ad'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:35:59.300001 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-c4697501-a5c9-4f12-8280-e438fdd347ad admin admin] The token cache is being invalidate because project ee10dd150c564313ab3749a17dbd025e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81362) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 02:35:59.300280 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-c4697501-a5c9-4f12-8280-e438fdd347ad admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:35:59.300926 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-c4697501-a5c9-4f12-8280-e438fdd347ad admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:35:59.302411 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1230/2458] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Oct 12 02:35:59 2022] DELETE /identity/v3/projects/ee10dd150c564313ab3749a17dbd025e => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 02:36:07.345424 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857cd72a-3fe7-4630-a395-ebab8b3f211a admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:36:07.347537 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-857cd72a-3fe7-4630-a395-ebab8b3f211a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:36:07.422709 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857cd72a-3fe7-4630-a395-ebab8b3f211a admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:36:07.436233 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:36:07.492606 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2dc133c-4d95-4395-b74a-95275c31e4ed service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fca96c111b45b795fb757f77908ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'beb6def6fcad45959e56425bb8bff4d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:36:07.493234 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dc133c-4d95-4395-b74a-95275c31e4ed service nova] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:36:07.493515 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dc133c-4d95-4395-b74a-95275c31e4ed service nova] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:36:07.493789 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dc133c-4d95-4395-b74a-95275c31e4ed service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:36:07.495744 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-a2dc133c-4d95-4395-b74a-95275c31e4ed service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:36:07.509789 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2dc133c-4d95-4395-b74a-95275c31e4ed service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:36:07.511400 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2dc133c-4d95-4395-b74a-95275c31e4ed service nova] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:36:07.523937 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1229/2459] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 02:36:07 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 02:36:09.296960 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=8,keystone:DELETE=4,keystone:INSERT=1 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:36:17.517975 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=26 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:36:45.368857 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b9fea4-39c2-41d5-915e-ceac39ffbf53 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:36:45.369380 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b9fea4-39c2-41d5-915e-ceac39ffbf53 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:36:45.369380 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b9fea4-39c2-41d5-915e-ceac39ffbf53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:36:45.388999 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-c7b9fea4-39c2-41d5-915e-ceac39ffbf53 None None] MFA Rules not processed for user `98bd9ff10bf74e1ab588810c83a9c7e9`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:36:45.390203 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-c7b9fea4-39c2-41d5-915e-ceac39ffbf53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:36:45.446138 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1231/2460] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 02:36:45 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 02:36:55.438696 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=25 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:37:42.766178 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f175beaf-e717-4512-af51-e04b0614b2ce None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:37:42.766695 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f175beaf-e717-4512-af51-e04b0614b2ce None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:37:42.766810 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f175beaf-e717-4512-af51-e04b0614b2ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:37:42.796055 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-f175beaf-e717-4512-af51-e04b0614b2ce None None] MFA Rules not processed for user `98bd9ff10bf74e1ab588810c83a9c7e9`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:37:42.797313 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-f175beaf-e717-4512-af51-e04b0614b2ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:37:42.821139 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1230/2461] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 02:37:42 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 02:37:52.819385 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=15 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:38:35.296346 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fbf1ad-4b46-4e10-8677-22ee2f8d54c6 None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:38:35.296928 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fbf1ad-4b46-4e10-8677-22ee2f8d54c6 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:38:35.296928 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fbf1ad-4b46-4e10-8677-22ee2f8d54c6 None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:38:35.298104 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1232/2462] 10.222.0.18 () {54 vars in 961 bytes} [Wed Oct 12 02:38:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 02:38:35.303910 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53365ad2-ca4d-4aa9-a338-f45e555504b3 None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:38:35.304434 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53365ad2-ca4d-4aa9-a338-f45e555504b3 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:38:35.305239 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53365ad2-ca4d-4aa9-a338-f45e555504b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:38:35.378063 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-53365ad2-ca4d-4aa9-a338-f45e555504b3 None None] MFA Rules not processed for user `a58b9e0467c040638c3d43e3ac9c0495`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:38:35.379282 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-53365ad2-ca4d-4aa9-a338-f45e555504b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:38:35.485234 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1231/2463] 10.222.0.18 () {58 vars in 1058 bytes} [Wed Oct 12 02:38:35 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 02:38:35.492971 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fbf1ad-4b46-4e10-8677-22ee2f8d54c6 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:38:35.506464 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fbf1ad-4b46-4e10-8677-22ee2f8d54c6 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:38:35.511617 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553e6a07-0f48-44b8-ac62-03746988f8b9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a58b9e0467c040638c3d43e3ac9c0495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'beb6def6fcad45959e56425bb8bff4d1', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:38:35.512505 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553e6a07-0f48-44b8-ac62-03746988f8b9 service placement] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:38:35.512691 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553e6a07-0f48-44b8-ac62-03746988f8b9 service placement] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:38:35.512944 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553e6a07-0f48-44b8-ac62-03746988f8b9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:38:35.514693 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-553e6a07-0f48-44b8-ac62-03746988f8b9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:38:35.526992 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553e6a07-0f48-44b8-ac62-03746988f8b9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:38:35.529126 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553e6a07-0f48-44b8-ac62-03746988f8b9 service placement] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:38:35.540887 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1233/2464] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 02:38:35 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 02:38:39.093879 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9580ef58-ced4-41f8-b6de-3112668c5cac None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:38:39.094363 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9580ef58-ced4-41f8-b6de-3112668c5cac None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:38:39.094492 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9580ef58-ced4-41f8-b6de-3112668c5cac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:38:39.114487 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-9580ef58-ced4-41f8-b6de-3112668c5cac None None] MFA Rules not processed for user `98bd9ff10bf74e1ab588810c83a9c7e9`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:38:39.115716 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-9580ef58-ced4-41f8-b6de-3112668c5cac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:38:39.123043 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1232/2465] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 02:38:39 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 02:38:45.536273 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=6 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:38:49.109751 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=65 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:39:39.674696 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553e6a07-0f48-44b8-ac62-03746988f8b9 service placement] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:39:39.676366 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-553e6a07-0f48-44b8-ac62-03746988f8b9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:39:39.785433 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553e6a07-0f48-44b8-ac62-03746988f8b9 service placement] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:39:39.790372 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552b2d5c-5fae-4313-84a4-b87a12ab5362 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:39:39.791250 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552b2d5c-5fae-4313-84a4-b87a12ab5362 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:39:39.791530 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552b2d5c-5fae-4313-84a4-b87a12ab5362 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:39:39.791805 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552b2d5c-5fae-4313-84a4-b87a12ab5362 admin admin] PATH_INFO: `/v3/users/98bd9ff10bf74e1ab588810c83a9c7e9` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:39:39.793529 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552b2d5c-5fae-4313-84a4-b87a12ab5362 admin admin] RBAC: Authorizing `identity:delete_user(user_id=98bd9ff10bf74e1ab588810c83a9c7e9)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:39:39.795611 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552b2d5c-5fae-4313-84a4-b87a12ab5362 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:39:39.848879 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-552b2d5c-5fae-4313-84a4-b87a12ab5362 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '98bd9ff10bf74e1ab588810c83a9c7e9'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:39:39.858583 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-552b2d5c-5fae-4313-84a4-b87a12ab5362 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '98bd9ff10bf74e1ab588810c83a9c7e9'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:39:39.873822 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-552b2d5c-5fae-4313-84a4-b87a12ab5362 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '98bd9ff10bf74e1ab588810c83a9c7e9'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:39:39.880626 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-552b2d5c-5fae-4313-84a4-b87a12ab5362 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '98bd9ff10bf74e1ab588810c83a9c7e9'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:39:39.881305 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-552b2d5c-5fae-4313-84a4-b87a12ab5362 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '98bd9ff10bf74e1ab588810c83a9c7e9'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:39:39.887389 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1234/2466] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Oct 12 02:39:39 2022] DELETE /identity/v3/users/98bd9ff10bf74e1ab588810c83a9c7e9 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 02:39:40.066747 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9580ef58-ced4-41f8-b6de-3112668c5cac None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:39:40.080603 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9580ef58-ced4-41f8-b6de-3112668c5cac None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:39:40.139464 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f92405-cf81-42ea-b1c0-3d830154d6ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:39:40.140095 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f92405-cf81-42ea-b1c0-3d830154d6ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:39:40.140379 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f92405-cf81-42ea-b1c0-3d830154d6ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:39:40.140696 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f92405-cf81-42ea-b1c0-3d830154d6ee admin admin] PATH_INFO: `/v3/projects/7eee400d8a3e49779363a82047c30632` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:39:40.141799 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f92405-cf81-42ea-b1c0-3d830154d6ee admin admin] RBAC: Authorizing `identity:delete_project(project_id=7eee400d8a3e49779363a82047c30632)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:39:40.143701 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f92405-cf81-42ea-b1c0-3d830154d6ee admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:39:40.190222 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-97f92405-cf81-42ea-b1c0-3d830154d6ee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7eee400d8a3e49779363a82047c30632', 'request_id': 'req-97f92405-cf81-42ea-b1c0-3d830154d6ee'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:39:40.195568 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-97f92405-cf81-42ea-b1c0-3d830154d6ee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7eee400d8a3e49779363a82047c30632', 'request_id': 'req-97f92405-cf81-42ea-b1c0-3d830154d6ee'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:39:40.201763 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-97f92405-cf81-42ea-b1c0-3d830154d6ee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7eee400d8a3e49779363a82047c30632', 'request_id': 'req-97f92405-cf81-42ea-b1c0-3d830154d6ee'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:39:40.213747 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-97f92405-cf81-42ea-b1c0-3d830154d6ee admin admin] The token cache is being invalidate because project 7eee400d8a3e49779363a82047c30632 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81361) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 02:39:40.214038 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-97f92405-cf81-42ea-b1c0-3d830154d6ee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:39:40.215192 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-97f92405-cf81-42ea-b1c0-3d830154d6ee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:39:40.216892 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1233/2467] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Oct 12 02:39:40 2022] DELETE /identity/v3/projects/7eee400d8a3e49779363a82047c30632 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 02:39:40.222214 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcf4daa-8695-4c4e-afe3-801fdf91c971 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:39:40.222497 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcf4daa-8695-4c4e-afe3-801fdf91c971 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:39:40.222771 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcf4daa-8695-4c4e-afe3-801fdf91c971 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:39:40.273305 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-adcf4daa-8695-4c4e-afe3-801fdf91c971 None None] MFA Rules not processed for user `a326a5bb7364479382f528a592371656`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:39:40.274509 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-adcf4daa-8695-4c4e-afe3-801fdf91c971 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:39:40.299631 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:39:40.336404 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1235/2468] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 02:39:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 02:39:40.345271 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d314e43-6ddf-4131-aef6-0e3447b4a4c9 None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:39:40.345806 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d314e43-6ddf-4131-aef6-0e3447b4a4c9 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:39:40.346077 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d314e43-6ddf-4131-aef6-0e3447b4a4c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:39:40.366183 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-0d314e43-6ddf-4131-aef6-0e3447b4a4c9 None None] MFA Rules not processed for user `a326a5bb7364479382f528a592371656`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:39:40.367383 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-0d314e43-6ddf-4131-aef6-0e3447b4a4c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:39:40.375593 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1234/2469] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 02:39:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 02:39:40.379850 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcf4daa-8695-4c4e-afe3-801fdf91c971 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:39:40.390114 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcf4daa-8695-4c4e-afe3-801fdf91c971 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:39:40.394645 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e81eab-e5a0-4a53-a4d3-02df3fa03191 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:39:40.395240 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e81eab-e5a0-4a53-a4d3-02df3fa03191 admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:39:40.395515 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e81eab-e5a0-4a53-a4d3-02df3fa03191 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:39:40.395783 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e81eab-e5a0-4a53-a4d3-02df3fa03191 admin admin] PATH_INFO: `/v3/domains` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:39:40.396422 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e81eab-e5a0-4a53-a4d3-02df3fa03191 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 02:39:40.396762 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e81eab-e5a0-4a53-a4d3-02df3fa03191 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:39:40.398324 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e81eab-e5a0-4a53-a4d3-02df3fa03191 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:39:40.410384 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1236/2470] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Oct 12 02:39:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 02:39:40.414495 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d314e43-6ddf-4131-aef6-0e3447b4a4c9 None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:39:40.423758 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d314e43-6ddf-4131-aef6-0e3447b4a4c9 None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:39:40.428349 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa03b49-c13d-4bed-9edb-759695258f31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:39:40.428966 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa03b49-c13d-4bed-9edb-759695258f31 admin admin] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:39:40.429242 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa03b49-c13d-4bed-9edb-759695258f31 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:39:40.429536 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa03b49-c13d-4bed-9edb-759695258f31 admin admin] PATH_INFO: `/v3/projects` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:39:40.430150 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa03b49-c13d-4bed-9edb-759695258f31 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:39:40.432031 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa03b49-c13d-4bed-9edb-759695258f31 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:39:40.471684 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1235/2471] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Oct 12 02:39:40 2022] POST /identity/v3/projects => generated 383 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 02:39:40.475692 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e81eab-e5a0-4a53-a4d3-02df3fa03191 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:39:40.485429 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e81eab-e5a0-4a53-a4d3-02df3fa03191 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:39:40.541092 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf44031-f90c-42f3-b800-8dafeee7ab5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:39:40.541696 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf44031-f90c-42f3-b800-8dafeee7ab5e admin admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:39:40.541971 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf44031-f90c-42f3-b800-8dafeee7ab5e admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:39:40.542248 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf44031-f90c-42f3-b800-8dafeee7ab5e admin admin] PATH_INFO: `/v3/users` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:39:40.542926 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf44031-f90c-42f3-b800-8dafeee7ab5e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:39:40.545041 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf44031-f90c-42f3-b800-8dafeee7ab5e admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:39:40.566148 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1237/2472] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Oct 12 02:39:40 2022] POST /identity/v3/users => generated 292 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 02:39:40.570296 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa03b49-c13d-4bed-9edb-759695258f31 admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:39:40.581776 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa03b49-c13d-4bed-9edb-759695258f31 admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:39:40.589346 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00beca5e-f3ad-4420-b226-73be43d5866d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:39:40.590813 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00beca5e-f3ad-4420-b226-73be43d5866d admin admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:39:40.591095 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00beca5e-f3ad-4420-b226-73be43d5866d admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:39:40.591369 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00beca5e-f3ad-4420-b226-73be43d5866d admin admin] PATH_INFO: `/v3/roles` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:39:40.592016 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00beca5e-f3ad-4420-b226-73be43d5866d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:39:40.593636 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00beca5e-f3ad-4420-b226-73be43d5866d admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:39:40.604154 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1236/2473] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Oct 12 02:39:40 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 02:39:40.608317 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf44031-f90c-42f3-b800-8dafeee7ab5e admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:39:40.618019 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf44031-f90c-42f3-b800-8dafeee7ab5e admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:39:40.622621 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b9a7a8-30bc-4ad7-bcfb-9280263b74d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:39:40.623209 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b9a7a8-30bc-4ad7-bcfb-9280263b74d7 admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:39:40.623483 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b9a7a8-30bc-4ad7-bcfb-9280263b74d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:39:40.623749 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b9a7a8-30bc-4ad7-bcfb-9280263b74d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:39:40.624380 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b9a7a8-30bc-4ad7-bcfb-9280263b74d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:39:40.625985 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b9a7a8-30bc-4ad7-bcfb-9280263b74d7 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:39:40.636324 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1238/2474] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Oct 12 02:39:40 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 02:39:40.641333 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00beca5e-f3ad-4420-b226-73be43d5866d admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:39:40.651159 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00beca5e-f3ad-4420-b226-73be43d5866d admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:39:40.657062 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cc5a10-8052-4cdc-a3a9-11504b100246 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:39:40.657710 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cc5a10-8052-4cdc-a3a9-11504b100246 admin admin] REQUEST_METHOD: `PUT` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:39:40.657989 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cc5a10-8052-4cdc-a3a9-11504b100246 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:39:40.658263 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cc5a10-8052-4cdc-a3a9-11504b100246 admin admin] PATH_INFO: `/v3/projects/7894a77d7e83485890a6e31206ce82c1/users/77ec127a57b1453d8e67025b3d408767/roles/3d75c4d7f1a849b9a771504d1583ab28` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:39:40.673133 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27cc5a10-8052-4cdc-a3a9-11504b100246 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7894a77d7e83485890a6e31206ce82c1, user_id=77ec127a57b1453d8e67025b3d408767, role_id=3d75c4d7f1a849b9a771504d1583ab28)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:39:40.675805 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27cc5a10-8052-4cdc-a3a9-11504b100246 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:39:40.688532 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1237/2475] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Oct 12 02:39:40 2022] PUT /identity/v3/projects/7894a77d7e83485890a6e31206ce82c1/users/77ec127a57b1453d8e67025b3d408767/roles/3d75c4d7f1a849b9a771504d1583ab28 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 02:39:40.698825 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0890dcbf-65e2-48b1-9af3-ea8d8920ed97 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:39:40.700035 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0890dcbf-65e2-48b1-9af3-ea8d8920ed97 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:39:40.700035 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0890dcbf-65e2-48b1-9af3-ea8d8920ed97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:39:40.728941 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-0890dcbf-65e2-48b1-9af3-ea8d8920ed97 None None] MFA Rules not processed for user `77ec127a57b1453d8e67025b3d408767`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:39:40.730093 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-0890dcbf-65e2-48b1-9af3-ea8d8920ed97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:39:40.793741 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1239/2476] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 02:39:40 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 02:39:40.798225 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cc5a10-8052-4cdc-a3a9-11504b100246 admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:39:40.817282 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:39:40.866534 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cc5a10-8052-4cdc-a3a9-11504b100246 admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:39:40.866764 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3738f69-e905-485e-bdb9-2c66fe615f55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:39:40.867348 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3738f69-e905-485e-bdb9-2c66fe615f55 admin admin] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:39:40.867519 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3738f69-e905-485e-bdb9-2c66fe615f55 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:39:40.867787 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3738f69-e905-485e-bdb9-2c66fe615f55 admin admin] PATH_INFO: `/v3/projects` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:39:40.868451 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3738f69-e905-485e-bdb9-2c66fe615f55 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:39:40.870368 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3738f69-e905-485e-bdb9-2c66fe615f55 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:39:40.898201 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1238/2477] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Oct 12 02:39:40 2022] POST /identity/v3/projects => generated 383 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 02:39:40.902261 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0890dcbf-65e2-48b1-9af3-ea8d8920ed97 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:39:40.912781 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0890dcbf-65e2-48b1-9af3-ea8d8920ed97 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:39:40.931866 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:39:40.969222 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4042c8e-f214-40c7-b758-b3032ee4820d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:39:40.969848 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4042c8e-f214-40c7-b758-b3032ee4820d admin admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:39:40.970124 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4042c8e-f214-40c7-b758-b3032ee4820d admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:39:40.970647 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4042c8e-f214-40c7-b758-b3032ee4820d admin admin] PATH_INFO: `/v3/users` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:39:40.971273 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4042c8e-f214-40c7-b758-b3032ee4820d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:39:40.973194 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4042c8e-f214-40c7-b758-b3032ee4820d admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:39:40.997142 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1240/2478] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Oct 12 02:39:40 2022] POST /identity/v3/users => generated 298 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 02:39:40.998366 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3738f69-e905-485e-bdb9-2c66fe615f55 admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:39:41.008499 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3738f69-e905-485e-bdb9-2c66fe615f55 admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:39:41.013891 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd295891-59bf-43ba-91a0-412d028dd808 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:39:41.014494 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd295891-59bf-43ba-91a0-412d028dd808 admin admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:39:41.014748 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd295891-59bf-43ba-91a0-412d028dd808 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:39:41.015015 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd295891-59bf-43ba-91a0-412d028dd808 admin admin] PATH_INFO: `/v3/roles` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:39:41.015646 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd295891-59bf-43ba-91a0-412d028dd808 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:39:41.017262 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd295891-59bf-43ba-91a0-412d028dd808 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:39:41.027573 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1239/2479] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Oct 12 02:39:40 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 12 02:39:41.031622 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4042c8e-f214-40c7-b758-b3032ee4820d admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:39:41.041336 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4042c8e-f214-40c7-b758-b3032ee4820d admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:39:41.046065 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e649e49d-4070-4378-81de-70d185d99384 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:39:41.046693 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e649e49d-4070-4378-81de-70d185d99384 admin admin] REQUEST_METHOD: `PUT` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:39:41.046966 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e649e49d-4070-4378-81de-70d185d99384 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:39:41.047235 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e649e49d-4070-4378-81de-70d185d99384 admin admin] PATH_INFO: `/v3/projects/94dbce42bb4b4b60a8f727d4919e92c5/users/a58629246de647469a9102703dd2bcb2/roles/39b1e8108dff402383def3c559f48189` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:39:41.062213 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e649e49d-4070-4378-81de-70d185d99384 admin admin] RBAC: Authorizing `identity:create_grant(project_id=94dbce42bb4b4b60a8f727d4919e92c5, user_id=a58629246de647469a9102703dd2bcb2, role_id=39b1e8108dff402383def3c559f48189)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:39:41.065337 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e649e49d-4070-4378-81de-70d185d99384 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:39:41.080424 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1241/2480] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Oct 12 02:39:41 2022] PUT /identity/v3/projects/94dbce42bb4b4b60a8f727d4919e92c5/users/a58629246de647469a9102703dd2bcb2/roles/39b1e8108dff402383def3c559f48189 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 02:39:41.084955 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd295891-59bf-43ba-91a0-412d028dd808 admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:39:41.095747 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd295891-59bf-43ba-91a0-412d028dd808 admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:39:41.152966 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000abbcf-1158-4595-b936-05dbbb68c73d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:39:41.153572 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000abbcf-1158-4595-b936-05dbbb68c73d admin admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:39:41.153850 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000abbcf-1158-4595-b936-05dbbb68c73d admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:39:41.154124 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000abbcf-1158-4595-b936-05dbbb68c73d admin admin] PATH_INFO: `/v3/roles` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:39:41.154761 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000abbcf-1158-4595-b936-05dbbb68c73d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:39:41.156348 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000abbcf-1158-4595-b936-05dbbb68c73d admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:39:41.166227 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1240/2481] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Oct 12 02:39:41 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 02:39:41.171448 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e649e49d-4070-4378-81de-70d185d99384 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:39:41.181844 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e649e49d-4070-4378-81de-70d185d99384 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:39:41.187217 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835987f8-c1cf-46c9-884f-96d48f529a13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:39:41.187856 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835987f8-c1cf-46c9-884f-96d48f529a13 admin admin] REQUEST_METHOD: `PUT` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:39:41.188130 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835987f8-c1cf-46c9-884f-96d48f529a13 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:39:41.188397 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835987f8-c1cf-46c9-884f-96d48f529a13 admin admin] PATH_INFO: `/v3/projects/94dbce42bb4b4b60a8f727d4919e92c5/users/a58629246de647469a9102703dd2bcb2/roles/39b1e8108dff402383def3c559f48189` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:39:41.190316 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835987f8-c1cf-46c9-884f-96d48f529a13 admin admin] RBAC: Authorizing `identity:create_grant(project_id=94dbce42bb4b4b60a8f727d4919e92c5, user_id=a58629246de647469a9102703dd2bcb2, role_id=39b1e8108dff402383def3c559f48189)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:39:41.192951 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835987f8-c1cf-46c9-884f-96d48f529a13 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:39:41.203016 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1242/2482] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Oct 12 02:39:41 2022] PUT /identity/v3/projects/94dbce42bb4b4b60a8f727d4919e92c5/users/a58629246de647469a9102703dd2bcb2/roles/39b1e8108dff402383def3c559f48189 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 02:39:41.213145 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbc9655-94bf-4050-88f1-1e661296d259 None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:39:41.213428 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbc9655-94bf-4050-88f1-1e661296d259 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:39:41.213730 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbc9655-94bf-4050-88f1-1e661296d259 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:39:41.241996 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-8dbc9655-94bf-4050-88f1-1e661296d259 None None] MFA Rules not processed for user `a58629246de647469a9102703dd2bcb2`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:39:41.243192 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-8dbc9655-94bf-4050-88f1-1e661296d259 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:39:41.312671 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1241/2483] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 02:39:41 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 02:39:41.324192 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835987f8-c1cf-46c9-884f-96d48f529a13 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:39:41.326027 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-835987f8-c1cf-46c9-884f-96d48f529a13 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:39:41.404991 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835987f8-c1cf-46c9-884f-96d48f529a13 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:39:41.408606 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4378b20a-1806-404b-8a3c-768ec932cdee service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ba688e0c4d44d13898539ee886f95fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'beb6def6fcad45959e56425bb8bff4d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:39:41.409205 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4378b20a-1806-404b-8a3c-768ec932cdee service cinder] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:39:41.409484 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4378b20a-1806-404b-8a3c-768ec932cdee service cinder] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:39:41.409758 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4378b20a-1806-404b-8a3c-768ec932cdee service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:39:41.419169 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4378b20a-1806-404b-8a3c-768ec932cdee service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:39:41.420643 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4378b20a-1806-404b-8a3c-768ec932cdee service cinder] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:39:41.430080 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1243/2484] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 02:39:41 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 02:39:41.503584 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbc9655-94bf-4050-88f1-1e661296d259 None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:39:41.513156 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbc9655-94bf-4050-88f1-1e661296d259 None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:39:41.516649 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c3c62f-727b-4704-be27-c18b43b82583 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ba688e0c4d44d13898539ee886f95fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'beb6def6fcad45959e56425bb8bff4d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:39:41.517234 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c3c62f-727b-4704-be27-c18b43b82583 service cinder] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:39:41.517506 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c3c62f-727b-4704-be27-c18b43b82583 service cinder] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:39:41.517774 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c3c62f-727b-4704-be27-c18b43b82583 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:39:41.526860 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:39:41.577726 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c3c62f-727b-4704-be27-c18b43b82583 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:39:41.579129 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c3c62f-727b-4704-be27-c18b43b82583 service cinder] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:39:41.587939 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1242/2485] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 02:39:41 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 02:39:41.851785 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4378b20a-1806-404b-8a3c-768ec932cdee service cinder] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:39:41.914695 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4378b20a-1806-404b-8a3c-768ec932cdee service cinder] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:39:41.919553 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54968fc0-2c3d-4df5-9ace-de1e22956a45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:39:41.920171 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54968fc0-2c3d-4df5-9ace-de1e22956a45 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:39:41.920448 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54968fc0-2c3d-4df5-9ace-de1e22956a45 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:39:41.920761 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54968fc0-2c3d-4df5-9ace-de1e22956a45 admin admin] PATH_INFO: `/v3/users/77ec127a57b1453d8e67025b3d408767` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:39:41.921866 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54968fc0-2c3d-4df5-9ace-de1e22956a45 admin admin] RBAC: Authorizing `identity:delete_user(user_id=77ec127a57b1453d8e67025b3d408767)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:39:41.923790 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54968fc0-2c3d-4df5-9ace-de1e22956a45 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:39:41.925291 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:39:41.972770 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-54968fc0-2c3d-4df5-9ace-de1e22956a45 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '77ec127a57b1453d8e67025b3d408767'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:39:41.980887 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-54968fc0-2c3d-4df5-9ace-de1e22956a45 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '77ec127a57b1453d8e67025b3d408767'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:39:41.993002 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-54968fc0-2c3d-4df5-9ace-de1e22956a45 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '77ec127a57b1453d8e67025b3d408767'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:39:42.000264 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-54968fc0-2c3d-4df5-9ace-de1e22956a45 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '77ec127a57b1453d8e67025b3d408767'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:39:42.000916 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-54968fc0-2c3d-4df5-9ace-de1e22956a45 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '77ec127a57b1453d8e67025b3d408767'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:39:42.006668 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1244/2486] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Oct 12 02:39:41 2022] DELETE /identity/v3/users/77ec127a57b1453d8e67025b3d408767 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 02:39:42.011164 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3c62f6-9363-4604-8250-bcf67d3741ce None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:39:42.012009 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3c62f6-9363-4604-8250-bcf67d3741ce None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:39:42.012287 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3c62f6-9363-4604-8250-bcf67d3741ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:39:42.031624 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-dd3c62f6-9363-4604-8250-bcf67d3741ce None None] MFA Rules not processed for user `a326a5bb7364479382f528a592371656`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:39:42.032842 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-dd3c62f6-9363-4604-8250-bcf67d3741ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:39:42.090542 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1243/2487] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 02:39:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 02:39:42.100426 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54968fc0-2c3d-4df5-9ace-de1e22956a45 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:39:42.102044 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-54968fc0-2c3d-4df5-9ace-de1e22956a45 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:39:42.181785 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54968fc0-2c3d-4df5-9ace-de1e22956a45 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:39:42.185523 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ba4728-5aa0-42cc-ab98-d61cf83bc9e3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5223b5cab3114e9b9a13c582f8ef8386', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'beb6def6fcad45959e56425bb8bff4d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:39:42.186127 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ba4728-5aa0-42cc-ab98-d61cf83bc9e3 service neutron] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:39:42.186409 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ba4728-5aa0-42cc-ab98-d61cf83bc9e3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:39:42.186684 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ba4728-5aa0-42cc-ab98-d61cf83bc9e3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:39:42.195627 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ba4728-5aa0-42cc-ab98-d61cf83bc9e3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:39:42.197189 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ba4728-5aa0-42cc-ab98-d61cf83bc9e3 service neutron] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:39:42.207235 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1245/2488] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 02:39:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 02:39:42.467665 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3c62f6-9363-4604-8250-bcf67d3741ce None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:39:42.469613 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-dd3c62f6-9363-4604-8250-bcf67d3741ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:39:42.484128 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3c62f6-9363-4604-8250-bcf67d3741ce None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:39:42.489045 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f564860f-b54c-456e-a15d-60e6ab8018b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:39:42.489711 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f564860f-b54c-456e-a15d-60e6ab8018b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:39:42.489999 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f564860f-b54c-456e-a15d-60e6ab8018b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:39:42.490366 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f564860f-b54c-456e-a15d-60e6ab8018b8 admin admin] PATH_INFO: `/v3/projects/7894a77d7e83485890a6e31206ce82c1` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:39:42.491366 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f564860f-b54c-456e-a15d-60e6ab8018b8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7894a77d7e83485890a6e31206ce82c1)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:39:42.493374 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f564860f-b54c-456e-a15d-60e6ab8018b8 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:39:42.542672 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-f564860f-b54c-456e-a15d-60e6ab8018b8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7894a77d7e83485890a6e31206ce82c1', 'request_id': 'req-f564860f-b54c-456e-a15d-60e6ab8018b8'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:39:42.548397 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-f564860f-b54c-456e-a15d-60e6ab8018b8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7894a77d7e83485890a6e31206ce82c1', 'request_id': 'req-f564860f-b54c-456e-a15d-60e6ab8018b8'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:39:42.554653 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-f564860f-b54c-456e-a15d-60e6ab8018b8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7894a77d7e83485890a6e31206ce82c1', 'request_id': 'req-f564860f-b54c-456e-a15d-60e6ab8018b8'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:39:42.568113 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-f564860f-b54c-456e-a15d-60e6ab8018b8 admin admin] The token cache is being invalidate because project 7894a77d7e83485890a6e31206ce82c1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81361) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 02:39:42.568398 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-f564860f-b54c-456e-a15d-60e6ab8018b8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:39:42.569031 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-f564860f-b54c-456e-a15d-60e6ab8018b8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:39:42.570552 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1244/2489] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Oct 12 02:39:42 2022] DELETE /identity/v3/projects/7894a77d7e83485890a6e31206ce82c1 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 02:39:42.574745 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ba4728-5aa0-42cc-ab98-d61cf83bc9e3 service neutron] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:39:42.584125 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ba4728-5aa0-42cc-ab98-d61cf83bc9e3 service neutron] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:39:42.641351 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12188095-e1f2-448a-b450-f3e1c2354ef1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:39:42.641981 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12188095-e1f2-448a-b450-f3e1c2354ef1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:39:42.642261 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12188095-e1f2-448a-b450-f3e1c2354ef1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:39:42.642533 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12188095-e1f2-448a-b450-f3e1c2354ef1 admin admin] PATH_INFO: `/v3/users/a58629246de647469a9102703dd2bcb2` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:39:42.643637 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12188095-e1f2-448a-b450-f3e1c2354ef1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a58629246de647469a9102703dd2bcb2)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:39:42.645595 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12188095-e1f2-448a-b450-f3e1c2354ef1 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:39:42.647823 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:39:42.693499 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-12188095-e1f2-448a-b450-f3e1c2354ef1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a58629246de647469a9102703dd2bcb2'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:39:42.701718 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-12188095-e1f2-448a-b450-f3e1c2354ef1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a58629246de647469a9102703dd2bcb2'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:39:42.715140 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-12188095-e1f2-448a-b450-f3e1c2354ef1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a58629246de647469a9102703dd2bcb2'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:39:42.722338 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-12188095-e1f2-448a-b450-f3e1c2354ef1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a58629246de647469a9102703dd2bcb2'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:39:42.723026 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-12188095-e1f2-448a-b450-f3e1c2354ef1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a58629246de647469a9102703dd2bcb2'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:39:42.728977 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1246/2490] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Oct 12 02:39:42 2022] DELETE /identity/v3/users/a58629246de647469a9102703dd2bcb2 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 02:39:42.997898 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f564860f-b54c-456e-a15d-60e6ab8018b8 admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:39:43.000248 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-f564860f-b54c-456e-a15d-60e6ab8018b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:39:43.023729 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f564860f-b54c-456e-a15d-60e6ab8018b8 admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:39:43.061587 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:39:43.088094 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b4473c-ae7a-47e7-bfc6-3cffbd05b215 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:39:43.088759 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b4473c-ae7a-47e7-bfc6-3cffbd05b215 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:39:43.089039 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b4473c-ae7a-47e7-bfc6-3cffbd05b215 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:39:43.089315 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b4473c-ae7a-47e7-bfc6-3cffbd05b215 admin admin] PATH_INFO: `/v3/projects/94dbce42bb4b4b60a8f727d4919e92c5` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:39:43.090853 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b4473c-ae7a-47e7-bfc6-3cffbd05b215 admin admin] RBAC: Authorizing `identity:delete_project(project_id=94dbce42bb4b4b60a8f727d4919e92c5)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:39:43.092807 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b4473c-ae7a-47e7-bfc6-3cffbd05b215 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:39:43.139672 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-03b4473c-ae7a-47e7-bfc6-3cffbd05b215 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '94dbce42bb4b4b60a8f727d4919e92c5', 'request_id': 'req-03b4473c-ae7a-47e7-bfc6-3cffbd05b215'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:39:43.145153 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-03b4473c-ae7a-47e7-bfc6-3cffbd05b215 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '94dbce42bb4b4b60a8f727d4919e92c5', 'request_id': 'req-03b4473c-ae7a-47e7-bfc6-3cffbd05b215'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:39:43.151205 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-03b4473c-ae7a-47e7-bfc6-3cffbd05b215 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '94dbce42bb4b4b60a8f727d4919e92c5', 'request_id': 'req-03b4473c-ae7a-47e7-bfc6-3cffbd05b215'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:39:43.163581 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-03b4473c-ae7a-47e7-bfc6-3cffbd05b215 admin admin] The token cache is being invalidate because project 94dbce42bb4b4b60a8f727d4919e92c5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81361) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 02:39:43.163868 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-03b4473c-ae7a-47e7-bfc6-3cffbd05b215 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:39:43.164512 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-03b4473c-ae7a-47e7-bfc6-3cffbd05b215 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:39:43.165999 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1245/2491] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Oct 12 02:39:42 2022] DELETE /identity/v3/projects/94dbce42bb4b4b60a8f727d4919e92c5 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 02:39:43.171388 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488f3b99-b911-446a-82aa-3be8078115c3 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:39:43.171863 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488f3b99-b911-446a-82aa-3be8078115c3 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:39:43.171863 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488f3b99-b911-446a-82aa-3be8078115c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:39:43.192408 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-488f3b99-b911-446a-82aa-3be8078115c3 None None] MFA Rules not processed for user `a326a5bb7364479382f528a592371656`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:39:43.193643 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-488f3b99-b911-446a-82aa-3be8078115c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:39:43.252655 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1247/2492] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 02:39:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 02:39:43.260355 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7440525a-2c76-48ca-bdde-90efaa0b30f3 None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:39:43.260665 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7440525a-2c76-48ca-bdde-90efaa0b30f3 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:39:43.260940 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7440525a-2c76-48ca-bdde-90efaa0b30f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:39:43.281348 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-7440525a-2c76-48ca-bdde-90efaa0b30f3 None None] MFA Rules not processed for user `a326a5bb7364479382f528a592371656`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:39:43.282586 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-7440525a-2c76-48ca-bdde-90efaa0b30f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:39:43.290743 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1246/2493] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 02:39:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 02:39:43.295105 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488f3b99-b911-446a-82aa-3be8078115c3 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:39:43.304644 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488f3b99-b911-446a-82aa-3be8078115c3 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:39:43.309668 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80899485-56e2-41f2-99e4-93448b111f33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:39:43.310259 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80899485-56e2-41f2-99e4-93448b111f33 admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:39:43.310533 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80899485-56e2-41f2-99e4-93448b111f33 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:39:43.310801 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80899485-56e2-41f2-99e4-93448b111f33 admin admin] PATH_INFO: `/v3/domains` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:39:43.311438 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80899485-56e2-41f2-99e4-93448b111f33 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 02:39:43.311732 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80899485-56e2-41f2-99e4-93448b111f33 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:39:43.313338 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80899485-56e2-41f2-99e4-93448b111f33 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:39:43.325441 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1248/2494] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Oct 12 02:39:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 02:39:43.329633 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7440525a-2c76-48ca-bdde-90efaa0b30f3 None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:39:43.338745 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7440525a-2c76-48ca-bdde-90efaa0b30f3 None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:39:43.343396 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdc1a31-c374-4d71-aa3a-574283cdccd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:39:43.343983 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdc1a31-c374-4d71-aa3a-574283cdccd8 admin admin] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:39:43.344259 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdc1a31-c374-4d71-aa3a-574283cdccd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:39:43.344560 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdc1a31-c374-4d71-aa3a-574283cdccd8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:39:43.345181 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fdc1a31-c374-4d71-aa3a-574283cdccd8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:39:43.347390 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fdc1a31-c374-4d71-aa3a-574283cdccd8 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:39:43.374970 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1247/2495] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Oct 12 02:39:43 2022] POST /identity/v3/projects => generated 385 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 02:39:43.379061 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80899485-56e2-41f2-99e4-93448b111f33 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:39:43.389049 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80899485-56e2-41f2-99e4-93448b111f33 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:39:43.444749 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f3bfa7-6546-4a49-8287-834d841467a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:39:43.445270 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f3bfa7-6546-4a49-8287-834d841467a2 admin admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:39:43.445544 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f3bfa7-6546-4a49-8287-834d841467a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:39:43.445811 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f3bfa7-6546-4a49-8287-834d841467a2 admin admin] PATH_INFO: `/v3/users` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:39:43.446421 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f3bfa7-6546-4a49-8287-834d841467a2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:39:43.448307 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f3bfa7-6546-4a49-8287-834d841467a2 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:39:43.464554 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:39:43.472092 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1249/2496] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Oct 12 02:39:43 2022] POST /identity/v3/users => generated 293 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 02:39:43.476282 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdc1a31-c374-4d71-aa3a-574283cdccd8 admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:39:43.487449 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdc1a31-c374-4d71-aa3a-574283cdccd8 admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:39:43.491960 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e464b0-a067-4b3c-b1d2-97ab45d29741 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:39:43.492574 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e464b0-a067-4b3c-b1d2-97ab45d29741 admin admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:39:43.492852 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e464b0-a067-4b3c-b1d2-97ab45d29741 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:39:43.493119 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e464b0-a067-4b3c-b1d2-97ab45d29741 admin admin] PATH_INFO: `/v3/roles` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:39:43.493753 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e464b0-a067-4b3c-b1d2-97ab45d29741 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:39:43.495334 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e464b0-a067-4b3c-b1d2-97ab45d29741 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:39:43.505638 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1248/2497] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Oct 12 02:39:43 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 02:39:43.509611 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f3bfa7-6546-4a49-8287-834d841467a2 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:39:43.519440 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f3bfa7-6546-4a49-8287-834d841467a2 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:39:43.524152 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd481e7-5465-43de-9927-d21a8d6a6836 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:39:43.524787 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd481e7-5465-43de-9927-d21a8d6a6836 admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:39:43.525069 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd481e7-5465-43de-9927-d21a8d6a6836 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:39:43.525346 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd481e7-5465-43de-9927-d21a8d6a6836 admin admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:39:43.525984 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd481e7-5465-43de-9927-d21a8d6a6836 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:39:43.527813 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd481e7-5465-43de-9927-d21a8d6a6836 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:39:43.538645 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1250/2498] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Oct 12 02:39:43 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 02:39:43.543443 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e464b0-a067-4b3c-b1d2-97ab45d29741 admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:39:43.553362 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e464b0-a067-4b3c-b1d2-97ab45d29741 admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:39:43.557914 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d1c4f5-e746-4986-a796-6eaa040181c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:39:43.559303 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d1c4f5-e746-4986-a796-6eaa040181c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:39:43.559576 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d1c4f5-e746-4986-a796-6eaa040181c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:39:43.559843 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d1c4f5-e746-4986-a796-6eaa040181c4 admin admin] PATH_INFO: `/v3/projects/dd577ee880134db4831e57cb23cfe720/users/fb1d43e325964874a5ab0a5b3ede2a4f/roles/3d75c4d7f1a849b9a771504d1583ab28` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:39:43.573960 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d1c4f5-e746-4986-a796-6eaa040181c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dd577ee880134db4831e57cb23cfe720, user_id=fb1d43e325964874a5ab0a5b3ede2a4f, role_id=3d75c4d7f1a849b9a771504d1583ab28)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:39:43.576634 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d1c4f5-e746-4986-a796-6eaa040181c4 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:39:43.588930 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1249/2499] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Oct 12 02:39:43 2022] PUT /identity/v3/projects/dd577ee880134db4831e57cb23cfe720/users/fb1d43e325964874a5ab0a5b3ede2a4f/roles/3d75c4d7f1a849b9a771504d1583ab28 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 02:39:43.599392 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa8c5a7-fdb2-462d-8d7e-9fab5d312578 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:39:43.599680 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa8c5a7-fdb2-462d-8d7e-9fab5d312578 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:39:43.599956 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa8c5a7-fdb2-462d-8d7e-9fab5d312578 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:39:43.628062 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-4aa8c5a7-fdb2-462d-8d7e-9fab5d312578 None None] MFA Rules not processed for user `fb1d43e325964874a5ab0a5b3ede2a4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:39:43.629312 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-4aa8c5a7-fdb2-462d-8d7e-9fab5d312578 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:39:43.692201 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1251/2500] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 02:39:43 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 02:39:43.703926 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d1c4f5-e746-4986-a796-6eaa040181c4 admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:39:43.705661 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-a0d1c4f5-e746-4986-a796-6eaa040181c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:39:43.762545 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d1c4f5-e746-4986-a796-6eaa040181c4 admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:39:43.766131 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a61c17-94d4-40d4-990c-58fb6d42355f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ba688e0c4d44d13898539ee886f95fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'beb6def6fcad45959e56425bb8bff4d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:39:43.766754 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a61c17-94d4-40d4-990c-58fb6d42355f service cinder] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:39:43.767028 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a61c17-94d4-40d4-990c-58fb6d42355f service cinder] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:39:43.767297 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a61c17-94d4-40d4-990c-58fb6d42355f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:39:43.775351 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a61c17-94d4-40d4-990c-58fb6d42355f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:39:43.777593 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a61c17-94d4-40d4-990c-58fb6d42355f service cinder] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:39:43.786089 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1250/2501] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 02:39:43 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 02:39:46.331396 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa8c5a7-fdb2-462d-8d7e-9fab5d312578 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:39:46.392494 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa8c5a7-fdb2-462d-8d7e-9fab5d312578 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:39:46.396928 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703d2509-a464-4e62-a07e-483f4f46b5e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:39:46.397541 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703d2509-a464-4e62-a07e-483f4f46b5e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:39:46.397822 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703d2509-a464-4e62-a07e-483f4f46b5e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:39:46.398087 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703d2509-a464-4e62-a07e-483f4f46b5e2 admin admin] PATH_INFO: `/v3/users/fb1d43e325964874a5ab0a5b3ede2a4f` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:39:46.399177 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703d2509-a464-4e62-a07e-483f4f46b5e2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fb1d43e325964874a5ab0a5b3ede2a4f)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:39:46.401099 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703d2509-a464-4e62-a07e-483f4f46b5e2 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:39:46.446052 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-703d2509-a464-4e62-a07e-483f4f46b5e2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fb1d43e325964874a5ab0a5b3ede2a4f'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:39:46.452944 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-703d2509-a464-4e62-a07e-483f4f46b5e2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fb1d43e325964874a5ab0a5b3ede2a4f'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:39:46.464982 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-703d2509-a464-4e62-a07e-483f4f46b5e2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fb1d43e325964874a5ab0a5b3ede2a4f'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:39:46.470427 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:39:46.472577 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-703d2509-a464-4e62-a07e-483f4f46b5e2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fb1d43e325964874a5ab0a5b3ede2a4f'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:39:46.473478 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-703d2509-a464-4e62-a07e-483f4f46b5e2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fb1d43e325964874a5ab0a5b3ede2a4f'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:39:46.481367 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1252/2502] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Oct 12 02:39:46 2022] DELETE /identity/v3/users/fb1d43e325964874a5ab0a5b3ede2a4f => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 02:39:46.485739 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ef9b4e-8e33-4d99-9339-80f411df9479 None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:39:46.486228 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ef9b4e-8e33-4d99-9339-80f411df9479 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:39:46.486350 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ef9b4e-8e33-4d99-9339-80f411df9479 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:39:46.494049 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:39:46.506517 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-69ef9b4e-8e33-4d99-9339-80f411df9479 None None] MFA Rules not processed for user `a326a5bb7364479382f528a592371656`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:39:46.507704 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-69ef9b4e-8e33-4d99-9339-80f411df9479 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:39:46.567292 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1251/2503] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 02:39:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 02:39:46.577101 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703d2509-a464-4e62-a07e-483f4f46b5e2 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:39:46.578523 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-703d2509-a464-4e62-a07e-483f4f46b5e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:39:46.635241 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703d2509-a464-4e62-a07e-483f4f46b5e2 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:39:46.639345 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77da0d0-9dc4-4aaa-acee-83001160c412 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5223b5cab3114e9b9a13c582f8ef8386', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'beb6def6fcad45959e56425bb8bff4d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:39:46.639946 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77da0d0-9dc4-4aaa-acee-83001160c412 service neutron] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:39:46.640223 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77da0d0-9dc4-4aaa-acee-83001160c412 service neutron] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:39:46.640518 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77da0d0-9dc4-4aaa-acee-83001160c412 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:39:46.649430 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77da0d0-9dc4-4aaa-acee-83001160c412 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:39:46.650835 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77da0d0-9dc4-4aaa-acee-83001160c412 service neutron] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:39:46.660136 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1253/2504] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 02:39:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 02:39:46.933770 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ef9b4e-8e33-4d99-9339-80f411df9479 None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:39:46.935343 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-69ef9b4e-8e33-4d99-9339-80f411df9479 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:39:46.947544 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ef9b4e-8e33-4d99-9339-80f411df9479 None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:39:46.952184 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b33accf-26c4-40d0-8038-41a65b0d5f31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:39:46.952857 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b33accf-26c4-40d0-8038-41a65b0d5f31 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:39:46.953155 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b33accf-26c4-40d0-8038-41a65b0d5f31 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:39:46.953451 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b33accf-26c4-40d0-8038-41a65b0d5f31 admin admin] PATH_INFO: `/v3/projects/dd577ee880134db4831e57cb23cfe720` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:39:46.954566 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b33accf-26c4-40d0-8038-41a65b0d5f31 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dd577ee880134db4831e57cb23cfe720)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:39:46.956498 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b33accf-26c4-40d0-8038-41a65b0d5f31 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:39:47.004685 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-1b33accf-26c4-40d0-8038-41a65b0d5f31 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dd577ee880134db4831e57cb23cfe720', 'request_id': 'req-1b33accf-26c4-40d0-8038-41a65b0d5f31'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:39:47.010132 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-1b33accf-26c4-40d0-8038-41a65b0d5f31 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dd577ee880134db4831e57cb23cfe720', 'request_id': 'req-1b33accf-26c4-40d0-8038-41a65b0d5f31'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:39:47.016403 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-1b33accf-26c4-40d0-8038-41a65b0d5f31 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dd577ee880134db4831e57cb23cfe720', 'request_id': 'req-1b33accf-26c4-40d0-8038-41a65b0d5f31'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:39:47.029057 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-1b33accf-26c4-40d0-8038-41a65b0d5f31 admin admin] The token cache is being invalidate because project dd577ee880134db4831e57cb23cfe720 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81361) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 02:39:47.029341 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-1b33accf-26c4-40d0-8038-41a65b0d5f31 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:39:47.029942 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-1b33accf-26c4-40d0-8038-41a65b0d5f31 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:39:47.031412 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1252/2505] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Oct 12 02:39:46 2022] DELETE /identity/v3/projects/dd577ee880134db4831e57cb23cfe720 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 02:39:47.036444 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da7626a-ae47-4a0e-bb32-16c9e3c941c4 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:39:47.036765 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da7626a-ae47-4a0e-bb32-16c9e3c941c4 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:39:47.037035 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da7626a-ae47-4a0e-bb32-16c9e3c941c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:39:47.056626 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-4da7626a-ae47-4a0e-bb32-16c9e3c941c4 None None] MFA Rules not processed for user `a326a5bb7364479382f528a592371656`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:39:47.057809 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-4da7626a-ae47-4a0e-bb32-16c9e3c941c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:39:47.116886 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1254/2506] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 02:39:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 02:39:47.125680 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c688517a-c68c-4771-aab6-6d62411f182e None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:39:47.125986 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c688517a-c68c-4771-aab6-6d62411f182e None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:39:47.126257 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c688517a-c68c-4771-aab6-6d62411f182e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:39:47.146256 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-c688517a-c68c-4771-aab6-6d62411f182e None None] MFA Rules not processed for user `a326a5bb7364479382f528a592371656`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:39:47.147460 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-c688517a-c68c-4771-aab6-6d62411f182e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:39:47.156332 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1253/2507] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 02:39:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 02:39:47.160439 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da7626a-ae47-4a0e-bb32-16c9e3c941c4 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:39:47.170688 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da7626a-ae47-4a0e-bb32-16c9e3c941c4 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:39:47.175204 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cc370f-72fd-4b9b-9293-8b4365633167 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:39:47.175800 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cc370f-72fd-4b9b-9293-8b4365633167 admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:39:47.176096 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cc370f-72fd-4b9b-9293-8b4365633167 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:39:47.176349 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cc370f-72fd-4b9b-9293-8b4365633167 admin admin] PATH_INFO: `/v3/domains` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:39:47.177057 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48cc370f-72fd-4b9b-9293-8b4365633167 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 02:39:47.177358 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48cc370f-72fd-4b9b-9293-8b4365633167 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:39:47.178946 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48cc370f-72fd-4b9b-9293-8b4365633167 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:39:47.190645 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1255/2508] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Oct 12 02:39:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 02:39:47.194744 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c688517a-c68c-4771-aab6-6d62411f182e None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:39:47.204377 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c688517a-c68c-4771-aab6-6d62411f182e None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:39:47.209226 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bda7af-accf-4e36-889a-10a7b164a644 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:39:47.209823 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bda7af-accf-4e36-889a-10a7b164a644 admin admin] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:39:47.210126 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bda7af-accf-4e36-889a-10a7b164a644 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:39:47.210403 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bda7af-accf-4e36-889a-10a7b164a644 admin admin] PATH_INFO: `/v3/projects` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:39:47.211054 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2bda7af-accf-4e36-889a-10a7b164a644 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:39:47.212996 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2bda7af-accf-4e36-889a-10a7b164a644 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:39:47.240260 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1254/2509] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Oct 12 02:39:47 2022] POST /identity/v3/projects => generated 369 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 02:39:47.244350 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cc370f-72fd-4b9b-9293-8b4365633167 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:39:47.254382 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cc370f-72fd-4b9b-9293-8b4365633167 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:39:47.310145 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249baf3a-77d5-4ece-8249-99d532000ca1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:39:47.310740 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249baf3a-77d5-4ece-8249-99d532000ca1 admin admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:39:47.311016 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249baf3a-77d5-4ece-8249-99d532000ca1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:39:47.311287 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249baf3a-77d5-4ece-8249-99d532000ca1 admin admin] PATH_INFO: `/v3/users` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:39:47.311914 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249baf3a-77d5-4ece-8249-99d532000ca1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:39:47.313834 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249baf3a-77d5-4ece-8249-99d532000ca1 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:39:47.334187 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1256/2510] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Oct 12 02:39:47 2022] POST /identity/v3/users => generated 285 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 02:39:47.338258 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bda7af-accf-4e36-889a-10a7b164a644 admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:39:47.349529 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bda7af-accf-4e36-889a-10a7b164a644 admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:39:47.354087 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1bb52b-7a41-4da1-b5c3-39c783f32a1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:39:47.354678 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1bb52b-7a41-4da1-b5c3-39c783f32a1d admin admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:39:47.355247 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1bb52b-7a41-4da1-b5c3-39c783f32a1d admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:39:47.355390 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1bb52b-7a41-4da1-b5c3-39c783f32a1d admin admin] PATH_INFO: `/v3/roles` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:39:47.355912 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1bb52b-7a41-4da1-b5c3-39c783f32a1d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:39:47.357543 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1bb52b-7a41-4da1-b5c3-39c783f32a1d admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:39:47.367456 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1255/2511] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Oct 12 02:39:47 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 02:39:47.371372 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249baf3a-77d5-4ece-8249-99d532000ca1 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:39:47.381141 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249baf3a-77d5-4ece-8249-99d532000ca1 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:39:47.385702 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be95c2fe-46d3-4c90-914d-ebe199176517 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:39:47.387023 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be95c2fe-46d3-4c90-914d-ebe199176517 admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:39:47.387023 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be95c2fe-46d3-4c90-914d-ebe199176517 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:39:47.387310 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be95c2fe-46d3-4c90-914d-ebe199176517 admin admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:39:47.387938 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be95c2fe-46d3-4c90-914d-ebe199176517 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:39:47.389560 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be95c2fe-46d3-4c90-914d-ebe199176517 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:39:47.399857 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1257/2512] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Oct 12 02:39:47 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 12 02:39:47.404376 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1bb52b-7a41-4da1-b5c3-39c783f32a1d admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:39:47.414525 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1bb52b-7a41-4da1-b5c3-39c783f32a1d admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:39:47.419223 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f9abd1-d6c1-450e-a433-0ab3a6d96627 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:39:47.419883 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f9abd1-d6c1-450e-a433-0ab3a6d96627 admin admin] REQUEST_METHOD: `PUT` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:39:47.420185 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f9abd1-d6c1-450e-a433-0ab3a6d96627 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:39:47.420458 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f9abd1-d6c1-450e-a433-0ab3a6d96627 admin admin] PATH_INFO: `/v3/projects/caf0275ead7e4233a5351df8a8ad0135/users/e6a6ffe3b3d4460b95aff624ee4e395d/roles/3d75c4d7f1a849b9a771504d1583ab28` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:39:47.435901 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f9abd1-d6c1-450e-a433-0ab3a6d96627 admin admin] RBAC: Authorizing `identity:create_grant(project_id=caf0275ead7e4233a5351df8a8ad0135, user_id=e6a6ffe3b3d4460b95aff624ee4e395d, role_id=3d75c4d7f1a849b9a771504d1583ab28)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:39:47.438560 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f9abd1-d6c1-450e-a433-0ab3a6d96627 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:39:47.451519 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1256/2513] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Oct 12 02:39:47 2022] PUT /identity/v3/projects/caf0275ead7e4233a5351df8a8ad0135/users/e6a6ffe3b3d4460b95aff624ee4e395d/roles/3d75c4d7f1a849b9a771504d1583ab28 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 02:39:47.461619 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08604037-97f8-4ac5-9a51-7d75c25f1247 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:39:47.461906 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08604037-97f8-4ac5-9a51-7d75c25f1247 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:39:47.462208 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08604037-97f8-4ac5-9a51-7d75c25f1247 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:39:47.471551 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:39:47.492394 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-08604037-97f8-4ac5-9a51-7d75c25f1247 None None] MFA Rules not processed for user `e6a6ffe3b3d4460b95aff624ee4e395d`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:39:47.493659 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-08604037-97f8-4ac5-9a51-7d75c25f1247 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:39:47.561563 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1258/2514] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 02:39:47 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 02:39:47.573429 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f9abd1-d6c1-450e-a433-0ab3a6d96627 admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:39:47.575653 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-85f9abd1-d6c1-450e-a433-0ab3a6d96627 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:39:47.602447 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:39:47.633360 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f9abd1-d6c1-450e-a433-0ab3a6d96627 admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:39:47.637653 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd03e402-bf13-497f-8f0d-b6e8dcc1fb18 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8285a132afeb47558e1b3dcedfd7b4e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'beb6def6fcad45959e56425bb8bff4d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:39:47.638252 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd03e402-bf13-497f-8f0d-b6e8dcc1fb18 service glance] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:39:47.638533 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd03e402-bf13-497f-8f0d-b6e8dcc1fb18 service glance] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:39:47.638805 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd03e402-bf13-497f-8f0d-b6e8dcc1fb18 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:39:47.647036 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd03e402-bf13-497f-8f0d-b6e8dcc1fb18 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:39:47.648526 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd03e402-bf13-497f-8f0d-b6e8dcc1fb18 service glance] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:39:47.657356 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1257/2515] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 02:39:47 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 02:39:57.557737 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=30 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:39:57.653866 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=15 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:40:09.176232 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08604037-97f8-4ac5-9a51-7d75c25f1247 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:40:09.240019 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08604037-97f8-4ac5-9a51-7d75c25f1247 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:40:09.244558 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63acfc3-2ac4-4321-bbc0-d9fa1269d4b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:40:09.245182 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63acfc3-2ac4-4321-bbc0-d9fa1269d4b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:40:09.245458 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63acfc3-2ac4-4321-bbc0-d9fa1269d4b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:40:09.245727 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63acfc3-2ac4-4321-bbc0-d9fa1269d4b1 admin admin] PATH_INFO: `/v3/users/e6a6ffe3b3d4460b95aff624ee4e395d` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:40:09.246831 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63acfc3-2ac4-4321-bbc0-d9fa1269d4b1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e6a6ffe3b3d4460b95aff624ee4e395d)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:40:09.248917 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63acfc3-2ac4-4321-bbc0-d9fa1269d4b1 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:40:09.294051 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-a63acfc3-2ac4-4321-bbc0-d9fa1269d4b1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e6a6ffe3b3d4460b95aff624ee4e395d'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:40:09.301946 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-a63acfc3-2ac4-4321-bbc0-d9fa1269d4b1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e6a6ffe3b3d4460b95aff624ee4e395d'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:40:09.313649 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-a63acfc3-2ac4-4321-bbc0-d9fa1269d4b1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e6a6ffe3b3d4460b95aff624ee4e395d'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:40:09.320319 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-a63acfc3-2ac4-4321-bbc0-d9fa1269d4b1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e6a6ffe3b3d4460b95aff624ee4e395d'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:40:09.320980 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-a63acfc3-2ac4-4321-bbc0-d9fa1269d4b1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e6a6ffe3b3d4460b95aff624ee4e395d'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:40:09.326877 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1259/2516] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Oct 12 02:40:09 2022] DELETE /identity/v3/users/e6a6ffe3b3d4460b95aff624ee4e395d => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 02:40:09.331305 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2001f9-c2ab-429d-97d6-e5f24dc15fef None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:40:09.331802 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2001f9-c2ab-429d-97d6-e5f24dc15fef None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:40:09.331910 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2001f9-c2ab-429d-97d6-e5f24dc15fef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:40:09.351176 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-8d2001f9-c2ab-429d-97d6-e5f24dc15fef None None] MFA Rules not processed for user `a326a5bb7364479382f528a592371656`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:40:09.352358 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-8d2001f9-c2ab-429d-97d6-e5f24dc15fef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:40:09.409709 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1258/2517] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 02:40:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 02:40:09.419483 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63acfc3-2ac4-4321-bbc0-d9fa1269d4b1 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:40:09.422065 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-a63acfc3-2ac4-4321-bbc0-d9fa1269d4b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:40:09.479140 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63acfc3-2ac4-4321-bbc0-d9fa1269d4b1 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:40:09.483437 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9a7b9e-2016-44f0-b400-b892d31db6ac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5223b5cab3114e9b9a13c582f8ef8386', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'beb6def6fcad45959e56425bb8bff4d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:40:09.484346 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9a7b9e-2016-44f0-b400-b892d31db6ac service neutron] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:40:09.484664 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9a7b9e-2016-44f0-b400-b892d31db6ac service neutron] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:40:09.484981 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9a7b9e-2016-44f0-b400-b892d31db6ac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:40:09.493874 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9a7b9e-2016-44f0-b400-b892d31db6ac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:40:09.495292 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9a7b9e-2016-44f0-b400-b892d31db6ac service neutron] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:40:09.505064 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1260/2518] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 02:40:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 02:40:09.766396 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2001f9-c2ab-429d-97d6-e5f24dc15fef None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:40:09.767885 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-8d2001f9-c2ab-429d-97d6-e5f24dc15fef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:40:09.780803 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2001f9-c2ab-429d-97d6-e5f24dc15fef None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:40:09.789904 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c2aa9f-ec5a-4feb-8d67-ce1f73cc3bda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:40:09.790466 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c2aa9f-ec5a-4feb-8d67-ce1f73cc3bda admin admin] REQUEST_METHOD: `DELETE` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:40:09.790664 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c2aa9f-ec5a-4feb-8d67-ce1f73cc3bda admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:40:09.791011 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c2aa9f-ec5a-4feb-8d67-ce1f73cc3bda admin admin] PATH_INFO: `/v3/projects/caf0275ead7e4233a5351df8a8ad0135` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:40:09.792039 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c2aa9f-ec5a-4feb-8d67-ce1f73cc3bda admin admin] RBAC: Authorizing `identity:delete_project(project_id=caf0275ead7e4233a5351df8a8ad0135)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:40:09.793983 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c2aa9f-ec5a-4feb-8d67-ce1f73cc3bda admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:40:09.841140 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-05c2aa9f-ec5a-4feb-8d67-ce1f73cc3bda admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'caf0275ead7e4233a5351df8a8ad0135', 'request_id': 'req-05c2aa9f-ec5a-4feb-8d67-ce1f73cc3bda'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:40:09.847668 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-05c2aa9f-ec5a-4feb-8d67-ce1f73cc3bda admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'caf0275ead7e4233a5351df8a8ad0135', 'request_id': 'req-05c2aa9f-ec5a-4feb-8d67-ce1f73cc3bda'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:40:09.853956 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-05c2aa9f-ec5a-4feb-8d67-ce1f73cc3bda admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'caf0275ead7e4233a5351df8a8ad0135', 'request_id': 'req-05c2aa9f-ec5a-4feb-8d67-ce1f73cc3bda'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:40:09.867282 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-05c2aa9f-ec5a-4feb-8d67-ce1f73cc3bda admin admin] The token cache is being invalidate because project caf0275ead7e4233a5351df8a8ad0135 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81361) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 02:40:09.867590 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-05c2aa9f-ec5a-4feb-8d67-ce1f73cc3bda admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:40:09.868204 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-05c2aa9f-ec5a-4feb-8d67-ce1f73cc3bda admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:40:09.869685 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1259/2519] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Oct 12 02:40:09 2022] DELETE /identity/v3/projects/caf0275ead7e4233a5351df8a8ad0135 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 02:40:09.874916 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e45120-d140-47d0-8bf9-e8a2a085d3ab None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:40:09.875195 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e45120-d140-47d0-8bf9-e8a2a085d3ab None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:40:09.875471 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e45120-d140-47d0-8bf9-e8a2a085d3ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:40:09.895385 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-c9e45120-d140-47d0-8bf9-e8a2a085d3ab None None] MFA Rules not processed for user `a326a5bb7364479382f528a592371656`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:40:09.896594 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-c9e45120-d140-47d0-8bf9-e8a2a085d3ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:40:09.913571 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:40:09.957570 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1261/2520] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 02:40:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 02:40:09.965368 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e25bf6-faac-44ab-9996-9021bedf2e05 None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:40:09.965656 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e25bf6-faac-44ab-9996-9021bedf2e05 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:40:09.965934 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e25bf6-faac-44ab-9996-9021bedf2e05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:40:09.985620 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-48e25bf6-faac-44ab-9996-9021bedf2e05 None None] MFA Rules not processed for user `a326a5bb7364479382f528a592371656`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:40:09.986821 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-48e25bf6-faac-44ab-9996-9021bedf2e05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:40:09.995655 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1260/2521] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 02:40:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 02:40:10.000621 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e45120-d140-47d0-8bf9-e8a2a085d3ab None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:40:10.010353 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e45120-d140-47d0-8bf9-e8a2a085d3ab None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:40:10.015591 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5424503-3f1e-4380-bd83-c2206cd31059 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:40:10.016180 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5424503-3f1e-4380-bd83-c2206cd31059 admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:40:10.016458 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5424503-3f1e-4380-bd83-c2206cd31059 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:40:10.016756 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5424503-3f1e-4380-bd83-c2206cd31059 admin admin] PATH_INFO: `/v3/domains` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:40:10.017394 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5424503-3f1e-4380-bd83-c2206cd31059 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 02:40:10.017695 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5424503-3f1e-4380-bd83-c2206cd31059 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:40:10.019264 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5424503-3f1e-4380-bd83-c2206cd31059 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:40:10.030866 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1262/2522] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Oct 12 02:40:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 02:40:10.034817 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e25bf6-faac-44ab-9996-9021bedf2e05 None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:40:10.044191 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e25bf6-faac-44ab-9996-9021bedf2e05 None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:40:10.049140 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144e8e77-6a00-425f-a307-7dbfe0d7ae00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:40:10.049734 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144e8e77-6a00-425f-a307-7dbfe0d7ae00 admin admin] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:40:10.050012 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144e8e77-6a00-425f-a307-7dbfe0d7ae00 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:40:10.050284 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144e8e77-6a00-425f-a307-7dbfe0d7ae00 admin admin] PATH_INFO: `/v3/projects` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:40:10.050907 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144e8e77-6a00-425f-a307-7dbfe0d7ae00 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:40:10.052850 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144e8e77-6a00-425f-a307-7dbfe0d7ae00 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:40:10.080394 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1261/2523] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Oct 12 02:40:10 2022] POST /identity/v3/projects => generated 373 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 02:40:10.084509 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5424503-3f1e-4380-bd83-c2206cd31059 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:40:10.094722 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5424503-3f1e-4380-bd83-c2206cd31059 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:40:10.150850 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a09ea2-61c8-42f3-a6b3-4a99c379c0cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:40:10.151449 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a09ea2-61c8-42f3-a6b3-4a99c379c0cc admin admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:40:10.151727 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a09ea2-61c8-42f3-a6b3-4a99c379c0cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:40:10.151998 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a09ea2-61c8-42f3-a6b3-4a99c379c0cc admin admin] PATH_INFO: `/v3/users` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:40:10.152671 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a09ea2-61c8-42f3-a6b3-4a99c379c0cc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:40:10.154614 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a09ea2-61c8-42f3-a6b3-4a99c379c0cc admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:40:10.175110 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1263/2524] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Oct 12 02:40:10 2022] POST /identity/v3/users => generated 287 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 02:40:10.179169 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144e8e77-6a00-425f-a307-7dbfe0d7ae00 admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:40:10.190154 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144e8e77-6a00-425f-a307-7dbfe0d7ae00 admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:40:10.194778 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff689eb-06c5-42e0-a13c-ee8ae414d055 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:40:10.195364 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff689eb-06c5-42e0-a13c-ee8ae414d055 admin admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:40:10.195644 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff689eb-06c5-42e0-a13c-ee8ae414d055 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:40:10.195914 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff689eb-06c5-42e0-a13c-ee8ae414d055 admin admin] PATH_INFO: `/v3/roles` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:40:10.196636 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff689eb-06c5-42e0-a13c-ee8ae414d055 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:40:10.198294 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff689eb-06c5-42e0-a13c-ee8ae414d055 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:40:10.209027 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1262/2525] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Oct 12 02:40:10 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 12 02:40:10.212863 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a09ea2-61c8-42f3-a6b3-4a99c379c0cc admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:40:10.223116 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a09ea2-61c8-42f3-a6b3-4a99c379c0cc admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:40:10.227619 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc9956c-c60d-4b65-a90d-2fdefbaee7ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:40:10.228214 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc9956c-c60d-4b65-a90d-2fdefbaee7ef admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:40:10.228522 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc9956c-c60d-4b65-a90d-2fdefbaee7ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:40:10.228797 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc9956c-c60d-4b65-a90d-2fdefbaee7ef admin admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:40:10.229430 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc9956c-c60d-4b65-a90d-2fdefbaee7ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:40:10.231020 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc9956c-c60d-4b65-a90d-2fdefbaee7ef admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:40:10.241558 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1264/2526] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Oct 12 02:40:10 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 02:40:10.245640 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff689eb-06c5-42e0-a13c-ee8ae414d055 admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:40:10.256119 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff689eb-06c5-42e0-a13c-ee8ae414d055 admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:40:10.260692 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1f40b6-1258-4439-b29d-68c3e49a78b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:40:10.261386 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1f40b6-1258-4439-b29d-68c3e49a78b5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:40:10.261697 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1f40b6-1258-4439-b29d-68c3e49a78b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:40:10.261945 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1f40b6-1258-4439-b29d-68c3e49a78b5 admin admin] PATH_INFO: `/v3/projects/4d2077cfbf1f4b20920cb2a038758fb4/users/7d677e7f53e9459f918735bc660fc6a2/roles/3d75c4d7f1a849b9a771504d1583ab28` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:40:10.278209 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1f40b6-1258-4439-b29d-68c3e49a78b5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4d2077cfbf1f4b20920cb2a038758fb4, user_id=7d677e7f53e9459f918735bc660fc6a2, role_id=3d75c4d7f1a849b9a771504d1583ab28)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:40:10.280924 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1f40b6-1258-4439-b29d-68c3e49a78b5 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:40:10.293294 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1263/2527] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Oct 12 02:40:10 2022] PUT /identity/v3/projects/4d2077cfbf1f4b20920cb2a038758fb4/users/7d677e7f53e9459f918735bc660fc6a2/roles/3d75c4d7f1a849b9a771504d1583ab28 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 02:40:10.357154 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de2267a-8433-4300-b650-bb9d849d3337 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:40:10.359105 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de2267a-8433-4300-b650-bb9d849d3337 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:40:10.359105 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de2267a-8433-4300-b650-bb9d849d3337 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:40:10.387227 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-7de2267a-8433-4300-b650-bb9d849d3337 None None] MFA Rules not processed for user `7d677e7f53e9459f918735bc660fc6a2`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:40:10.388430 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-7de2267a-8433-4300-b650-bb9d849d3337 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:40:10.452883 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1265/2528] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 02:40:10 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 02:40:10.463379 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1f40b6-1258-4439-b29d-68c3e49a78b5 admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:40:10.465000 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-bc1f40b6-1258-4439-b29d-68c3e49a78b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:40:10.487306 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:40:10.524535 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1f40b6-1258-4439-b29d-68c3e49a78b5 admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:40:10.528128 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020a1cf5-531e-4657-b011-7a06e2a33a1a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ba688e0c4d44d13898539ee886f95fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'beb6def6fcad45959e56425bb8bff4d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:40:10.528772 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020a1cf5-531e-4657-b011-7a06e2a33a1a service cinder] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:40:10.529046 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020a1cf5-531e-4657-b011-7a06e2a33a1a service cinder] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:40:10.529341 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020a1cf5-531e-4657-b011-7a06e2a33a1a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:40:10.538098 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020a1cf5-531e-4657-b011-7a06e2a33a1a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:40:10.539530 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020a1cf5-531e-4657-b011-7a06e2a33a1a service cinder] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:40:10.548912 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1264/2529] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 02:40:10 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 02:40:11.905225 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f13850-e243-4e13-bbcf-ba8193870e0b None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:40:11.905723 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f13850-e243-4e13-bbcf-ba8193870e0b None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:40:11.905830 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f13850-e243-4e13-bbcf-ba8193870e0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:40:11.924845 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-55f13850-e243-4e13-bbcf-ba8193870e0b None None] MFA Rules not processed for user `7d677e7f53e9459f918735bc660fc6a2`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:40:11.926026 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-55f13850-e243-4e13-bbcf-ba8193870e0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:40:11.932694 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1266/2530] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 02:40:11 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 02:40:11.971499 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020a1cf5-531e-4657-b011-7a06e2a33a1a service cinder] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:40:11.972957 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-020a1cf5-531e-4657-b011-7a06e2a33a1a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:40:12.029807 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020a1cf5-531e-4657-b011-7a06e2a33a1a service cinder] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:40:12.034025 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d61205-5388-4d5f-a1a6-b49496199c60 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8285a132afeb47558e1b3dcedfd7b4e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'beb6def6fcad45959e56425bb8bff4d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:40:12.034656 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d61205-5388-4d5f-a1a6-b49496199c60 service glance] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:40:12.034935 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d61205-5388-4d5f-a1a6-b49496199c60 service glance] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:40:12.035208 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d61205-5388-4d5f-a1a6-b49496199c60 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:40:12.036935 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-76d61205-5388-4d5f-a1a6-b49496199c60 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:40:12.127426 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d61205-5388-4d5f-a1a6-b49496199c60 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:40:12.128817 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d61205-5388-4d5f-a1a6-b49496199c60 service glance] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:40:12.148891 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1265/2531] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 02:40:11 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 02:40:12.810662 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f13850-e243-4e13-bbcf-ba8193870e0b None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:40:12.812105 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-55f13850-e243-4e13-bbcf-ba8193870e0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:40:12.826117 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:40:12.831629 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d61205-5388-4d5f-a1a6-b49496199c60 service glance] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:40:12.833172 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-76d61205-5388-4d5f-a1a6-b49496199c60 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:40:12.877932 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:40:12.886139 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f13850-e243-4e13-bbcf-ba8193870e0b None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:40:12.892320 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae019cdd-4666-483a-80a0-a64b4c86273c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a58b9e0467c040638c3d43e3ac9c0495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'beb6def6fcad45959e56425bb8bff4d1', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:40:12.892987 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae019cdd-4666-483a-80a0-a64b4c86273c service placement] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:40:12.893267 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae019cdd-4666-483a-80a0-a64b4c86273c service placement] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:40:12.893538 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae019cdd-4666-483a-80a0-a64b4c86273c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:40:12.893775 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d61205-5388-4d5f-a1a6-b49496199c60 service glance] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:40:12.895259 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-ae019cdd-4666-483a-80a0-a64b4c86273c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:40:12.897356 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37e7158-2f69-4c67-9e7f-488ada7302b1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5223b5cab3114e9b9a13c582f8ef8386', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'beb6def6fcad45959e56425bb8bff4d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:40:12.898050 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37e7158-2f69-4c67-9e7f-488ada7302b1 service neutron] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:40:12.898327 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37e7158-2f69-4c67-9e7f-488ada7302b1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:40:12.898643 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37e7158-2f69-4c67-9e7f-488ada7302b1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:40:12.900330 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-e37e7158-2f69-4c67-9e7f-488ada7302b1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:40:12.907339 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae019cdd-4666-483a-80a0-a64b4c86273c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:40:12.908940 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae019cdd-4666-483a-80a0-a64b4c86273c service placement] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:40:12.913622 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37e7158-2f69-4c67-9e7f-488ada7302b1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:40:12.915060 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37e7158-2f69-4c67-9e7f-488ada7302b1 service neutron] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:40:12.918916 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1267/2532] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 02:40:12 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 02:40:12.926467 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1266/2533] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 02:40:12 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 12 02:40:15.108612 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae019cdd-4666-483a-80a0-a64b4c86273c service placement] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:40:15.120322 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae019cdd-4666-483a-80a0-a64b4c86273c service placement] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:40:15.124045 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65688b8a-506f-49c3-adb9-8ab921ad999e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5223b5cab3114e9b9a13c582f8ef8386', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'beb6def6fcad45959e56425bb8bff4d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:40:15.124703 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65688b8a-506f-49c3-adb9-8ab921ad999e service neutron] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:40:15.125491 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65688b8a-506f-49c3-adb9-8ab921ad999e service neutron] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:40:15.126341 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65688b8a-506f-49c3-adb9-8ab921ad999e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:40:15.130188 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-65688b8a-506f-49c3-adb9-8ab921ad999e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:40:15.141162 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65688b8a-506f-49c3-adb9-8ab921ad999e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:40:15.143271 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65688b8a-506f-49c3-adb9-8ab921ad999e service neutron] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:40:15.153047 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1268/2534] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 02:40:15 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 02:40:22.921033 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=9 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:40:25.148386 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=33 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:40:25.677755 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37e7158-2f69-4c67-9e7f-488ada7302b1 service neutron] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:40:25.679565 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-e37e7158-2f69-4c67-9e7f-488ada7302b1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:40:25.696056 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37e7158-2f69-4c67-9e7f-488ada7302b1 service neutron] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:40:25.702940 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa5e7bd-13e7-4e6c-9175-7906655aab4a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fca96c111b45b795fb757f77908ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'beb6def6fcad45959e56425bb8bff4d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:40:25.703805 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa5e7bd-13e7-4e6c-9175-7906655aab4a service nova] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:40:25.704149 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa5e7bd-13e7-4e6c-9175-7906655aab4a service nova] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:40:25.704441 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa5e7bd-13e7-4e6c-9175-7906655aab4a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:40:25.706520 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-9aa5e7bd-13e7-4e6c-9175-7906655aab4a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:40:25.722033 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa5e7bd-13e7-4e6c-9175-7906655aab4a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:40:25.723792 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa5e7bd-13e7-4e6c-9175-7906655aab4a service nova] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:40:25.737228 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1267/2535] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 02:40:25 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 02:40:27.357852 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150afa4b-b573-44e2-962a-95e8dc6fd398 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:40:27.358328 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150afa4b-b573-44e2-962a-95e8dc6fd398 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:40:27.358485 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150afa4b-b573-44e2-962a-95e8dc6fd398 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:40:27.408362 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-150afa4b-b573-44e2-962a-95e8dc6fd398 None None] MFA Rules not processed for user `8d0e2087e5324071926c3dc3a3cb9b1d`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:40:27.409594 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-150afa4b-b573-44e2-962a-95e8dc6fd398 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:40:27.474720 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1269/2536] 10.222.0.18 () {58 vars in 1009 bytes} [Wed Oct 12 02:40:27 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 02:40:27.519951 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa5e7bd-13e7-4e6c-9175-7906655aab4a service nova] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:40:27.521397 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-9aa5e7bd-13e7-4e6c-9175-7906655aab4a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:40:27.611528 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa5e7bd-13e7-4e6c-9175-7906655aab4a service nova] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:40:27.616459 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86ff729-e3ec-4161-9608-58dbd2d797c1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af9bd50c42cc437dbdd5a431d8adbb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'beb6def6fcad45959e56425bb8bff4d1', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:40:27.617076 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86ff729-e3ec-4161-9608-58dbd2d797c1 service swift] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:40:27.617353 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86ff729-e3ec-4161-9608-58dbd2d797c1 service swift] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:40:27.617624 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86ff729-e3ec-4161-9608-58dbd2d797c1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:40:27.626471 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86ff729-e3ec-4161-9608-58dbd2d797c1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:40:27.628044 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86ff729-e3ec-4161-9608-58dbd2d797c1 service swift] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:40:27.636011 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1268/2537] 10.222.0.18 () {60 vars in 1384 bytes} [Wed Oct 12 02:40:27 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 12 02:40:28.129127 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6696d2f8-c04c-4d08-b8ea-6bbed8084d9f None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:40:28.129419 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6696d2f8-c04c-4d08-b8ea-6bbed8084d9f None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:40:28.129693 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6696d2f8-c04c-4d08-b8ea-6bbed8084d9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:40:28.148432 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-6696d2f8-c04c-4d08-b8ea-6bbed8084d9f None None] MFA Rules not processed for user `8d0e2087e5324071926c3dc3a3cb9b1d`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:40:28.149707 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-6696d2f8-c04c-4d08-b8ea-6bbed8084d9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:40:28.157186 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1270/2538] 10.222.0.18 () {58 vars in 967 bytes} [Wed Oct 12 02:40:28 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 02:40:28.169130 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86ff729-e3ec-4161-9608-58dbd2d797c1 service swift] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:40:28.180333 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86ff729-e3ec-4161-9608-58dbd2d797c1 service swift] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:40:28.185471 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34dd6a95-4f14-4dfc-b24e-b8122f942b0f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af9bd50c42cc437dbdd5a431d8adbb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'beb6def6fcad45959e56425bb8bff4d1', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:40:28.186037 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dd6a95-4f14-4dfc-b24e-b8122f942b0f service swift] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:40:28.186316 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dd6a95-4f14-4dfc-b24e-b8122f942b0f service swift] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:40:28.186590 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dd6a95-4f14-4dfc-b24e-b8122f942b0f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:40:28.194397 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34dd6a95-4f14-4dfc-b24e-b8122f942b0f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:40:28.195997 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34dd6a95-4f14-4dfc-b24e-b8122f942b0f service swift] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:40:28.204631 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1269/2539] 10.222.0.18 () {60 vars in 1384 bytes} [Wed Oct 12 02:40:28 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 12 02:40:28.429863 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d569845e-6ddc-4ae7-915e-aa06b4909685 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:40:28.430313 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d569845e-6ddc-4ae7-915e-aa06b4909685 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:40:28.430407 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d569845e-6ddc-4ae7-915e-aa06b4909685 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:40:28.449524 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-d569845e-6ddc-4ae7-915e-aa06b4909685 None None] MFA Rules not processed for user `8d0e2087e5324071926c3dc3a3cb9b1d`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:40:28.450723 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-d569845e-6ddc-4ae7-915e-aa06b4909685 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:40:28.458466 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1271/2540] 10.222.0.18 () {58 vars in 1009 bytes} [Wed Oct 12 02:40:28 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 02:40:28.471909 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34dd6a95-4f14-4dfc-b24e-b8122f942b0f service swift] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:40:28.482937 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34dd6a95-4f14-4dfc-b24e-b8122f942b0f service swift] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:40:28.487983 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d1e2f1-1897-47c8-b684-adde79742637 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af9bd50c42cc437dbdd5a431d8adbb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'beb6def6fcad45959e56425bb8bff4d1', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:40:28.488541 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d1e2f1-1897-47c8-b684-adde79742637 service swift] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:40:28.488825 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d1e2f1-1897-47c8-b684-adde79742637 service swift] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:40:28.489099 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d1e2f1-1897-47c8-b684-adde79742637 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:40:28.497005 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d1e2f1-1897-47c8-b684-adde79742637 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:40:28.498581 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d1e2f1-1897-47c8-b684-adde79742637 service swift] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:40:28.508425 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1270/2541] 10.222.0.18 () {60 vars in 1384 bytes} [Wed Oct 12 02:40:28 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 12 02:40:28.825427 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b76e203-3424-40df-9eed-c1cdaa125eec None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:40:28.825707 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b76e203-3424-40df-9eed-c1cdaa125eec None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:40:28.825977 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b76e203-3424-40df-9eed-c1cdaa125eec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:40:28.845627 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-6b76e203-3424-40df-9eed-c1cdaa125eec None None] MFA Rules not processed for user `8d0e2087e5324071926c3dc3a3cb9b1d`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:40:28.846812 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-6b76e203-3424-40df-9eed-c1cdaa125eec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:40:28.853911 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1272/2542] 10.222.0.18 () {58 vars in 967 bytes} [Wed Oct 12 02:40:28 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 02:40:28.866613 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d1e2f1-1897-47c8-b684-adde79742637 service swift] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:40:28.877526 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d1e2f1-1897-47c8-b684-adde79742637 service swift] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:40:28.882438 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0546c2cc-4175-4168-8c28-4b671300cd74 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af9bd50c42cc437dbdd5a431d8adbb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'beb6def6fcad45959e56425bb8bff4d1', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:40:28.883011 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0546c2cc-4175-4168-8c28-4b671300cd74 service swift] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:40:28.883284 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0546c2cc-4175-4168-8c28-4b671300cd74 service swift] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:40:28.883548 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0546c2cc-4175-4168-8c28-4b671300cd74 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:40:28.892052 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0546c2cc-4175-4168-8c28-4b671300cd74 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:40:28.893656 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0546c2cc-4175-4168-8c28-4b671300cd74 service swift] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:40:28.901663 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1271/2543] 10.222.0.18 () {60 vars in 1384 bytes} [Wed Oct 12 02:40:28 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 12 02:40:30.982989 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b76e203-3424-40df-9eed-c1cdaa125eec None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:40:31.045487 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b76e203-3424-40df-9eed-c1cdaa125eec None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:40:31.049922 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346db367-46ef-4ec1-b9b0-a945a61d37fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:40:31.050543 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346db367-46ef-4ec1-b9b0-a945a61d37fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:40:31.050824 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346db367-46ef-4ec1-b9b0-a945a61d37fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:40:31.051088 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346db367-46ef-4ec1-b9b0-a945a61d37fa admin admin] PATH_INFO: `/v3/users/7d677e7f53e9459f918735bc660fc6a2` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:40:31.052188 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346db367-46ef-4ec1-b9b0-a945a61d37fa admin admin] RBAC: Authorizing `identity:delete_user(user_id=7d677e7f53e9459f918735bc660fc6a2)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:40:31.054129 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346db367-46ef-4ec1-b9b0-a945a61d37fa admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:40:31.103846 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-346db367-46ef-4ec1-b9b0-a945a61d37fa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7d677e7f53e9459f918735bc660fc6a2'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:40:31.111327 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-346db367-46ef-4ec1-b9b0-a945a61d37fa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7d677e7f53e9459f918735bc660fc6a2'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:40:31.112545 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:40:31.126900 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-346db367-46ef-4ec1-b9b0-a945a61d37fa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7d677e7f53e9459f918735bc660fc6a2'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:40:31.134383 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-346db367-46ef-4ec1-b9b0-a945a61d37fa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7d677e7f53e9459f918735bc660fc6a2'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:40:31.135121 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-346db367-46ef-4ec1-b9b0-a945a61d37fa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7d677e7f53e9459f918735bc660fc6a2'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:40:31.142090 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1273/2544] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Oct 12 02:40:30 2022] DELETE /identity/v3/users/7d677e7f53e9459f918735bc660fc6a2 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 02:40:31.146700 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35556535-0e7d-4cb8-b442-078917581cc7 None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:40:31.147176 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35556535-0e7d-4cb8-b442-078917581cc7 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:40:31.147446 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35556535-0e7d-4cb8-b442-078917581cc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:40:31.166432 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-35556535-0e7d-4cb8-b442-078917581cc7 None None] MFA Rules not processed for user `a326a5bb7364479382f528a592371656`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:40:31.167636 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-35556535-0e7d-4cb8-b442-078917581cc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:40:31.226670 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1272/2545] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 02:40:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 02:40:31.236749 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346db367-46ef-4ec1-b9b0-a945a61d37fa admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:40:31.238180 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-346db367-46ef-4ec1-b9b0-a945a61d37fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:40:31.297618 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346db367-46ef-4ec1-b9b0-a945a61d37fa admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:40:31.301238 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3813e628-e800-4ee9-83db-910e6032214a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5223b5cab3114e9b9a13c582f8ef8386', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'beb6def6fcad45959e56425bb8bff4d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:40:31.301869 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3813e628-e800-4ee9-83db-910e6032214a service neutron] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:40:31.302147 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3813e628-e800-4ee9-83db-910e6032214a service neutron] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:40:31.302413 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3813e628-e800-4ee9-83db-910e6032214a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:40:31.312039 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3813e628-e800-4ee9-83db-910e6032214a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:40:31.313388 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3813e628-e800-4ee9-83db-910e6032214a service neutron] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:40:31.322816 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1274/2546] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 02:40:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 02:40:31.494580 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35556535-0e7d-4cb8-b442-078917581cc7 None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:40:31.496059 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-35556535-0e7d-4cb8-b442-078917581cc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:40:31.508246 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35556535-0e7d-4cb8-b442-078917581cc7 None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:40:31.513214 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158770cb-7bc4-40d7-8b7a-b8c04a7ee76b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:40:31.515979 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158770cb-7bc4-40d7-8b7a-b8c04a7ee76b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:40:31.517490 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158770cb-7bc4-40d7-8b7a-b8c04a7ee76b admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:40:31.517490 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158770cb-7bc4-40d7-8b7a-b8c04a7ee76b admin admin] PATH_INFO: `/v3/projects/4d2077cfbf1f4b20920cb2a038758fb4` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:40:31.518429 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158770cb-7bc4-40d7-8b7a-b8c04a7ee76b admin admin] RBAC: Authorizing `identity:delete_project(project_id=4d2077cfbf1f4b20920cb2a038758fb4)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:40:31.521238 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158770cb-7bc4-40d7-8b7a-b8c04a7ee76b admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:40:31.540844 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:40:31.571288 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-158770cb-7bc4-40d7-8b7a-b8c04a7ee76b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4d2077cfbf1f4b20920cb2a038758fb4', 'request_id': 'req-158770cb-7bc4-40d7-8b7a-b8c04a7ee76b'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:40:31.576669 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-158770cb-7bc4-40d7-8b7a-b8c04a7ee76b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4d2077cfbf1f4b20920cb2a038758fb4', 'request_id': 'req-158770cb-7bc4-40d7-8b7a-b8c04a7ee76b'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:40:31.582899 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-158770cb-7bc4-40d7-8b7a-b8c04a7ee76b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4d2077cfbf1f4b20920cb2a038758fb4', 'request_id': 'req-158770cb-7bc4-40d7-8b7a-b8c04a7ee76b'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:40:31.595979 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-158770cb-7bc4-40d7-8b7a-b8c04a7ee76b admin admin] The token cache is being invalidate because project 4d2077cfbf1f4b20920cb2a038758fb4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81361) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 02:40:31.596270 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-158770cb-7bc4-40d7-8b7a-b8c04a7ee76b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:40:31.596971 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-158770cb-7bc4-40d7-8b7a-b8c04a7ee76b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:40:31.598547 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1273/2547] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Oct 12 02:40:31 2022] DELETE /identity/v3/projects/4d2077cfbf1f4b20920cb2a038758fb4 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 02:40:31.603462 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976f9d7b-3d83-4d12-b7e7-672b364e78d7 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:40:31.603742 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976f9d7b-3d83-4d12-b7e7-672b364e78d7 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:40:31.604013 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976f9d7b-3d83-4d12-b7e7-672b364e78d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:40:31.624000 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-976f9d7b-3d83-4d12-b7e7-672b364e78d7 None None] MFA Rules not processed for user `a326a5bb7364479382f528a592371656`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:40:31.625284 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-976f9d7b-3d83-4d12-b7e7-672b364e78d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:40:31.682615 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1275/2548] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 02:40:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 02:40:31.690259 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f28eb2-f500-43b5-ae99-e86462403530 None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:40:31.690540 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f28eb2-f500-43b5-ae99-e86462403530 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:40:31.690813 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f28eb2-f500-43b5-ae99-e86462403530 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:40:31.710250 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-b2f28eb2-f500-43b5-ae99-e86462403530 None None] MFA Rules not processed for user `a326a5bb7364479382f528a592371656`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:40:31.711490 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-b2f28eb2-f500-43b5-ae99-e86462403530 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:40:31.720165 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1274/2549] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 02:40:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 02:40:31.724176 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976f9d7b-3d83-4d12-b7e7-672b364e78d7 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:40:31.734437 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976f9d7b-3d83-4d12-b7e7-672b364e78d7 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:40:31.739068 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b101bab-fc61-4c75-b6ad-9e367dad1720 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:40:31.739611 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b101bab-fc61-4c75-b6ad-9e367dad1720 admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:40:31.739891 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b101bab-fc61-4c75-b6ad-9e367dad1720 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:40:31.740163 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b101bab-fc61-4c75-b6ad-9e367dad1720 admin admin] PATH_INFO: `/v3/domains` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:40:31.740879 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b101bab-fc61-4c75-b6ad-9e367dad1720 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 02:40:31.741183 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b101bab-fc61-4c75-b6ad-9e367dad1720 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:40:31.742762 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b101bab-fc61-4c75-b6ad-9e367dad1720 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:40:31.754555 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1276/2550] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Oct 12 02:40:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 02:40:31.758663 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f28eb2-f500-43b5-ae99-e86462403530 None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:40:31.767858 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f28eb2-f500-43b5-ae99-e86462403530 None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:40:31.772497 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a867c090-dcbe-467e-a46d-4714819f0ade admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:40:31.773082 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a867c090-dcbe-467e-a46d-4714819f0ade admin admin] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:40:31.773359 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a867c090-dcbe-467e-a46d-4714819f0ade admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:40:31.773627 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a867c090-dcbe-467e-a46d-4714819f0ade admin admin] PATH_INFO: `/v3/projects` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:40:31.774242 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a867c090-dcbe-467e-a46d-4714819f0ade admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:40:31.776122 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a867c090-dcbe-467e-a46d-4714819f0ade admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:40:31.804227 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1275/2551] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Oct 12 02:40:31 2022] POST /identity/v3/projects => generated 381 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 02:40:31.808277 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b101bab-fc61-4c75-b6ad-9e367dad1720 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:40:31.818277 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b101bab-fc61-4c75-b6ad-9e367dad1720 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:40:31.874087 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ee9c37-1756-43f7-be04-52f4b9b789cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:40:31.874695 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ee9c37-1756-43f7-be04-52f4b9b789cd admin admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:40:31.874977 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ee9c37-1756-43f7-be04-52f4b9b789cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:40:31.875253 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ee9c37-1756-43f7-be04-52f4b9b789cd admin admin] PATH_INFO: `/v3/users` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:40:31.875886 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ee9c37-1756-43f7-be04-52f4b9b789cd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:40:31.877852 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ee9c37-1756-43f7-be04-52f4b9b789cd admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:40:31.886757 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:40:31.903360 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1277/2552] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Oct 12 02:40:31 2022] POST /identity/v3/users => generated 291 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 02:40:31.904586 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a867c090-dcbe-467e-a46d-4714819f0ade admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:40:31.915364 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a867c090-dcbe-467e-a46d-4714819f0ade admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:40:31.919891 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3168ef1c-a934-4600-abb6-73c8fc87ea4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:40:31.920516 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3168ef1c-a934-4600-abb6-73c8fc87ea4e admin admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:40:31.921360 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3168ef1c-a934-4600-abb6-73c8fc87ea4e admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:40:31.921720 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3168ef1c-a934-4600-abb6-73c8fc87ea4e admin admin] PATH_INFO: `/v3/roles` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:40:31.922275 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3168ef1c-a934-4600-abb6-73c8fc87ea4e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:40:31.923861 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3168ef1c-a934-4600-abb6-73c8fc87ea4e admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:40:31.933549 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1276/2553] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Oct 12 02:40:31 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 02:40:31.937725 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ee9c37-1756-43f7-be04-52f4b9b789cd admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:40:31.947553 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ee9c37-1756-43f7-be04-52f4b9b789cd admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:40:31.952808 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcda102-2003-4726-88f5-9e4753d2ea3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:40:31.953403 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcda102-2003-4726-88f5-9e4753d2ea3f admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:40:31.953700 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcda102-2003-4726-88f5-9e4753d2ea3f admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:40:31.953954 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcda102-2003-4726-88f5-9e4753d2ea3f admin admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:40:31.954592 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dcda102-2003-4726-88f5-9e4753d2ea3f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:40:31.956216 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dcda102-2003-4726-88f5-9e4753d2ea3f admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:40:31.968079 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1278/2554] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Oct 12 02:40:31 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 02:40:31.972339 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3168ef1c-a934-4600-abb6-73c8fc87ea4e admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:40:31.982150 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3168ef1c-a934-4600-abb6-73c8fc87ea4e admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:40:31.986805 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9335199-e6bf-4ce5-bab3-864f3021f976 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:40:31.987441 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9335199-e6bf-4ce5-bab3-864f3021f976 admin admin] REQUEST_METHOD: `PUT` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:40:31.987722 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9335199-e6bf-4ce5-bab3-864f3021f976 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:40:31.987997 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9335199-e6bf-4ce5-bab3-864f3021f976 admin admin] PATH_INFO: `/v3/projects/4d9541e33e4f4751a2fef0ea188fc21d/users/122aff6498524be78579f1d1c37c1098/roles/3d75c4d7f1a849b9a771504d1583ab28` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:40:32.002353 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9335199-e6bf-4ce5-bab3-864f3021f976 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4d9541e33e4f4751a2fef0ea188fc21d, user_id=122aff6498524be78579f1d1c37c1098, role_id=3d75c4d7f1a849b9a771504d1583ab28)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:40:32.005130 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9335199-e6bf-4ce5-bab3-864f3021f976 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:40:32.018934 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1277/2555] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Oct 12 02:40:31 2022] PUT /identity/v3/projects/4d9541e33e4f4751a2fef0ea188fc21d/users/122aff6498524be78579f1d1c37c1098/roles/3d75c4d7f1a849b9a771504d1583ab28 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 02:40:32.023845 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea4dff7-01e2-412f-b818-3080c4314da7 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:40:32.024378 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea4dff7-01e2-412f-b818-3080c4314da7 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:40:32.024499 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea4dff7-01e2-412f-b818-3080c4314da7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:40:32.043479 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-5ea4dff7-01e2-412f-b818-3080c4314da7 None None] MFA Rules not processed for user `a326a5bb7364479382f528a592371656`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:40:32.044700 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-5ea4dff7-01e2-412f-b818-3080c4314da7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:40:32.102969 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1279/2556] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 02:40:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 02:40:32.112735 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9335199-e6bf-4ce5-bab3-864f3021f976 admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:40:32.114414 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-f9335199-e6bf-4ce5-bab3-864f3021f976 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:40:32.171051 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9335199-e6bf-4ce5-bab3-864f3021f976 admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:40:32.174819 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f48e110-2f99-4797-9147-b169670e06cd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5223b5cab3114e9b9a13c582f8ef8386', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'beb6def6fcad45959e56425bb8bff4d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:40:32.175422 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f48e110-2f99-4797-9147-b169670e06cd service neutron] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:40:32.175703 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f48e110-2f99-4797-9147-b169670e06cd service neutron] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:40:32.175973 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f48e110-2f99-4797-9147-b169670e06cd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:40:32.184768 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f48e110-2f99-4797-9147-b169670e06cd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:40:32.186181 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f48e110-2f99-4797-9147-b169670e06cd service neutron] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:40:32.195222 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1278/2557] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 02:40:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 02:40:32.825128 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32dd1e1-a8b0-4132-80c1-c91b8ce24d07 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:40:32.825474 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32dd1e1-a8b0-4132-80c1-c91b8ce24d07 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:40:32.825700 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32dd1e1-a8b0-4132-80c1-c91b8ce24d07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:40:32.854785 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-b32dd1e1-a8b0-4132-80c1-c91b8ce24d07 None None] MFA Rules not processed for user `122aff6498524be78579f1d1c37c1098`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:40:32.856039 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-b32dd1e1-a8b0-4132-80c1-c91b8ce24d07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:40:32.925582 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1280/2558] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 02:40:32 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 02:40:32.935874 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f48e110-2f99-4797-9147-b169670e06cd service neutron] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:40:32.937961 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-1f48e110-2f99-4797-9147-b169670e06cd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:40:32.981357 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:40:32.996939 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f48e110-2f99-4797-9147-b169670e06cd service neutron] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:40:33.001363 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be4f8b2-eb93-4e17-8775-9f1e64b4e076 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ba688e0c4d44d13898539ee886f95fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'beb6def6fcad45959e56425bb8bff4d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:40:33.001971 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be4f8b2-eb93-4e17-8775-9f1e64b4e076 service cinder] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:40:33.002251 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be4f8b2-eb93-4e17-8775-9f1e64b4e076 service cinder] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:40:33.002524 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be4f8b2-eb93-4e17-8775-9f1e64b4e076 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:40:33.011294 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be4f8b2-eb93-4e17-8775-9f1e64b4e076 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:40:33.012761 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be4f8b2-eb93-4e17-8775-9f1e64b4e076 service cinder] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:40:33.027988 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1279/2559] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 02:40:32 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 02:40:34.388946 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35398726-2378-42a0-87a1-72e716877740 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:40:34.390182 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35398726-2378-42a0-87a1-72e716877740 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:40:34.390182 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35398726-2378-42a0-87a1-72e716877740 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:40:34.409316 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-35398726-2378-42a0-87a1-72e716877740 None None] MFA Rules not processed for user `122aff6498524be78579f1d1c37c1098`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:40:34.410523 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-35398726-2378-42a0-87a1-72e716877740 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:40:34.417332 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1281/2560] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 02:40:34 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 02:40:41.158102 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be4f8b2-eb93-4e17-8775-9f1e64b4e076 service cinder] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:40:41.159541 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-4be4f8b2-eb93-4e17-8775-9f1e64b4e076 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:40:41.234168 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be4f8b2-eb93-4e17-8775-9f1e64b4e076 service cinder] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:40:41.239686 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c0f4ec-5fc0-4210-9588-dd83b395ff00 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fca96c111b45b795fb757f77908ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'beb6def6fcad45959e56425bb8bff4d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:40:41.240288 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c0f4ec-5fc0-4210-9588-dd83b395ff00 service nova] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:40:41.240620 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c0f4ec-5fc0-4210-9588-dd83b395ff00 service nova] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:40:41.240899 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c0f4ec-5fc0-4210-9588-dd83b395ff00 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:40:41.242609 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-41c0f4ec-5fc0-4210-9588-dd83b395ff00 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:40:41.254494 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c0f4ec-5fc0-4210-9588-dd83b395ff00 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:40:41.256053 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c0f4ec-5fc0-4210-9588-dd83b395ff00 service nova] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:40:41.267382 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1280/2561] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 02:40:41 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 02:40:44.403313 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:INSERT=2,keystone:SELECT=69 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:40:51.262039 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=42 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:40:58.379897 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afd17c7-6a0b-4d78-9b7e-b0f3b1e6e7cf None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:40:58.380359 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afd17c7-6a0b-4d78-9b7e-b0f3b1e6e7cf None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:40:58.380359 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afd17c7-6a0b-4d78-9b7e-b0f3b1e6e7cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:40:58.400169 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-5afd17c7-6a0b-4d78-9b7e-b0f3b1e6e7cf None None] MFA Rules not processed for user `a326a5bb7364479382f528a592371656`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:40:58.401398 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-5afd17c7-6a0b-4d78-9b7e-b0f3b1e6e7cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:40:58.409258 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1282/2562] 10.222.0.27 () {58 vars in 1016 bytes} [Wed Oct 12 02:40:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 02:40:58.432179 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c0f4ec-5fc0-4210-9588-dd83b395ff00 service nova] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:40:58.444344 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c0f4ec-5fc0-4210-9588-dd83b395ff00 service nova] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:40:58.449761 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fc7540-77f7-492d-ad0a-e2604db21243 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fca96c111b45b795fb757f77908ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'beb6def6fcad45959e56425bb8bff4d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:40:58.450364 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fc7540-77f7-492d-ad0a-e2604db21243 service nova] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:40:58.450637 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fc7540-77f7-492d-ad0a-e2604db21243 service nova] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:40:58.450904 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fc7540-77f7-492d-ad0a-e2604db21243 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:40:58.459734 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01fc7540-77f7-492d-ad0a-e2604db21243 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:40:58.461357 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01fc7540-77f7-492d-ad0a-e2604db21243 service nova] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:40:58.471082 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1281/2563] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 02:40:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 02:41:01.451381 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b5f581-51c7-41b5-b858-5ac4e7332b82 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:41:01.451997 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b5f581-51c7-41b5-b858-5ac4e7332b82 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:41:01.451997 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b5f581-51c7-41b5-b858-5ac4e7332b82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:41:01.471426 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-97b5f581-51c7-41b5-b858-5ac4e7332b82 None None] MFA Rules not processed for user `a326a5bb7364479382f528a592371656`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:41:01.473300 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-97b5f581-51c7-41b5-b858-5ac4e7332b82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:41:01.481092 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1283/2564] 10.222.0.27 () {58 vars in 1016 bytes} [Wed Oct 12 02:41:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 02:41:01.500890 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fc7540-77f7-492d-ad0a-e2604db21243 service nova] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:41:01.502289 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-01fc7540-77f7-492d-ad0a-e2604db21243 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:41:01.516693 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fc7540-77f7-492d-ad0a-e2604db21243 service nova] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:41:01.522731 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6fad4a-c969-43de-9d9b-22509e3ac278 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fca96c111b45b795fb757f77908ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'beb6def6fcad45959e56425bb8bff4d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:41:01.523319 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6fad4a-c969-43de-9d9b-22509e3ac278 service nova] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:41:01.523599 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6fad4a-c969-43de-9d9b-22509e3ac278 service nova] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:41:01.523873 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6fad4a-c969-43de-9d9b-22509e3ac278 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:41:01.532210 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6fad4a-c969-43de-9d9b-22509e3ac278 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:41:01.533829 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6fad4a-c969-43de-9d9b-22509e3ac278 service nova] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:41:01.544378 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1282/2565] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 02:41:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 02:41:04.705520 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c86e8b-80dc-4639-91f7-c283563ede8c None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:41:04.706081 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c86e8b-80dc-4639-91f7-c283563ede8c None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:41:04.706081 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c86e8b-80dc-4639-91f7-c283563ede8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:41:04.725903 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-00c86e8b-80dc-4639-91f7-c283563ede8c None None] MFA Rules not processed for user `a326a5bb7364479382f528a592371656`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:41:04.727094 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-00c86e8b-80dc-4639-91f7-c283563ede8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:41:04.734865 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1284/2566] 10.222.0.27 () {58 vars in 1016 bytes} [Wed Oct 12 02:41:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 02:41:04.755749 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6fad4a-c969-43de-9d9b-22509e3ac278 service nova] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:41:04.767363 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6fad4a-c969-43de-9d9b-22509e3ac278 service nova] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:41:04.772935 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e963d9-56a4-4498-87a8-22294a7da4c8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fca96c111b45b795fb757f77908ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'beb6def6fcad45959e56425bb8bff4d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:41:04.773518 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e963d9-56a4-4498-87a8-22294a7da4c8 service nova] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:41:04.773791 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e963d9-56a4-4498-87a8-22294a7da4c8 service nova] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:41:04.774104 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e963d9-56a4-4498-87a8-22294a7da4c8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:41:04.782061 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e963d9-56a4-4498-87a8-22294a7da4c8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:41:04.783612 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e963d9-56a4-4498-87a8-22294a7da4c8 service nova] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:41:04.793874 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1283/2567] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 02:41:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 02:41:07.801721 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f40a96-261f-4f27-b65c-759ae16e1c70 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:41:07.802210 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f40a96-261f-4f27-b65c-759ae16e1c70 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:41:07.802311 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f40a96-261f-4f27-b65c-759ae16e1c70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:41:07.821764 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-e9f40a96-261f-4f27-b65c-759ae16e1c70 None None] MFA Rules not processed for user `a326a5bb7364479382f528a592371656`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:41:07.822935 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-e9f40a96-261f-4f27-b65c-759ae16e1c70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:41:07.830539 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1285/2568] 10.222.0.27 () {58 vars in 1016 bytes} [Wed Oct 12 02:41:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 02:41:07.852153 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e963d9-56a4-4498-87a8-22294a7da4c8 service nova] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:41:07.863264 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e963d9-56a4-4498-87a8-22294a7da4c8 service nova] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:41:07.869680 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac6ba7f-a976-4f26-9bb2-862c043d15ad service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fca96c111b45b795fb757f77908ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'beb6def6fcad45959e56425bb8bff4d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:41:07.870262 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac6ba7f-a976-4f26-9bb2-862c043d15ad service nova] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:41:07.870538 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac6ba7f-a976-4f26-9bb2-862c043d15ad service nova] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:41:07.870806 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac6ba7f-a976-4f26-9bb2-862c043d15ad service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:41:07.878754 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac6ba7f-a976-4f26-9bb2-862c043d15ad service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:41:07.880418 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac6ba7f-a976-4f26-9bb2-862c043d15ad service nova] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:41:07.889615 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1284/2569] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 02:41:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 02:41:10.957349 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88a41fc-312f-4847-8695-c6305c0c6ede None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:41:10.957938 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88a41fc-312f-4847-8695-c6305c0c6ede None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:41:10.957938 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88a41fc-312f-4847-8695-c6305c0c6ede None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:41:10.977821 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-f88a41fc-312f-4847-8695-c6305c0c6ede None None] MFA Rules not processed for user `a326a5bb7364479382f528a592371656`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:41:10.979019 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-f88a41fc-312f-4847-8695-c6305c0c6ede None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:41:10.986861 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1286/2570] 10.222.0.27 () {58 vars in 1016 bytes} [Wed Oct 12 02:41:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 02:41:11.008301 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac6ba7f-a976-4f26-9bb2-862c043d15ad service nova] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:41:11.019438 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac6ba7f-a976-4f26-9bb2-862c043d15ad service nova] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:41:11.025032 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d273cba8-d1f0-4d8c-aceb-f0c392c03567 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fca96c111b45b795fb757f77908ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'beb6def6fcad45959e56425bb8bff4d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:41:11.025618 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d273cba8-d1f0-4d8c-aceb-f0c392c03567 service nova] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:41:11.025898 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d273cba8-d1f0-4d8c-aceb-f0c392c03567 service nova] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:41:11.026171 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d273cba8-d1f0-4d8c-aceb-f0c392c03567 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:41:11.034176 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d273cba8-d1f0-4d8c-aceb-f0c392c03567 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:41:11.036250 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d273cba8-d1f0-4d8c-aceb-f0c392c03567 service nova] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:41:11.045624 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1285/2571] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 02:41:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 02:41:14.120086 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2eef7b-22bf-45c9-9075-45bda2e215ed None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:41:14.120644 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2eef7b-22bf-45c9-9075-45bda2e215ed None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:41:14.120644 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2eef7b-22bf-45c9-9075-45bda2e215ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:41:14.140620 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-1f2eef7b-22bf-45c9-9075-45bda2e215ed None None] MFA Rules not processed for user `a326a5bb7364479382f528a592371656`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:41:14.141800 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-1f2eef7b-22bf-45c9-9075-45bda2e215ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:41:14.150302 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1287/2572] 10.222.0.27 () {58 vars in 1016 bytes} [Wed Oct 12 02:41:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 02:41:14.172891 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d273cba8-d1f0-4d8c-aceb-f0c392c03567 service nova] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:41:14.184134 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d273cba8-d1f0-4d8c-aceb-f0c392c03567 service nova] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:41:14.189393 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bad543-aad2-4f46-91b1-0070042b744f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fca96c111b45b795fb757f77908ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'beb6def6fcad45959e56425bb8bff4d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:41:14.189973 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bad543-aad2-4f46-91b1-0070042b744f service nova] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:41:14.190247 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bad543-aad2-4f46-91b1-0070042b744f service nova] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:41:14.190515 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bad543-aad2-4f46-91b1-0070042b744f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:41:14.199408 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8bad543-aad2-4f46-91b1-0070042b744f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:41:14.201009 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8bad543-aad2-4f46-91b1-0070042b744f service nova] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:41:14.210724 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1286/2573] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 02:41:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 02:41:24.135291 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=18 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:41:24.206009 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=36 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:41:28.099826 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edc0580-e4ed-48a1-b190-f64083eecc55 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:41:28.100311 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edc0580-e4ed-48a1-b190-f64083eecc55 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:41:28.100422 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edc0580-e4ed-48a1-b190-f64083eecc55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:41:28.119742 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-7edc0580-e4ed-48a1-b190-f64083eecc55 None None] MFA Rules not processed for user `122aff6498524be78579f1d1c37c1098`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:41:28.120969 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-7edc0580-e4ed-48a1-b190-f64083eecc55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:41:28.127642 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1288/2574] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 02:41:28 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 02:41:28.358876 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bad543-aad2-4f46-91b1-0070042b744f service nova] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:41:28.368930 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bad543-aad2-4f46-91b1-0070042b744f service nova] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:41:28.372419 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75d87f1-abf9-403e-bbb1-263fd57b5576 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5223b5cab3114e9b9a13c582f8ef8386', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'beb6def6fcad45959e56425bb8bff4d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:41:28.373030 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75d87f1-abf9-403e-bbb1-263fd57b5576 service neutron] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:41:28.373322 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75d87f1-abf9-403e-bbb1-263fd57b5576 service neutron] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:41:28.373585 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75d87f1-abf9-403e-bbb1-263fd57b5576 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:41:28.375274 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-d75d87f1-abf9-403e-bbb1-263fd57b5576 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:41:28.385508 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75d87f1-abf9-403e-bbb1-263fd57b5576 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:41:28.386955 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75d87f1-abf9-403e-bbb1-263fd57b5576 service neutron] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:41:28.394841 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1287/2575] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 02:41:28 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 02:41:38.113561 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=3 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:41:38.391168 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=6 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:41:38.611453 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c88ea5e-e498-4dc0-a18a-d6edc19e94b5 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:41:38.611747 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c88ea5e-e498-4dc0-a18a-d6edc19e94b5 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:41:38.612022 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c88ea5e-e498-4dc0-a18a-d6edc19e94b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:41:38.631839 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-4c88ea5e-e498-4dc0-a18a-d6edc19e94b5 None None] MFA Rules not processed for user `a326a5bb7364479382f528a592371656`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:41:38.633126 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-4c88ea5e-e498-4dc0-a18a-d6edc19e94b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:41:38.640915 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1289/2576] 10.222.0.27 () {58 vars in 1016 bytes} [Wed Oct 12 02:41:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 02:41:38.661389 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75d87f1-abf9-403e-bbb1-263fd57b5576 service neutron] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:41:38.674621 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75d87f1-abf9-403e-bbb1-263fd57b5576 service neutron] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:41:38.680797 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ae1830-ec9a-4b24-a197-d33823f61343 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fca96c111b45b795fb757f77908ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'beb6def6fcad45959e56425bb8bff4d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:41:38.681386 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ae1830-ec9a-4b24-a197-d33823f61343 service nova] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:41:38.681666 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ae1830-ec9a-4b24-a197-d33823f61343 service nova] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:41:38.681940 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ae1830-ec9a-4b24-a197-d33823f61343 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:41:38.690424 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ae1830-ec9a-4b24-a197-d33823f61343 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:41:38.692107 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ae1830-ec9a-4b24-a197-d33823f61343 service nova] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:41:38.702659 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1288/2577] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 02:41:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 02:41:41.873727 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0214495-1b79-4ed8-b429-13aa5d670149 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:41:41.874345 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0214495-1b79-4ed8-b429-13aa5d670149 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:41:41.874345 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0214495-1b79-4ed8-b429-13aa5d670149 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:41:41.894291 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-b0214495-1b79-4ed8-b429-13aa5d670149 None None] MFA Rules not processed for user `a326a5bb7364479382f528a592371656`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:41:41.895481 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-b0214495-1b79-4ed8-b429-13aa5d670149 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:41:41.904585 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1290/2578] 10.222.0.27 () {58 vars in 1016 bytes} [Wed Oct 12 02:41:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 02:41:41.925416 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ae1830-ec9a-4b24-a197-d33823f61343 service nova] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:41:41.936806 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ae1830-ec9a-4b24-a197-d33823f61343 service nova] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:41:41.942144 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39983216-ba92-468f-afe0-b9e1afe1d5d3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fca96c111b45b795fb757f77908ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'beb6def6fcad45959e56425bb8bff4d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:41:41.942745 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39983216-ba92-468f-afe0-b9e1afe1d5d3 service nova] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:41:41.943018 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39983216-ba92-468f-afe0-b9e1afe1d5d3 service nova] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:41:41.943285 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39983216-ba92-468f-afe0-b9e1afe1d5d3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:41:41.951368 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39983216-ba92-468f-afe0-b9e1afe1d5d3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:41:41.952946 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39983216-ba92-468f-afe0-b9e1afe1d5d3 service nova] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:41:41.962657 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1289/2579] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 02:41:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 02:41:44.966652 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f1830f-1fc5-4219-bff9-db7cad03965a None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:41:44.967135 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f1830f-1fc5-4219-bff9-db7cad03965a None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:41:44.967257 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f1830f-1fc5-4219-bff9-db7cad03965a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:41:44.987464 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-91f1830f-1fc5-4219-bff9-db7cad03965a None None] MFA Rules not processed for user `a326a5bb7364479382f528a592371656`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:41:44.988671 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-91f1830f-1fc5-4219-bff9-db7cad03965a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:41:44.996431 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1291/2580] 10.222.0.27 () {58 vars in 1016 bytes} [Wed Oct 12 02:41:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 02:41:45.015923 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39983216-ba92-468f-afe0-b9e1afe1d5d3 service nova] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:41:45.027576 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39983216-ba92-468f-afe0-b9e1afe1d5d3 service nova] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:41:45.033000 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2991484a-32dd-4c5b-8429-678aae9c032e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fca96c111b45b795fb757f77908ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'beb6def6fcad45959e56425bb8bff4d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:41:45.033576 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2991484a-32dd-4c5b-8429-678aae9c032e service nova] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:41:45.033855 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2991484a-32dd-4c5b-8429-678aae9c032e service nova] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:41:45.034143 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2991484a-32dd-4c5b-8429-678aae9c032e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:41:45.042759 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2991484a-32dd-4c5b-8429-678aae9c032e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:41:45.044319 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2991484a-32dd-4c5b-8429-678aae9c032e service nova] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:41:45.053407 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1290/2581] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 02:41:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 02:41:48.128539 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35892938-8de7-4262-b8cb-d4716bfa1acb None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:41:48.129056 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35892938-8de7-4262-b8cb-d4716bfa1acb None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:41:48.129180 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35892938-8de7-4262-b8cb-d4716bfa1acb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:41:48.148181 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-35892938-8de7-4262-b8cb-d4716bfa1acb None None] MFA Rules not processed for user `a326a5bb7364479382f528a592371656`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:41:48.149956 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-35892938-8de7-4262-b8cb-d4716bfa1acb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:41:48.157743 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1292/2582] 10.222.0.27 () {58 vars in 1016 bytes} [Wed Oct 12 02:41:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 02:41:48.177448 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2991484a-32dd-4c5b-8429-678aae9c032e service nova] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:41:48.189036 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2991484a-32dd-4c5b-8429-678aae9c032e service nova] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:41:48.194528 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f5fcb8-2101-437c-a559-13dd157e257c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fca96c111b45b795fb757f77908ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'beb6def6fcad45959e56425bb8bff4d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:41:48.195115 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f5fcb8-2101-437c-a559-13dd157e257c service nova] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:41:48.195395 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f5fcb8-2101-437c-a559-13dd157e257c service nova] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:41:48.195672 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f5fcb8-2101-437c-a559-13dd157e257c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:41:48.204755 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f5fcb8-2101-437c-a559-13dd157e257c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:41:48.206359 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f5fcb8-2101-437c-a559-13dd157e257c service nova] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:41:48.216318 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1291/2583] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 02:41:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 02:41:51.298241 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67233ae-dfcc-483e-8e13-5faa4ce3931d None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:41:51.298791 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67233ae-dfcc-483e-8e13-5faa4ce3931d None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:41:51.298791 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67233ae-dfcc-483e-8e13-5faa4ce3931d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:41:51.318293 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-d67233ae-dfcc-483e-8e13-5faa4ce3931d None None] MFA Rules not processed for user `a326a5bb7364479382f528a592371656`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:41:51.319476 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-d67233ae-dfcc-483e-8e13-5faa4ce3931d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:41:51.328951 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1293/2584] 10.222.0.27 () {58 vars in 1016 bytes} [Wed Oct 12 02:41:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 02:41:51.351463 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f5fcb8-2101-437c-a559-13dd157e257c service nova] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:41:51.363547 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f5fcb8-2101-437c-a559-13dd157e257c service nova] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:41:51.369476 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d722da81-ea1b-4438-9ff7-bec3d958fd85 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fca96c111b45b795fb757f77908ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'beb6def6fcad45959e56425bb8bff4d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:41:51.370061 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d722da81-ea1b-4438-9ff7-bec3d958fd85 service nova] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:41:51.370339 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d722da81-ea1b-4438-9ff7-bec3d958fd85 service nova] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:41:51.370608 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d722da81-ea1b-4438-9ff7-bec3d958fd85 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:41:51.378582 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d722da81-ea1b-4438-9ff7-bec3d958fd85 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:41:51.380145 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d722da81-ea1b-4438-9ff7-bec3d958fd85 service nova] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:41:51.390628 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1292/2585] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 02:41:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 02:42:01.313087 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=15 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:42:01.386360 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=30 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:42:19.253380 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67233ae-dfcc-483e-8e13-5faa4ce3931d None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:42:19.254827 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-d67233ae-dfcc-483e-8e13-5faa4ce3931d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:42:19.318600 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d722da81-ea1b-4438-9ff7-bec3d958fd85 service nova] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:42:19.328945 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d722da81-ea1b-4438-9ff7-bec3d958fd85 service nova] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:42:19.333821 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac80f96-6753-4d04-9307-8d5ff5d2dfb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:42:19.334470 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac80f96-6753-4d04-9307-8d5ff5d2dfb7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:42:19.334750 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac80f96-6753-4d04-9307-8d5ff5d2dfb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:42:19.335043 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac80f96-6753-4d04-9307-8d5ff5d2dfb7 admin admin] PATH_INFO: `/v3/users/122aff6498524be78579f1d1c37c1098` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:42:19.336626 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac80f96-6753-4d04-9307-8d5ff5d2dfb7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=122aff6498524be78579f1d1c37c1098)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:42:19.338894 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac80f96-6753-4d04-9307-8d5ff5d2dfb7 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:42:19.339585 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67233ae-dfcc-483e-8e13-5faa4ce3931d None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:42:19.345980 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f413fde-feed-463f-9f8e-9f0a968e70f1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a58b9e0467c040638c3d43e3ac9c0495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'beb6def6fcad45959e56425bb8bff4d1', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:42:19.346797 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f413fde-feed-463f-9f8e-9f0a968e70f1 service placement] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:42:19.347073 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f413fde-feed-463f-9f8e-9f0a968e70f1 service placement] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:42:19.347344 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f413fde-feed-463f-9f8e-9f0a968e70f1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:42:19.349116 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-0f413fde-feed-463f-9f8e-9f0a968e70f1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:42:19.362261 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f413fde-feed-463f-9f8e-9f0a968e70f1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:42:19.364014 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f413fde-feed-463f-9f8e-9f0a968e70f1 service placement] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:42:19.376175 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1294/2586] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 02:42:19 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 02:42:19.388700 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-2ac80f96-6753-4d04-9307-8d5ff5d2dfb7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '122aff6498524be78579f1d1c37c1098'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:42:19.396573 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-2ac80f96-6753-4d04-9307-8d5ff5d2dfb7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '122aff6498524be78579f1d1c37c1098'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:42:19.410369 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-2ac80f96-6753-4d04-9307-8d5ff5d2dfb7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '122aff6498524be78579f1d1c37c1098'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:42:19.417979 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-2ac80f96-6753-4d04-9307-8d5ff5d2dfb7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '122aff6498524be78579f1d1c37c1098'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:42:19.418677 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-2ac80f96-6753-4d04-9307-8d5ff5d2dfb7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '122aff6498524be78579f1d1c37c1098'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:42:19.424749 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1293/2587] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Oct 12 02:42:19 2022] DELETE /identity/v3/users/122aff6498524be78579f1d1c37c1098 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 02:42:19.601243 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f413fde-feed-463f-9f8e-9f0a968e70f1 service placement] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:42:19.615196 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f413fde-feed-463f-9f8e-9f0a968e70f1 service placement] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:42:19.671821 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbdf992-cefd-4360-9763-6d460ae11946 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:42:19.672443 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbdf992-cefd-4360-9763-6d460ae11946 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:42:19.672748 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbdf992-cefd-4360-9763-6d460ae11946 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:42:19.673018 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbdf992-cefd-4360-9763-6d460ae11946 admin admin] PATH_INFO: `/v3/projects/4d9541e33e4f4751a2fef0ea188fc21d` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:42:19.674130 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dbdf992-cefd-4360-9763-6d460ae11946 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4d9541e33e4f4751a2fef0ea188fc21d)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:42:19.676001 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dbdf992-cefd-4360-9763-6d460ae11946 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:42:19.721330 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-6dbdf992-cefd-4360-9763-6d460ae11946 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4d9541e33e4f4751a2fef0ea188fc21d', 'request_id': 'req-6dbdf992-cefd-4360-9763-6d460ae11946'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:42:19.726734 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-6dbdf992-cefd-4360-9763-6d460ae11946 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4d9541e33e4f4751a2fef0ea188fc21d', 'request_id': 'req-6dbdf992-cefd-4360-9763-6d460ae11946'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:42:19.732994 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-6dbdf992-cefd-4360-9763-6d460ae11946 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4d9541e33e4f4751a2fef0ea188fc21d', 'request_id': 'req-6dbdf992-cefd-4360-9763-6d460ae11946'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:42:19.744933 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-6dbdf992-cefd-4360-9763-6d460ae11946 admin admin] The token cache is being invalidate because project 4d9541e33e4f4751a2fef0ea188fc21d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81362) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 02:42:19.745223 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-6dbdf992-cefd-4360-9763-6d460ae11946 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:42:19.745842 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-6dbdf992-cefd-4360-9763-6d460ae11946 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:42:19.747311 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1295/2588] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Oct 12 02:42:19 2022] DELETE /identity/v3/projects/4d9541e33e4f4751a2fef0ea188fc21d => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 02:42:19.752334 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816ce710-bcb6-4361-aa71-3eaeb9e31482 None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:42:19.752642 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816ce710-bcb6-4361-aa71-3eaeb9e31482 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:42:19.752916 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816ce710-bcb6-4361-aa71-3eaeb9e31482 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:42:19.772804 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-816ce710-bcb6-4361-aa71-3eaeb9e31482 None None] MFA Rules not processed for user `a326a5bb7364479382f528a592371656`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:42:19.774668 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-816ce710-bcb6-4361-aa71-3eaeb9e31482 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:42:19.832005 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1294/2589] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 02:42:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 02:42:19.840770 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8492b9-e8ee-4d7b-96e8-4aba2b17b6be None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:42:19.841086 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8492b9-e8ee-4d7b-96e8-4aba2b17b6be None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:42:19.841407 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8492b9-e8ee-4d7b-96e8-4aba2b17b6be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:42:19.862556 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-3e8492b9-e8ee-4d7b-96e8-4aba2b17b6be None None] MFA Rules not processed for user `a326a5bb7364479382f528a592371656`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:42:19.863771 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-3e8492b9-e8ee-4d7b-96e8-4aba2b17b6be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:42:19.871776 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1296/2590] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 02:42:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 02:42:19.876019 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816ce710-bcb6-4361-aa71-3eaeb9e31482 None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:42:19.886314 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816ce710-bcb6-4361-aa71-3eaeb9e31482 None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:42:19.890841 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2215ccca-f50b-4c18-a873-70137a34c488 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:42:19.891555 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2215ccca-f50b-4c18-a873-70137a34c488 admin admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:42:19.891829 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2215ccca-f50b-4c18-a873-70137a34c488 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:42:19.892100 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2215ccca-f50b-4c18-a873-70137a34c488 admin admin] PATH_INFO: `/v3/domains` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:42:19.892807 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2215ccca-f50b-4c18-a873-70137a34c488 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 02:42:19.893111 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2215ccca-f50b-4c18-a873-70137a34c488 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:42:19.894701 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2215ccca-f50b-4c18-a873-70137a34c488 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:42:19.906836 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1295/2591] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Oct 12 02:42:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 02:42:19.911054 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8492b9-e8ee-4d7b-96e8-4aba2b17b6be None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:42:19.920225 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8492b9-e8ee-4d7b-96e8-4aba2b17b6be None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:42:19.924856 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564ea1ba-0521-41e6-8cc6-38c985219845 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:42:19.925447 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564ea1ba-0521-41e6-8cc6-38c985219845 admin admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:42:19.925722 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564ea1ba-0521-41e6-8cc6-38c985219845 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:42:19.925993 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564ea1ba-0521-41e6-8cc6-38c985219845 admin admin] PATH_INFO: `/v3/projects` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:42:19.926616 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564ea1ba-0521-41e6-8cc6-38c985219845 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:42:19.928609 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564ea1ba-0521-41e6-8cc6-38c985219845 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:42:19.939686 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:42:19.958093 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1297/2592] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Oct 12 02:42:19 2022] POST /identity/v3/projects => generated 371 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 02:42:19.962877 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2215ccca-f50b-4c18-a873-70137a34c488 admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:42:19.973040 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2215ccca-f50b-4c18-a873-70137a34c488 admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:42:20.028693 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3b5e10-d9d6-47bb-b08f-e90746e85abf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:42:20.029309 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3b5e10-d9d6-47bb-b08f-e90746e85abf admin admin] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:42:20.029585 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3b5e10-d9d6-47bb-b08f-e90746e85abf admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:42:20.029855 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3b5e10-d9d6-47bb-b08f-e90746e85abf admin admin] PATH_INFO: `/v3/users` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:42:20.030485 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3b5e10-d9d6-47bb-b08f-e90746e85abf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:42:20.032392 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3b5e10-d9d6-47bb-b08f-e90746e85abf admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:42:20.040483 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:42:20.053779 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1296/2593] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Oct 12 02:42:19 2022] POST /identity/v3/users => generated 286 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 02:42:20.057880 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564ea1ba-0521-41e6-8cc6-38c985219845 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:42:20.068032 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564ea1ba-0521-41e6-8cc6-38c985219845 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:42:20.073343 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b9696d-ab9b-439d-a694-20b669c71070 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:42:20.073934 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b9696d-ab9b-439d-a694-20b669c71070 admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:42:20.074208 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b9696d-ab9b-439d-a694-20b669c71070 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:42:20.074473 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b9696d-ab9b-439d-a694-20b669c71070 admin admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:42:20.075106 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b9696d-ab9b-439d-a694-20b669c71070 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:42:20.076705 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b9696d-ab9b-439d-a694-20b669c71070 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:42:20.087121 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1298/2594] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Oct 12 02:42:20 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 02:42:20.090951 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3b5e10-d9d6-47bb-b08f-e90746e85abf admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:42:20.101045 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3b5e10-d9d6-47bb-b08f-e90746e85abf admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:42:20.106004 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80688b16-ba7b-45ce-892b-61447d1810f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:42:20.106593 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80688b16-ba7b-45ce-892b-61447d1810f3 admin admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:42:20.106869 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80688b16-ba7b-45ce-892b-61447d1810f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:42:20.107134 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80688b16-ba7b-45ce-892b-61447d1810f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:42:20.107770 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80688b16-ba7b-45ce-892b-61447d1810f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:42:20.109483 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80688b16-ba7b-45ce-892b-61447d1810f3 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:42:20.120738 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1297/2595] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Oct 12 02:42:20 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 02:42:20.124948 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b9696d-ab9b-439d-a694-20b669c71070 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:42:20.135732 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b9696d-ab9b-439d-a694-20b669c71070 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:42:20.140397 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf2a41d-8a22-4bd1-86eb-f2746044ea49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:42:20.141088 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf2a41d-8a22-4bd1-86eb-f2746044ea49 admin admin] REQUEST_METHOD: `PUT` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:42:20.141370 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf2a41d-8a22-4bd1-86eb-f2746044ea49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:42:20.141648 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf2a41d-8a22-4bd1-86eb-f2746044ea49 admin admin] PATH_INFO: `/v3/projects/a2e62e5890dd476e9b5ec4dd20a265a7/users/e032911d38994aa29e04266deb1cf630/roles/3d75c4d7f1a849b9a771504d1583ab28` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:42:20.157219 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf2a41d-8a22-4bd1-86eb-f2746044ea49 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a2e62e5890dd476e9b5ec4dd20a265a7, user_id=e032911d38994aa29e04266deb1cf630, role_id=3d75c4d7f1a849b9a771504d1583ab28)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:42:20.159964 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf2a41d-8a22-4bd1-86eb-f2746044ea49 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:42:20.172389 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1299/2596] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Oct 12 02:42:20 2022] PUT /identity/v3/projects/a2e62e5890dd476e9b5ec4dd20a265a7/users/e032911d38994aa29e04266deb1cf630/roles/3d75c4d7f1a849b9a771504d1583ab28 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 02:42:20.177432 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40df19c8-0dcb-43a2-9835-60cdb44632ca None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:42:20.177735 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40df19c8-0dcb-43a2-9835-60cdb44632ca None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:42:20.178010 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40df19c8-0dcb-43a2-9835-60cdb44632ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:42:20.198084 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-40df19c8-0dcb-43a2-9835-60cdb44632ca None None] MFA Rules not processed for user `a326a5bb7364479382f528a592371656`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:42:20.199310 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-40df19c8-0dcb-43a2-9835-60cdb44632ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:42:20.256789 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1298/2597] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 02:42:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 02:42:20.266987 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf2a41d-8a22-4bd1-86eb-f2746044ea49 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:42:20.268804 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-ecf2a41d-8a22-4bd1-86eb-f2746044ea49 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:42:20.327992 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf2a41d-8a22-4bd1-86eb-f2746044ea49 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:42:20.332021 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b9a849-ce01-415b-b93e-7c4a85e391e2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5223b5cab3114e9b9a13c582f8ef8386', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'beb6def6fcad45959e56425bb8bff4d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:42:20.332997 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b9a849-ce01-415b-b93e-7c4a85e391e2 service neutron] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:42:20.333111 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b9a849-ce01-415b-b93e-7c4a85e391e2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:42:20.333282 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b9a849-ce01-415b-b93e-7c4a85e391e2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:42:20.342527 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b9a849-ce01-415b-b93e-7c4a85e391e2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:42:20.343941 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b9a849-ce01-415b-b93e-7c4a85e391e2 service neutron] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:42:20.353505 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1300/2598] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 02:42:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 02:42:24.055350 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b50e13-1620-4e48-9c2d-a003ab6c9b25 None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:42:24.056335 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b50e13-1620-4e48-9c2d-a003ab6c9b25 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:42:24.056335 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b50e13-1620-4e48-9c2d-a003ab6c9b25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:42:24.091703 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-46b50e13-1620-4e48-9c2d-a003ab6c9b25 None None] MFA Rules not processed for user `e032911d38994aa29e04266deb1cf630`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:42:24.093405 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-46b50e13-1620-4e48-9c2d-a003ab6c9b25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:42:24.184742 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1299/2599] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 02:42:24 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 02:42:24.187257 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b9a849-ce01-415b-b93e-7c4a85e391e2 service neutron] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:42:24.198777 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b9a849-ce01-415b-b93e-7c4a85e391e2 service neutron] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:42:24.203815 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5a19ec-37c2-406e-b605-bb6fd46ca4d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:42:24.204427 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5a19ec-37c2-406e-b605-bb6fd46ca4d4 admin admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:42:24.204922 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5a19ec-37c2-406e-b605-bb6fd46ca4d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:42:24.205354 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5a19ec-37c2-406e-b605-bb6fd46ca4d4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:42:24.206164 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5a19ec-37c2-406e-b605-bb6fd46ca4d4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:42:24.208225 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5a19ec-37c2-406e-b605-bb6fd46ca4d4 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:42:24.239812 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1301/2600] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Oct 12 02:42:24 2022] POST /identity/v3/projects => generated 373 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 02:42:24.244508 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b50e13-1620-4e48-9c2d-a003ab6c9b25 None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:42:24.259369 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b50e13-1620-4e48-9c2d-a003ab6c9b25 None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:42:24.325274 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3abf82-8e31-4ab4-a143-fa19c3cd717d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:42:24.326141 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3abf82-8e31-4ab4-a143-fa19c3cd717d admin admin] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:42:24.326499 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3abf82-8e31-4ab4-a143-fa19c3cd717d admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:42:24.326846 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3abf82-8e31-4ab4-a143-fa19c3cd717d admin admin] PATH_INFO: `/v3/users` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:42:24.327613 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3abf82-8e31-4ab4-a143-fa19c3cd717d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:42:24.329976 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3abf82-8e31-4ab4-a143-fa19c3cd717d admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:42:24.350282 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:INSERT=6,keystone:SELECT=94 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:42:24.359849 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1300/2601] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Oct 12 02:42:24 2022] POST /identity/v3/users => generated 293 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 02:42:24.363784 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5a19ec-37c2-406e-b605-bb6fd46ca4d4 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:42:24.375751 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5a19ec-37c2-406e-b605-bb6fd46ca4d4 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:42:24.381981 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9114ebf6-7ae9-4f9c-89e9-a8e24063c663 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:42:24.382610 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9114ebf6-7ae9-4f9c-89e9-a8e24063c663 admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:42:24.382916 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9114ebf6-7ae9-4f9c-89e9-a8e24063c663 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:42:24.383390 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9114ebf6-7ae9-4f9c-89e9-a8e24063c663 admin admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:42:24.384123 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9114ebf6-7ae9-4f9c-89e9-a8e24063c663 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:42:24.385921 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9114ebf6-7ae9-4f9c-89e9-a8e24063c663 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:42:24.397927 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1302/2602] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Oct 12 02:42:24 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 02:42:24.402404 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3abf82-8e31-4ab4-a143-fa19c3cd717d admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:42:24.414620 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3abf82-8e31-4ab4-a143-fa19c3cd717d admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:42:24.419525 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19f3201-952d-4b4f-b458-d2298927a838 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:42:24.420202 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19f3201-952d-4b4f-b458-d2298927a838 admin admin] REQUEST_METHOD: `PUT` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:42:24.420500 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19f3201-952d-4b4f-b458-d2298927a838 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:42:24.420805 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19f3201-952d-4b4f-b458-d2298927a838 admin admin] PATH_INFO: `/v3/projects/d84657ed75a344c0a517a4f50d421d32/users/6212fe7d7fae42f695ff03d52b686f69/roles/39b1e8108dff402383def3c559f48189` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:42:24.440859 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19f3201-952d-4b4f-b458-d2298927a838 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d84657ed75a344c0a517a4f50d421d32, user_id=6212fe7d7fae42f695ff03d52b686f69, role_id=39b1e8108dff402383def3c559f48189)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:42:24.443761 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19f3201-952d-4b4f-b458-d2298927a838 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:42:24.459412 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1301/2603] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Oct 12 02:42:24 2022] PUT /identity/v3/projects/d84657ed75a344c0a517a4f50d421d32/users/6212fe7d7fae42f695ff03d52b686f69/roles/39b1e8108dff402383def3c559f48189 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 02:42:24.464239 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9114ebf6-7ae9-4f9c-89e9-a8e24063c663 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:42:24.475503 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9114ebf6-7ae9-4f9c-89e9-a8e24063c663 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:42:24.559107 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db334e87-c967-48e2-b9e3-1b68d3aee3f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:42:24.559862 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db334e87-c967-48e2-b9e3-1b68d3aee3f2 admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:42:24.560225 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db334e87-c967-48e2-b9e3-1b68d3aee3f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:42:24.560531 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db334e87-c967-48e2-b9e3-1b68d3aee3f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:42:24.561188 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db334e87-c967-48e2-b9e3-1b68d3aee3f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:42:24.562994 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db334e87-c967-48e2-b9e3-1b68d3aee3f2 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:42:24.576782 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1303/2604] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Oct 12 02:42:24 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 02:42:24.579390 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19f3201-952d-4b4f-b458-d2298927a838 admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:42:24.591123 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19f3201-952d-4b4f-b458-d2298927a838 admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:42:24.596040 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12868fc0-eee5-4682-816a-d59dc0c26c0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:42:24.596723 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12868fc0-eee5-4682-816a-d59dc0c26c0e admin admin] REQUEST_METHOD: `PUT` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:42:24.596998 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12868fc0-eee5-4682-816a-d59dc0c26c0e admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:42:24.597265 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12868fc0-eee5-4682-816a-d59dc0c26c0e admin admin] PATH_INFO: `/v3/projects/d84657ed75a344c0a517a4f50d421d32/users/6212fe7d7fae42f695ff03d52b686f69/roles/39b1e8108dff402383def3c559f48189` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:42:24.599167 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12868fc0-eee5-4682-816a-d59dc0c26c0e admin admin] RBAC: Authorizing `identity:create_grant(project_id=d84657ed75a344c0a517a4f50d421d32, user_id=6212fe7d7fae42f695ff03d52b686f69, role_id=39b1e8108dff402383def3c559f48189)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:42:24.601873 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12868fc0-eee5-4682-816a-d59dc0c26c0e admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:42:24.612014 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1302/2605] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Oct 12 02:42:24 2022] PUT /identity/v3/projects/d84657ed75a344c0a517a4f50d421d32/users/6212fe7d7fae42f695ff03d52b686f69/roles/39b1e8108dff402383def3c559f48189 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 02:42:29.236723 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9945c9-2035-4999-a9d4-5594dddb5892 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:42:29.237280 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9945c9-2035-4999-a9d4-5594dddb5892 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:42:29.237280 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9945c9-2035-4999-a9d4-5594dddb5892 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:42:29.271816 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-7c9945c9-2035-4999-a9d4-5594dddb5892 None None] MFA Rules not processed for user `6212fe7d7fae42f695ff03d52b686f69`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:42:29.273476 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-7c9945c9-2035-4999-a9d4-5594dddb5892 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:42:29.285985 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:42:29.352112 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1304/2606] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 02:42:29 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 02:42:29.370211 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12868fc0-eee5-4682-816a-d59dc0c26c0e admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:42:29.373320 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-12868fc0-eee5-4682-816a-d59dc0c26c0e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:42:29.453177 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12868fc0-eee5-4682-816a-d59dc0c26c0e admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:42:29.458931 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8fbf95-8ac4-4bc7-b510-a5da1d79b7db service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fca96c111b45b795fb757f77908ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'beb6def6fcad45959e56425bb8bff4d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:42:29.459555 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8fbf95-8ac4-4bc7-b510-a5da1d79b7db service nova] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:42:29.459835 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8fbf95-8ac4-4bc7-b510-a5da1d79b7db service nova] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:42:29.460106 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8fbf95-8ac4-4bc7-b510-a5da1d79b7db service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:42:29.519475 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8fbf95-8ac4-4bc7-b510-a5da1d79b7db service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:42:29.521094 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8fbf95-8ac4-4bc7-b510-a5da1d79b7db service nova] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:42:29.530392 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1303/2607] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 02:42:29 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 12 02:42:30.527524 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7895f034-e355-40c4-9e00-5bdea1d07a14 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:42:30.528072 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7895f034-e355-40c4-9e00-5bdea1d07a14 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:42:30.528072 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7895f034-e355-40c4-9e00-5bdea1d07a14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:42:30.551020 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-7895f034-e355-40c4-9e00-5bdea1d07a14 None None] MFA Rules not processed for user `e032911d38994aa29e04266deb1cf630`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 02:42:30.552419 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-7895f034-e355-40c4-9e00-5bdea1d07a14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:42:30.564386 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1305/2608] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 02:42:30 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 02:42:39.527159 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=72,keystone:INSERT=2 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:42:40.544563 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=27 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:42:42.935228 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8fbf95-8ac4-4bc7-b510-a5da1d79b7db service nova] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:42:42.988626 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8fbf95-8ac4-4bc7-b510-a5da1d79b7db service nova] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:42:42.992167 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cb6fea-471f-4984-a99c-481b4a0f7b42 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5223b5cab3114e9b9a13c582f8ef8386', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'beb6def6fcad45959e56425bb8bff4d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:42:42.992830 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cb6fea-471f-4984-a99c-481b4a0f7b42 service neutron] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:42:42.993248 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cb6fea-471f-4984-a99c-481b4a0f7b42 service neutron] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:42:42.993525 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cb6fea-471f-4984-a99c-481b4a0f7b42 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:42:42.995256 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-e5cb6fea-471f-4984-a99c-481b4a0f7b42 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:42:43.004712 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5cb6fea-471f-4984-a99c-481b4a0f7b42 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:42:43.006133 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5cb6fea-471f-4984-a99c-481b4a0f7b42 service neutron] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:42:43.015025 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1304/2609] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 02:42:42 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 02:42:53.011469 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=26 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:42:54.252736 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7895f034-e355-40c4-9e00-5bdea1d07a14 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:42:54.254155 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-7895f034-e355-40c4-9e00-5bdea1d07a14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:42:54.266669 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7895f034-e355-40c4-9e00-5bdea1d07a14 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:42:54.270241 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd1702e-8140-4e31-a334-c439550bbc10 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5223b5cab3114e9b9a13c582f8ef8386', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'beb6def6fcad45959e56425bb8bff4d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:42:54.270835 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd1702e-8140-4e31-a334-c439550bbc10 service neutron] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:42:54.271109 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd1702e-8140-4e31-a334-c439550bbc10 service neutron] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:42:54.271377 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd1702e-8140-4e31-a334-c439550bbc10 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:42:54.280699 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd1702e-8140-4e31-a334-c439550bbc10 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:42:54.282102 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd1702e-8140-4e31-a334-c439550bbc10 service neutron] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:42:54.291618 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1306/2610] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 02:42:54 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 02:43:04.287334 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=6 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:43:45.025999 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cb6fea-471f-4984-a99c-481b4a0f7b42 service neutron] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:43:45.027461 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-e5cb6fea-471f-4984-a99c-481b4a0f7b42 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:43:45.094126 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cb6fea-471f-4984-a99c-481b4a0f7b42 service neutron] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:43:45.099640 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6e7db0-8cd7-4cae-a76f-37a6cae3e52f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a58b9e0467c040638c3d43e3ac9c0495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'beb6def6fcad45959e56425bb8bff4d1', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:43:45.100238 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6e7db0-8cd7-4cae-a76f-37a6cae3e52f service placement] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:43:45.100563 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6e7db0-8cd7-4cae-a76f-37a6cae3e52f service placement] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:43:45.100830 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6e7db0-8cd7-4cae-a76f-37a6cae3e52f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:43:45.102509 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-2a6e7db0-8cd7-4cae-a76f-37a6cae3e52f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:43:45.114551 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6e7db0-8cd7-4cae-a76f-37a6cae3e52f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:43:45.116110 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6e7db0-8cd7-4cae-a76f-37a6cae3e52f service placement] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:43:45.126072 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1305/2611] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 02:43:45 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 02:43:55.121803 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=32 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:45:03.848416 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd1702e-8140-4e31-a334-c439550bbc10 service neutron] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:45:03.858006 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd1702e-8140-4e31-a334-c439550bbc10 service neutron] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:45:03.861954 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c6a6eb-44cb-4836-95cb-842de10dbcfd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5223b5cab3114e9b9a13c582f8ef8386', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'beb6def6fcad45959e56425bb8bff4d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:45:03.862580 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c6a6eb-44cb-4836-95cb-842de10dbcfd service neutron] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:45:03.862997 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c6a6eb-44cb-4836-95cb-842de10dbcfd service neutron] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:45:03.863280 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c6a6eb-44cb-4836-95cb-842de10dbcfd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:45:03.865064 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-64c6a6eb-44cb-4836-95cb-842de10dbcfd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:45:03.875785 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c6a6eb-44cb-4836-95cb-842de10dbcfd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:45:03.877179 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c6a6eb-44cb-4836-95cb-842de10dbcfd service neutron] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:45:03.885583 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1307/2612] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 02:45:03 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 02:45:04.005264 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6e7db0-8cd7-4cae-a76f-37a6cae3e52f service placement] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:45:04.014923 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6e7db0-8cd7-4cae-a76f-37a6cae3e52f service placement] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:45:04.018527 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b8865b-ed98-40c5-9ad8-9416b76c3c5d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5223b5cab3114e9b9a13c582f8ef8386', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'beb6def6fcad45959e56425bb8bff4d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:45:04.019117 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b8865b-ed98-40c5-9ad8-9416b76c3c5d service neutron] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:45:04.019396 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b8865b-ed98-40c5-9ad8-9416b76c3c5d service neutron] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:45:04.019667 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b8865b-ed98-40c5-9ad8-9416b76c3c5d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:45:04.021403 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-92b8865b-ed98-40c5-9ad8-9416b76c3c5d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:45:04.037687 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b8865b-ed98-40c5-9ad8-9416b76c3c5d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:45:04.039108 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b8865b-ed98-40c5-9ad8-9416b76c3c5d service neutron] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:45:04.050708 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1306/2613] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 02:45:04 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 02:45:13.882003 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=6 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:45:14.045944 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=6 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:45:52.733223 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c6a6eb-44cb-4836-95cb-842de10dbcfd service neutron] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:45:52.741996 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c6a6eb-44cb-4836-95cb-842de10dbcfd service neutron] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:45:52.745636 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72c5ee1-d907-4a40-a6f6-d264ab40ec3c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5223b5cab3114e9b9a13c582f8ef8386', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'beb6def6fcad45959e56425bb8bff4d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:45:52.746229 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72c5ee1-d907-4a40-a6f6-d264ab40ec3c service neutron] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:45:52.746507 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72c5ee1-d907-4a40-a6f6-d264ab40ec3c service neutron] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:45:52.747430 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72c5ee1-d907-4a40-a6f6-d264ab40ec3c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:45:52.749349 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-d72c5ee1-d907-4a40-a6f6-d264ab40ec3c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:45:52.758765 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72c5ee1-d907-4a40-a6f6-d264ab40ec3c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:45:52.760168 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72c5ee1-d907-4a40-a6f6-d264ab40ec3c service neutron] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:45:52.768388 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1308/2614] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 02:45:52 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 02:46:02.764747 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=6 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:46:21.866887 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b8865b-ed98-40c5-9ad8-9416b76c3c5d service neutron] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:46:21.879621 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b8865b-ed98-40c5-9ad8-9416b76c3c5d service neutron] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:46:21.885554 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadbea99-b367-422f-b2b8-0a4bfb7bf32f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fca96c111b45b795fb757f77908ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'beb6def6fcad45959e56425bb8bff4d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:46:21.886284 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadbea99-b367-422f-b2b8-0a4bfb7bf32f service nova] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:46:21.886881 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadbea99-b367-422f-b2b8-0a4bfb7bf32f service nova] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:46:21.887119 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadbea99-b367-422f-b2b8-0a4bfb7bf32f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:46:21.889028 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-cadbea99-b367-422f-b2b8-0a4bfb7bf32f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:46:21.901684 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cadbea99-b367-422f-b2b8-0a4bfb7bf32f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:46:21.903352 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cadbea99-b367-422f-b2b8-0a4bfb7bf32f service nova] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:46:21.914560 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1307/2615] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 02:46:21 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 02:46:22.074091 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72c5ee1-d907-4a40-a6f6-d264ab40ec3c service neutron] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:46:22.083298 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72c5ee1-d907-4a40-a6f6-d264ab40ec3c service neutron] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:46:22.087043 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fa024a-52de-49ea-bd18-248d0cc2aee2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5223b5cab3114e9b9a13c582f8ef8386', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'beb6def6fcad45959e56425bb8bff4d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:46:22.087720 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fa024a-52de-49ea-bd18-248d0cc2aee2 service neutron] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:46:22.088064 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fa024a-52de-49ea-bd18-248d0cc2aee2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:46:22.088399 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fa024a-52de-49ea-bd18-248d0cc2aee2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:46:22.091609 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-48fa024a-52de-49ea-bd18-248d0cc2aee2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:46:22.106660 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48fa024a-52de-49ea-bd18-248d0cc2aee2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:46:22.108237 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48fa024a-52de-49ea-bd18-248d0cc2aee2 service neutron] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:46:22.120083 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1309/2616] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 02:46:22 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 02:46:23.301375 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadbea99-b367-422f-b2b8-0a4bfb7bf32f service nova] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:46:23.311347 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadbea99-b367-422f-b2b8-0a4bfb7bf32f service nova] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:46:23.315046 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed75a8e-964c-4c5c-a650-c54f65b7eb40 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5223b5cab3114e9b9a13c582f8ef8386', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'beb6def6fcad45959e56425bb8bff4d1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:46:23.315842 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed75a8e-964c-4c5c-a650-c54f65b7eb40 service neutron] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:46:23.316117 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed75a8e-964c-4c5c-a650-c54f65b7eb40 service neutron] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:46:23.316387 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed75a8e-964c-4c5c-a650-c54f65b7eb40 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:46:23.318195 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-5ed75a8e-964c-4c5c-a650-c54f65b7eb40 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:46:23.331880 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed75a8e-964c-4c5c-a650-c54f65b7eb40 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:46:23.333326 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed75a8e-964c-4c5c-a650-c54f65b7eb40 service neutron] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:46:23.344072 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1308/2617] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 02:46:23 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 02:46:29.705575 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fa024a-52de-49ea-bd18-248d0cc2aee2 service neutron] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:46:29.718272 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fa024a-52de-49ea-bd18-248d0cc2aee2 service neutron] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:46:29.723676 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2aa9f7-03a4-4b77-8988-28a45022435c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a58b9e0467c040638c3d43e3ac9c0495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'beb6def6fcad45959e56425bb8bff4d1', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:46:29.724281 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2aa9f7-03a4-4b77-8988-28a45022435c service placement] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:46:29.724599 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2aa9f7-03a4-4b77-8988-28a45022435c service placement] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:46:29.725050 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2aa9f7-03a4-4b77-8988-28a45022435c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:46:29.726763 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-0a2aa9f7-03a4-4b77-8988-28a45022435c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:46:29.739432 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2aa9f7-03a4-4b77-8988-28a45022435c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:46:29.741065 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2aa9f7-03a4-4b77-8988-28a45022435c service placement] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:46:29.752579 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1310/2618] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 02:46:29 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 02:46:32.961741 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed75a8e-964c-4c5c-a650-c54f65b7eb40 service neutron] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:46:33.024697 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed75a8e-964c-4c5c-a650-c54f65b7eb40 service neutron] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:46:33.029829 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3aa1b5-a5d6-42d9-bdb1-933586ee3422 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:46:33.030442 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3aa1b5-a5d6-42d9-bdb1-933586ee3422 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:46:33.030717 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3aa1b5-a5d6-42d9-bdb1-933586ee3422 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:46:33.030987 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3aa1b5-a5d6-42d9-bdb1-933586ee3422 admin admin] PATH_INFO: `/v3/users/e032911d38994aa29e04266deb1cf630` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:46:33.032081 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3aa1b5-a5d6-42d9-bdb1-933586ee3422 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e032911d38994aa29e04266deb1cf630)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:46:33.034029 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3aa1b5-a5d6-42d9-bdb1-933586ee3422 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:46:33.079604 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-1f3aa1b5-a5d6-42d9-bdb1-933586ee3422 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e032911d38994aa29e04266deb1cf630'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:46:33.086638 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-1f3aa1b5-a5d6-42d9-bdb1-933586ee3422 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e032911d38994aa29e04266deb1cf630'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:46:33.099273 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-1f3aa1b5-a5d6-42d9-bdb1-933586ee3422 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e032911d38994aa29e04266deb1cf630'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:46:33.106063 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-1f3aa1b5-a5d6-42d9-bdb1-933586ee3422 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e032911d38994aa29e04266deb1cf630'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:46:33.106691 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-1f3aa1b5-a5d6-42d9-bdb1-933586ee3422 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e032911d38994aa29e04266deb1cf630'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:46:33.112437 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1309/2619] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Oct 12 02:46:32 2022] DELETE /identity/v3/users/e032911d38994aa29e04266deb1cf630 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 02:46:33.282248 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2aa9f7-03a4-4b77-8988-28a45022435c service placement] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:46:33.292942 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2aa9f7-03a4-4b77-8988-28a45022435c service placement] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:46:33.349253 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec647a36-7a93-4bdf-908a-97e9b82f38a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:46:33.349881 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec647a36-7a93-4bdf-908a-97e9b82f38a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:46:33.350154 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec647a36-7a93-4bdf-908a-97e9b82f38a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:46:33.350423 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec647a36-7a93-4bdf-908a-97e9b82f38a5 admin admin] PATH_INFO: `/v3/projects/a2e62e5890dd476e9b5ec4dd20a265a7` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:46:33.351520 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec647a36-7a93-4bdf-908a-97e9b82f38a5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a2e62e5890dd476e9b5ec4dd20a265a7)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:46:33.353426 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec647a36-7a93-4bdf-908a-97e9b82f38a5 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:46:33.399345 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-ec647a36-7a93-4bdf-908a-97e9b82f38a5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a2e62e5890dd476e9b5ec4dd20a265a7', 'request_id': 'req-ec647a36-7a93-4bdf-908a-97e9b82f38a5'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:46:33.404862 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-ec647a36-7a93-4bdf-908a-97e9b82f38a5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a2e62e5890dd476e9b5ec4dd20a265a7', 'request_id': 'req-ec647a36-7a93-4bdf-908a-97e9b82f38a5'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:46:33.410955 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-ec647a36-7a93-4bdf-908a-97e9b82f38a5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a2e62e5890dd476e9b5ec4dd20a265a7', 'request_id': 'req-ec647a36-7a93-4bdf-908a-97e9b82f38a5'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:46:33.423238 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-ec647a36-7a93-4bdf-908a-97e9b82f38a5 admin admin] The token cache is being invalidate because project a2e62e5890dd476e9b5ec4dd20a265a7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81362) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 02:46:33.423541 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-ec647a36-7a93-4bdf-908a-97e9b82f38a5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:46:33.424178 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-ec647a36-7a93-4bdf-908a-97e9b82f38a5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:46:33.425684 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1311/2620] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Oct 12 02:46:33 2022] DELETE /identity/v3/projects/a2e62e5890dd476e9b5ec4dd20a265a7 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 02:46:33.429657 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3aa1b5-a5d6-42d9-bdb1-933586ee3422 admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:46:33.431036 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-1f3aa1b5-a5d6-42d9-bdb1-933586ee3422 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:46:33.444613 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3aa1b5-a5d6-42d9-bdb1-933586ee3422 admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:46:33.493090 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:46:33.504196 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2782341c-86d7-44a4-a080-026472ee9c68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:46:33.504868 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2782341c-86d7-44a4-a080-026472ee9c68 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:46:33.505148 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2782341c-86d7-44a4-a080-026472ee9c68 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:46:33.505424 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2782341c-86d7-44a4-a080-026472ee9c68 admin admin] PATH_INFO: `/v3/users/6212fe7d7fae42f695ff03d52b686f69` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:46:33.506581 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2782341c-86d7-44a4-a080-026472ee9c68 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6212fe7d7fae42f695ff03d52b686f69)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:46:33.508524 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2782341c-86d7-44a4-a080-026472ee9c68 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:46:33.556496 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-2782341c-86d7-44a4-a080-026472ee9c68 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6212fe7d7fae42f695ff03d52b686f69'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:46:33.564494 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-2782341c-86d7-44a4-a080-026472ee9c68 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6212fe7d7fae42f695ff03d52b686f69'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:46:33.577162 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-2782341c-86d7-44a4-a080-026472ee9c68 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6212fe7d7fae42f695ff03d52b686f69'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:46:33.583899 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-2782341c-86d7-44a4-a080-026472ee9c68 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6212fe7d7fae42f695ff03d52b686f69'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:46:33.584578 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-2782341c-86d7-44a4-a080-026472ee9c68 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6212fe7d7fae42f695ff03d52b686f69'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:46:33.590319 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1310/2621] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Oct 12 02:46:33 2022] DELETE /identity/v3/users/6212fe7d7fae42f695ff03d52b686f69 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 02:46:33.760239 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec647a36-7a93-4bdf-908a-97e9b82f38a5 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:46:33.762026 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-ec647a36-7a93-4bdf-908a-97e9b82f38a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:46:33.774813 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec647a36-7a93-4bdf-908a-97e9b82f38a5 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:46:33.830884 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783f2c57-e349-4812-9487-690fca6c2296 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a326a5bb7364479382f528a592371656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae04d11182384b63981888ea102e1452', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:46:33.831521 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783f2c57-e349-4812-9487-690fca6c2296 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:46:33.831802 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783f2c57-e349-4812-9487-690fca6c2296 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:46:33.832077 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783f2c57-e349-4812-9487-690fca6c2296 admin admin] PATH_INFO: `/v3/projects/d84657ed75a344c0a517a4f50d421d32` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:46:33.833224 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783f2c57-e349-4812-9487-690fca6c2296 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d84657ed75a344c0a517a4f50d421d32)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:46:33.835134 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783f2c57-e349-4812-9487-690fca6c2296 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:46:33.841355 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:46:33.883932 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-783f2c57-e349-4812-9487-690fca6c2296 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd84657ed75a344c0a517a4f50d421d32', 'request_id': 'req-783f2c57-e349-4812-9487-690fca6c2296'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:46:33.889678 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-783f2c57-e349-4812-9487-690fca6c2296 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd84657ed75a344c0a517a4f50d421d32', 'request_id': 'req-783f2c57-e349-4812-9487-690fca6c2296'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:46:33.896322 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-783f2c57-e349-4812-9487-690fca6c2296 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd84657ed75a344c0a517a4f50d421d32', 'request_id': 'req-783f2c57-e349-4812-9487-690fca6c2296'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:46:33.908313 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-783f2c57-e349-4812-9487-690fca6c2296 admin admin] The token cache is being invalidate because project d84657ed75a344c0a517a4f50d421d32 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81362) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 02:46:33.908716 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-783f2c57-e349-4812-9487-690fca6c2296 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:46:33.909319 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-783f2c57-e349-4812-9487-690fca6c2296 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 02:46:33.910796 dv-cinder-849143-14-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1312/2622] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Oct 12 02:46:33 2022] DELETE /identity/v3/projects/d84657ed75a344c0a517a4f50d421d32 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 02:46:43.586916 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=29,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:46:43.905414 dv-cinder-849143-14-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=22,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 02:48:48.999666 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2782341c-86d7-44a4-a080-026472ee9c68 admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 02:48:49.001090 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-2782341c-86d7-44a4-a080-026472ee9c68 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:48:49.144427 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2782341c-86d7-44a4-a080-026472ee9c68 admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 02:48:49.202250 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f11f1f4-3124-42dc-9a90-63d0e39adb21 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a58b9e0467c040638c3d43e3ac9c0495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'beb6def6fcad45959e56425bb8bff4d1', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 02:48:49.202860 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f11f1f4-3124-42dc-9a90-63d0e39adb21 service placement] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 02:48:49.203142 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f11f1f4-3124-42dc-9a90-63d0e39adb21 service placement] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 02:48:49.203418 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f11f1f4-3124-42dc-9a90-63d0e39adb21 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 02:48:49.205275 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-7f11f1f4-3124-42dc-9a90-63d0e39adb21 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 02:48:49.217127 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f11f1f4-3124-42dc-9a90-63d0e39adb21 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 02:48:49.218718 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f11f1f4-3124-42dc-9a90-63d0e39adb21 service placement] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 02:48:49.228854 dv-cinder-849143-14-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1311/2623] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 02:48:48 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 02:48:59.224712 dv-cinder-849143-14-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=89 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}